00010000:00010000:0.0:1746142888.651114:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142888.651117:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746142888.651121:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cc87dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e79 expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.651128:0:22383:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cc87dc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e79 expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.651134:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cc87dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e79 expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.651151:0:22383:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cc87dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e79 expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142888.651159:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096096300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867528704:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142888.651184:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142888.651195:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526912 00000100:00100000:0.0:1746142888.651197:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526912 00000100:00100000:0.0:1746142888.651208:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527552 00000100:00100000:0.0:1746142888.651210:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527552 00000100:00100000:0.0:1746142888.651215:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528064 00000100:00100000:0.0:1746142888.651217:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528064 00000100:00100000:0.0:1746142888.651223:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528576 00000100:00100000:0.0:1746142888.651224:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528576 00000100:00100000:0.0:1746142888.651229:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527424 00000100:00100000:0.0:1746142888.651231:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527424 00000100:00100000:0.0:1746142888.651236:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527936 00000100:00100000:0.0:1746142888.651237:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527936 00000100:00100000:0.0:1746142888.651245:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12382 00000100:00100000:0.0:1746142888.651249:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3763:x1830962867526912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142888.651287:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142888.651290:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142888 -> 1746142888 00002000:00010000:0.0:1746142888.651292:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142888 -> 1746142888 00002000:00010000:0.0:1746142888.651293:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142889 -> 1746142889 00002000:00010000:0.0:1746142888.651295:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142888.651312:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867526912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (256us total) trans 21474840832 rc 0/0 00000100:00100000:0.0:1746142888.651316:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12382 00000100:00100000:0.0:1746142888.651325:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12384 00000100:00100000:0.0:1746142888.651329:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3763:x1830962867528064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142888.651358:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142888.651360:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142888 -> 1746142888 00002000:00010000:0.0:1746142888.651362:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142888 -> 1746142888 00002000:00010000:0.0:1746142888.651363:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142889 -> 1746142889 00002000:00010000:0.0:1746142888.651365:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746142888.651381:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3763:x1830962867528064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (276us total) trans 17179873557 rc 0/0 00000100:00100000:0.0:1746142888.651386:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12384 00000100:00100000:0.0:1746142888.651394:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12386 00000100:00100000:0.0:1746142888.651399:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3763:x1830962867527424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142888.651441:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867527424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (292us total) trans 21474840834 rc 0/0 00000100:00100000:0.0:1746142888.651445:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12386 00000100:00100000:0.0:1746142888.652309:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12388 00000100:00100000:0.0:1746142888.652317:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3765:x1830962867527296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142888.654641:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867527296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2324us (4238us total) trans 21474840836 rc 0/0 00000100:00100000:0.0:1746142888.654648:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12388 00000100:00100000:0.0:1746142888.655175:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096096300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867528704:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142888.655200:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f38e200/0x2fa243e067cc87c7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e64 expref: 10 pid: 22383 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746142888.655218:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067cc87ce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e64 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.655240:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbae00, rc 0) 00000100:00100000:0.0:1746142888.655262:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:31469:x1830962866630016:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 16560us (17395us total) trans 8589936073 rc 0/0 00000100:00100000:0.0:1746142888.655268:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14025 00000100:00100000:0.0:1746142888.655347:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.655361:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866631168 00000100:00100000:0.0:1746142888.655364:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866631168 00000100:00100000:0.0:1746142888.655383:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14028 00000100:00100000:0.0:1746142888.655388:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:31468:x1830962866631168:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142888.655395:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142888.655401:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2bc00/0x2fa243e067cc87f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87e87 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.655423:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2bc00/0x2fa243e067cc87f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e87 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.655431:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2bc00/0x2fa243e067cc87f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e87 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.655444:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142888.655446:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142888.655447:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2bc00, rc 0) 00000100:00100000:0.0:1746142888.655632:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:31468:x1830962866631168:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 243us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142888.655637:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14028 00000100:00100000:0.0:1746142888.662056:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.662098:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.662125:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.662142:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866631552 00000100:00100000:0.0:1746142888.662145:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866631552 00000100:00100000:0.0:1746142888.662188:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12394 00000100:00100000:0.0:1746142888.662195:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:31468:x1830962866631552:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142888.662209:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142888.662221:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87e8e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.662245:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbb000/0x2fa243e067cc870a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e10 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.662252:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142888.662254:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142888.662257:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3592192->4194303] (req 3592192->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.662289:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbb000/0x2fa243e067cc870a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e10 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.662301:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fbb000/0x2fa243e067cc870a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e10 expref: 17 pid: 1852 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746142888.662311:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867529216:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142888.663402:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142888.663441:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.663481:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.663518:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.663574:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866631808 00000100:00100000:0.0:1746142888.663577:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866631808 00002000:00100000:0.0:1746142888.663596:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009734c000 x1830962866631808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:39/0 lens 488/0 e 0 to 0 dl 1746142899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142888.663605:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c000 with x1830962866631808 ext(1048576->2097151) 00002000:00010000:0.0:1746142888.663608:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734c000 00000100:00100000:0.0:1746142888.663617:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866632192 00000100:00100000:0.0:1746142888.663619:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866632192 00002000:00100000:0.0:1746142888.663628:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009734d500 x1830962866632192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:39/0 lens 488/0 e 0 to 0 dl 1746142899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142888.663635:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d500 with x1830962866632192 ext(1048576->2097151) 00002000:00010000:0.0:1746142888.663637:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734d500 00000100:00100000:0.0:1746142888.663644:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3476 00000100:00100000:0.0:1746142888.663648:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962866631808:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142888.666742:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866632320 00000100:00100000:0.0:1746142888.666748:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866632320 00010000:00010000:0.0:1746142888.666773:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbb000/0x2fa243e067cc870a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e10 expref: 18 pid: 1852 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746142888.666813:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5431 00000100:00100000:0.0:1746142888.666817:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962866632320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142888.666826:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142888.666841:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fbb000/0x2fa243e067cc870a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e10 expref: 18 pid: 1852 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746142888.666851:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fbb000/0x2fa243e067cc870a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e10 expref: 18 pid: 1852 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746142888.666869:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142888.666871:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142888.666876:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.666884:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.666923:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142888.666933:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867529472:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142888.667003:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142888.670852:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867529472:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142888.670870:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142888.670960:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962866632320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4098us (4197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142888.670968:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5431 00000100:00100000:0.0:1746142888.671856:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.676042:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.679479:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.679522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.680588:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.680616:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.687204:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.688230:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.697272:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.698015:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.702297:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866634496 00000100:00100000:0.0:1746142888.702305:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866634496 00010000:00010000:0.0:1746142888.702333:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 762 lvb_type: 0 00000100:00100000:0.0:1746142888.702371:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5432 00000100:00100000:0.0:1746142888.703052:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962866634496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142888.703060:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746142888.703070:0:11911:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142888 -> 1746142889 00010000:00010000:0.0:1746142888.703074:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746142888.703082:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746142888.703099:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2a800/0x2fa243e067cc87f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e8e expref: 34 pid: 1854 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746142888.703272:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142888.703274:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142888.703278:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2b000/0x2fa243e067cc880d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ea3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.703285:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b000/0x2fa243e067cc880d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ea3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.703291:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142888.703292:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142888.703294:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067cc881b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87eb1 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.703300:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067cc881b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87eb1 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.703316:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067cc881b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87eb1 expref: 12 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142888.703324:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867530240:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142888.703978:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2b000/0x2fa243e067cc880d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3538943) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ea3 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142888.703991:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867530368:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142888.704008:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142888.707584:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.707604:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.707651:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.711721:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.713999:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.718659:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.720737:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.721620:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.721647:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.732544:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.733738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.736842:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.736886:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.737303:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.749555:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.751679:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.753303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.762237:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.766826:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.767472:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.773731:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.783257:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.794851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.831635:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.831677:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.832047:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.832063:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866640000 00000100:00100000:0.0:1746142888.832067:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866640000 00000100:00100000:0.0:1746142888.832094:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866640256 00000100:00100000:0.0:1746142888.832097:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866640256 00000100:00100000:0.0:1746142888.832110:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 840 00000100:00100000:0.0:1746142888.832115:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2006:x1830962866640000:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142888.832144:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2006:x1830962866640000:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142888.832149:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 840 00000100:00100000:0.0:1746142888.832159:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 841 00000100:00100000:0.0:1746142888.832164:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+6:2006:x1830962866640256:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142888.832186:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+6:2006:x1830962866640256:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 22us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142888.832191:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 841 00000100:00100000:0.0:1746142888.832216:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.832227:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866640128 00000100:00100000:0.0:1746142888.832229:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866640128 00000100:00100000:0.0:1746142888.832244:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 842 00000100:00100000:0.0:1746142888.832248:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+5:2006:x1830962866640128:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142888.832266:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+5:2006:x1830962866640128:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 18us (49us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142888.832271:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 842 00000100:00100000:0.0:1746142888.832315:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.832327:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866640384 00000100:00100000:0.0:1746142888.832330:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866640384 00000100:00100000:0.0:1746142888.832347:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 843 00000100:00100000:0.0:1746142888.832351:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+5:2006:x1830962866640384:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142888.832883:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+5:2006:x1830962866640384:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 20us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142888.832889:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 843 00000100:00100000:0.0:1746142888.920202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.933864:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.933945:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.935507:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866641408 00000100:00100000:0.0:1746142888.935510:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866641408 00000100:00100000:0.0:1746142888.935544:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14030 00000100:00100000:0.0:1746142888.935549:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:31483:x1830962866641408:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142888.935562:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142888.935576:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cc8876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87ef0 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.935630:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935640:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935649:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935659:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935667:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935672:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935739:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107200/0x2fa243e067cc888b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935748:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107200/0x2fa243e067cc888b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935754:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107200/0x2fa243e067cc888b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142888.935761:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142888.935833:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935838:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935843:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935847:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935851:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142888.935854:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935858:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935869:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142888.935871:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142888.935874:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935878:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cc887d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935914:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935918:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935922:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935926:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142888.935927:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935931:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935937:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3d00) 00010000:00010000:0.0:1746142888.935939:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142888.935941:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935944:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cc8884 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142888.935973:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cc8876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ef0 expref: 34 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.935983:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107200/0x2fa243e067cc888b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ef0 expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142888.935988:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142888.935990:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142888.935992:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107200, rc 0) 00000100:00100000:0.0:1746142888.936014:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:31483:x1830962866641408:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 464us (553us total) trans 8589936078 rc 0/0 00000100:00100000:0.0:1746142888.936019:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14030 00000100:00100000:0.0:1746142888.942261:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.950415:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.950737:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.955602:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.967252:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.967286:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.967311:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.967347:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.977464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.983498:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.988865:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142888.990015:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962866643456:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 920us (1154us total) trans 21474840839 rc 0/0 00000100:00100000:0.0:1746142888.990022:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1109 00002000:00100000:0.0:1746142888.990029:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2289664->2297855) req@ffff88012e518a80 x1830962866643456/t21474840839(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:39/0 lens 8680/448 e 0 to 0 dl 1746142899 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142888.990042:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e518a80 with x1830962866643456 ext(2289664->2297855) 00010000:00010000:0.0:1746142888.990046:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093379e00/0x2fa243e067cc88bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2297855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87efe expref: 22 pid: 1853 timeout: 762 lvb_type: 0 00010000:00010000:0.0:1746142888.990057:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093379e00/0x2fa243e067cc88bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2289664->2297855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87efe expref: 22 pid: 1853 timeout: 762 lvb_type: 0 00002000:00010000:0.0:1746142888.990062:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e518a80 00000100:00100000:0.0:1746142888.992954:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.002979:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.003988:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.013283:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.013336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.027835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.027878:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.027944:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.027962:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866644864 00000100:00100000:0.0:1746142889.027966:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866644864 00002000:00100000:0.0:1746142889.027993:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009ceb3100 x1830962866644864/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.028001:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb3100 with x1830962866644864 ext(1048576->2097151) 00002000:00010000:0.0:1746142889.028005:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb3100 00000100:00100000:0.0:1746142889.028348:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3495 00000100:00100000:0.0:1746142889.028359:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962866644608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142889.033317:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.067160:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.073846:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.073897:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.074965:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3500 00000100:00100000:0.0:1746142889.074972:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962866646144:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142889.101149:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.119636:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.123450:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.123523:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.128076:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.133127:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.141675:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.141758:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.148853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.158399:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142889.158787:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142889.164047:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.164157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.164218:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.164292:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866648448 00000100:00100000:0.0:1746142889.164298:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866648448 00010000:00010000:0.0:1746142889.164318:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092732800/0x2fa243e067cc8845 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87edb expref: 37 pid: 1853 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.168469:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.175058:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.180991:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.189562:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.189882:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.196131:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.196178:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.199941:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.201155:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.202670:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866650240 00000100:00100000:0.0:1746142889.202674:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866650240 00002000:00100000:0.0:1746142889.202699:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (716800->720895) req@ffff8800981cd180 x1830962866650240/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.202706:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cd180 with x1830962866650240 ext(716800->720895) 00002000:00010000:0.0:1746142889.202710:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cd180 00000100:00100000:0.0:1746142889.202823:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3504 00000100:00100000:0.0:1746142889.202829:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962866650240:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142889.202946:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962866650240:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 117us (307us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142889.202951:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3504 00002000:00100000:0.0:1746142889.202956:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (716800->720895) req@ffff8800981cd180 x1830962866650240/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746142900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.202962:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cd180 with x1830962866650240 ext(716800->720895) 00002000:00010000:0.0:1746142889.202964:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cd180 00000100:00100000:0.0:1746142889.204678:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.207395:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.207436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.212113:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.214443:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.216391:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.219798:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.224065:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.238800:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.242978:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.251137:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.257239:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.280861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.282291:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.311703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.318729:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866653440 00000100:00100000:0.0:1746142889.318737:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866653440 00000100:00100000:0.0:1746142889.318791:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 700 00000100:00100000:0.0:1746142889.318799:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b7b42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962866653440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.318812:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.318833:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a36000/0x2fa243e067cc8980 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f59 expref: 37 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.318858:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142889.318862:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.318913:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b7b42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962866653440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.318919:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 700 00000100:00100000:0.0:1746142889.332476:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.345635:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.348729:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.350492:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.350552:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.350733:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.350748:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866654592 00000100:00100000:0.0:1746142889.350750:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866654592 00000100:00100000:0.0:1746142889.350789:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12418 00000100:00100000:0.0:1746142889.350794:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962866654592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.350800:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.350809:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cc89b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87f6e expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.350822:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.350824:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.350830:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cc89b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f6e expref: 15 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.350842:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cc89b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f6e expref: 15 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.350851:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74e00, rc 0) 00000100:00100000:0.0:1746142889.350875:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962866654592:12345-192.168.204.50@tcp:101:cat.0 Request processed in 80us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.350879:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12418 00000100:00100000:0.0:1746142889.351483:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.358882:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.359728:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.377301:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.377327:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.381096:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.384160:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.392161:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3765:1830962867535232:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392194:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.392226:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3765:1830962867535744:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392243:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.392258:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867536256:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392270:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.392283:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746142889.392287:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867535616:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392301:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.392313:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3765:1830962867536128:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392326:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.392349:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867536384 00000100:00100000:0.0:1746142889.392355:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867536384 00000100:00100000:0.0:1746142889.392395:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867536256 00000100:00100000:0.0:1746142889.392397:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867536256 00000100:00100000:0.0:1746142889.392408:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867535616 00000100:00100000:0.0:1746142889.392410:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867535616 00000100:00100000:0.0:1746142889.392425:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1746142889.392431:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3762:x1830962867536384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392464:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3762:x1830962867536384:12345-0@lo:400:kworker.0 Request processed in 33us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.392468:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1746142889.392480:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1746142889.392484:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867536256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392504:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867536256:12345-0@lo:400:kworker.0 Request processed in 20us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.392509:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1746142889.392516:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1746142889.392520:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3765:x1830962867535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392540:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3765:x1830962867535616:12345-0@lo:400:kworker.0 Request processed in 20us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.392544:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00080000:0.0:1746142889.392556:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746142889.392559:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746142889.392561:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746142889.392562:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746142889.392564:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746142889.392583:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867535616:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392591:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867536256:0@lo:400:kworker.0 00000100:00080000:0.0:1746142889.392604:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746142889.392616:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3765:1830962867535744:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.392837:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3765:1830962867535232:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.393312:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3765:1830962867536128:0@lo:400:kworker.0 00000100:00100000:0.0:1746142889.395457:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.401057:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.411392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.415588:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.427038:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.436440:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.436489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.440037:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867537024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746142889.440082:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.440265:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867537024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746142889.443536:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.455329:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.458728:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.466957:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.466993:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.470407:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866658432 00000100:00100000:0.0:1746142889.470413:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866658432 00002000:00100000:0.0:1746142889.470441:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012e518380 x1830962866658432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.470451:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e518380 with x1830962866658432 ext(4194304->5033983) 00010000:00010000:0.0:1746142889.470457:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067cc89db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f91 expref: 25 pid: 9580 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.470470:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067cc89db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f91 expref: 25 pid: 9580 timeout: 763 lvb_type: 0 00002000:00010000:0.0:1746142889.470476:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e518380 00000100:00100000:0.0:1746142889.470507:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866658688 00000100:00100000:0.0:1746142889.470510:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866658688 00000100:00100000:0.0:1746142889.470531:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866658560 00000100:00100000:0.0:1746142889.470533:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866658560 00000100:00100000:0.0:1746142889.470548:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12426 00000100:00100000:0.0:1746142889.470553:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962866658688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.470561:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.470572:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87fbb expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.470586:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.470587:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.470593:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fbb expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.470604:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fbb expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.470611:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52c00, rc 0) 00000100:00100000:0.0:1746142889.470635:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962866658688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.470640:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12426 00000100:00100000:0.0:1746142889.470649:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12427 00000100:00100000:0.0:1746142889.470653:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962866658560:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.470659:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.470665:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067cc8a3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87fb4 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.470855:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.470862:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067cc8a3d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fb4 expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.470871:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067cc8a3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fb4 expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.470886:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52200, rc 0) 00000100:00100000:0.0:1746142889.470931:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962866658560:12345-192.168.204.50@tcp:101:cat.0 Request processed in 276us (471us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142889.470936:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12427 00000100:00100000:0.0:1746142889.470953:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1114 00000100:00100000:0.0:1746142889.470958:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962866658432:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142889.480484:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866658944 00000100:00100000:0.0:1746142889.480493:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866658944 00000100:00100000:0.0:1746142889.480542:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12428 00000100:00100000:0.0:1746142889.480549:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962866658944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.480564:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.480577:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067cc8a44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87fc2 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.480601:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.480611:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067cc8a44 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fc2 expref: 26 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.480621:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067cc8a44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fc2 expref: 26 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.480639:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea53200, rc 0) 00000100:00100000:0.0:1746142889.482087:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962866658944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1536us (2059us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142889.482098:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12428 00000100:00100000:0.0:1746142889.482928:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866659072 00000100:00100000:0.0:1746142889.482932:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866659072 00000100:00100000:0.0:1746142889.482961:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12429 00000100:00100000:0.0:1746142889.482967:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:31513:x1830962866659072:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.482975:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.482982:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52a00/0x2fa243e067cc8a4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87fc9 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.482996:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cc8a0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2859007) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fad expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.483000:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142889.483002:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142889.483004:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea52a00/0x2fa243e067cc8a4b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fc9 expref: 33 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.483019:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cc8a0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2859007) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fad expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.483028:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cc8a0c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2699264->2859007) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fad expref: 24 pid: 11943 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.483036:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867537408:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142889.483075:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142889.485353:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.486156:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867537280:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142889.486169:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.486196:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962866659200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3834us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.486204:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5454 00000100:00100000:0.0:1746142889.487355:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.487390:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.488985:0:9582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537664 00000100:00100000:0.0:1746142889.488988:0:9582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537664 00000100:00100000:0.0:1746142889.489010:0:9582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1746142889.489014:0:9582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867537664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746142889.489024:0:9582:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1186159424 pending 4034560 free 3906637824 avail 3675115520 00000100:00100000:0.0:1746142889.489116:0:9582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867537664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.489121:0:9582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1746142889.492535:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.492576:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.492616:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.493832:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.495428:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.496680:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.496707:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.500360:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.502465:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.502935:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866661888 00000100:00100000:0.0:1746142889.502939:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866661888 00002000:00100000:0.0:1746142889.502959:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (393216->397311) req@ffff88009a35a680 x1830962866661888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.502967:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35a680 with x1830962866661888 ext(393216->397311) 00002000:00010000:0.0:1746142889.502970:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35a680 00000100:00100000:0.0:1746142889.502982:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3517 00000100:00100000:0.0:1746142889.502987:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962866661888:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142889.503058:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962866661888:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 71us (209us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142889.503063:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3517 00002000:00100000:0.0:1746142889.503068:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (393216->397311) req@ffff88009a35a680 x1830962866661888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:40/0 lens 488/4536 e 0 to 0 dl 1746142900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.503074:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35a680 with x1830962866661888 ext(393216->397311) 00002000:00010000:0.0:1746142889.503077:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35a680 00000100:00100000:0.0:1746142889.504389:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.510092:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.510864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.528437:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.538859:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.548891:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.550668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.553316:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.557550:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142889.558501:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142889.559365:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866664320 00000100:00100000:0.0:1746142889.559368:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866664320 00000100:00100000:0.0:1746142889.559385:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12433 00000100:00100000:0.0:1746142889.559390:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962866664064:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142889.559397:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.559404:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87ff3 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.559413:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.559415:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.559419:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ff3 expref: 19 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.559428:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ff3 expref: 19 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.559434:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0e00, rc 0) 00000100:00100000:0.0:1746142889.559455:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962866664064:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 64us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.559459:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12433 00000100:00100000:0.0:1746142889.559470:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12434 00000100:00100000:0.0:1746142889.559474:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962866664192:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142889.559480:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.559486:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0400/0x2fa243e067cc8aad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb87ffa expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.559495:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.559496:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.559500:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0400/0x2fa243e067cc8aad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ffa expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.559508:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0400/0x2fa243e067cc8aad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ffa expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.559515:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0400, rc 0) 00000100:00100000:0.0:1746142889.559529:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962866664192:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 54us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.559533:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12434 00000100:00100000:0.0:1746142889.559541:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12435 00000100:00100000:0.0:1746142889.559546:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962866664320:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142889.559551:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.559556:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067cc8ab4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88001 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.559564:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.560255:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.560261:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067cc8ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88001 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.560270:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067cc8ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88001 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.560293:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d1800, rc 0) 00000100:00100000:0.0:1746142889.560312:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962866664320:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 766us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.560317:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12435 00000100:00100000:0.0:1746142889.562010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.564134:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.566650:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.568179:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.571179:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.575177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.577399:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.577434:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.577465:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.577486:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866665600 00000100:00100000:0.0:1746142889.577491:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866665600 00000100:00100000:0.0:1746142889.577534:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12438 00000100:00100000:0.0:1746142889.577541:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+20:2005:x1830962866665856:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142889.577570:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067cc8b01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.577585:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.577592:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ff3 expref: 20 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.577599:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1c00/0x2fa243e067cc87d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e6b expref: 35 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.577605:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.577606:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.577608:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067cc8b01 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.577630:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed1c00/0x2fa243e067cc87d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e6b expref: 35 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.577641:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1c00/0x2fa243e067cc87d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e6b expref: 35 pid: 11943 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.577651:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867538944:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142889.577708:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ff3 expref: 20 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.577715:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ff3 expref: 20 pid: 1397 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.577722:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867539200:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142889.577741:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.577748:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.577755:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867539456:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142889.577780:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142889.577805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.577854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.577923:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.581669:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.583460:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.583493:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.583515:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.583535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.583549:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866666624 00000100:00100000:0.0:1746142889.583553:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866666624 00010000:00010000:0.0:1746142889.583568:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067cc8ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88001 expref: 18 pid: 1397 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.583586:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866666496 00000100:00100000:0.0:1746142889.583587:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866666496 00010000:00010000:0.0:1746142889.583595:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067cc8aa6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ff3 expref: 23 pid: 1397 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.583609:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5463 00000100:00100000:0.0:1746142889.583613:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962866667008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.583620:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.583630:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cc89b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f6e expref: 16 pid: 9580 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.583638:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cc89b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f6e expref: 16 pid: 9580 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.583649:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cc89b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87f6e expref: 16 pid: 9580 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.583661:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.583678:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962866667008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.583686:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5463 00000100:00100000:0.0:1746142889.583722:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.583734:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866666752 00000100:00100000:0.0:1746142889.583737:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866666752 00010000:00010000:0.0:1746142889.583746:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.583774:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5465 00000100:00100000:0.0:1746142889.583780:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962866666752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.583786:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.583793:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.583800:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.583809:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7e00/0x2fa243e067cc87b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e56 expref: 15 pid: 11943 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.583817:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.583819:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.583822:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067cc8b01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.583829:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067cc8b01 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.583850:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.583864:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962866666752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.583868:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5465 00000100:00100000:0.0:1746142889.590539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.590722:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.590742:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866667264 00000100:00100000:0.0:1746142889.590747:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866667264 00010000:00010000:0.0:1746142889.590783:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067cc8806 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e9c expref: 35 pid: 1853 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.590804:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866667648 00000100:00100000:0.0:1746142889.590806:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866667648 00010000:00010000:0.0:1746142889.590814:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067cc8abb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88008 expref: 21 pid: 9580 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.590827:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5466 00000100:00100000:0.0:1746142889.590833:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962866667264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.591303:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.591314:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067cc8806 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e9c expref: 36 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.591321:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067cc8806 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e9c expref: 36 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.591332:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067cc8806 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e9c expref: 36 pid: 1853 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.591341:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.591355:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962866667264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 523us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.591793:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5466 00000100:00100000:0.0:1746142889.591837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.591863:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.591893:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5472 00000100:00100000:0.0:1746142889.591914:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962866667904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.591920:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.591927:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc87e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e72 expref: 24 pid: 1397 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.591934:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc87e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e72 expref: 24 pid: 1397 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.591944:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc87e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e72 expref: 24 pid: 1397 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.591951:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.591953:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.591955:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092733000/0x2fa243e067cc8b1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.591961:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092733000/0x2fa243e067cc8b1d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.591981:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.591993:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962866667904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 95us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.591998:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5472 00000100:00100000:0.0:1746142889.592029:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.592038:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866668160 00000100:00100000:0.0:1746142889.592040:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866668160 00010000:00010000:0.0:1746142889.592049:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fbb expref: 34 pid: 1397 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.592062:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5474 00000100:00100000:0.0:1746142889.592067:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962866668160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.592072:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.592580:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fbb expref: 34 pid: 1397 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.592591:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fbb expref: 34 pid: 1397 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.592602:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067cc8a36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87fbb expref: 34 pid: 1397 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.592609:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.592610:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.592612:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067cc8b24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.592622:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067cc8b24 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.592735:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.592752:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962866668160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 684us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.592768:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5474 00000100:00100000:0.0:1746142889.596016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.603187:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.603206:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.603220:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.603240:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.603403:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866668928 00000100:00100000:0.0:1746142889.603406:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866668928 00010000:00010000:0.0:1746142889.603426:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cc88ae lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ef7 expref: 21 pid: 7230 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.603441:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866668800 00000100:00100000:0.0:1746142889.603442:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866668800 00010000:00010000:0.0:1746142889.603448:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067cc87ce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87e64 expref: 22 pid: 22383 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.603456:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5476 00000100:00100000:0.0:1746142889.603462:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962866668928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.603472:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.603477:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cc88ae lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ef7 expref: 22 pid: 7230 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.603485:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cc88ae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87ef7 expref: 22 pid: 7230 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.603520:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142889.603524:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067cc8b2b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142889.603531:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.603563:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962866668928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.603572:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5476 00000100:00100000:0.0:1746142889.606935:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867541760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142889.607440:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.607453:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867542272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142889.607472:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.607480:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867542784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.607494:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142889.608134:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e519880/2, rc 0, transno 17179873571 00000100:00100000:0.0:1746142889.608142:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867541760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142889.608149:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e519f80/2, rc 0, transno 17179873572 00000100:00100000:0.0:1746142889.608151:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867542272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142889.608157:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644c380/2, rc 0, transno 21474840850 00000100:00100000:0.0:1746142889.608159:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867542784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.608213:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543424 00000100:00100000:0.0:1746142889.608216:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543424 00000100:00100000:0.0:1746142889.608228:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12457 00000100:00100000:0.0:1746142889.608231:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3762:x1830962867543424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142889.608294:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3762:x1830962867543424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (89us total) trans 17179873574 rc 0/0 00000100:00100000:0.0:1746142889.608301:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12457 00000100:00100000:0.0:1746142889.608314:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12458 00000100:00100000:0.0:1746142889.608318:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3764:x1830962867543296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142889.608352:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142889.608354:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142889.608356:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142889.608357:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142889.608359:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:0.0:1746142889.608390:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+75:3764:x1830962867543296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1035us total) trans 17179873575 rc 0/0 00000100:00100000:0.0:1746142889.608395:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12458 00000100:00100000:0.0:1746142889.610179:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12459 00000100:00100000:0.0:1746142889.610187:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3763:x1830962867542016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142889.610250:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142889.610253:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142889.610254:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142889.610256:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142889.610257:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142889.610279:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3763:x1830962867542016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1052us total) trans 17179873576 rc 0/0 00000100:00100000:0.0:1746142889.610284:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12459 00000100:00100000:0.0:1746142889.610849:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.615304:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.623688:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633374:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633412:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633438:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633457:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633467:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633489:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.633672:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12469 00000100:00100000:0.0:1746142889.633679:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962866670720:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142889.634257:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962866670720:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 578us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.634262:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12469 00000100:00100000:0.0:1746142889.639344:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12476 00000100:00100000:0.0:1746142889.639351:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+22:2005:x1830962866671104:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142889.640303:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+20:2005:x1830962866671104:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 952us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.640309:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12476 00000100:00100000:0.0:1746142889.645428:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.648280:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.655607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.655651:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.656376:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.656964:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3523 00000100:00100000:0.0:1746142889.656971:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+21:2003:x1830962866672768:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142889.656988:0:20333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.656994:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.656995:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.656998:0:20333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.657005:0:20333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679066:0:20333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679076:0:20333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679082:0:20333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679087:0:20333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe5c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142889.679089:0:20333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679287:0:20333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679300:0:20333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.679309:0:20333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8b7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142889.679365:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+25:2003:x1830962866672768:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 22394us (22989us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142889.679372:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3523 00000100:00100000:0.0:1746142889.699417:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.702511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.702545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.702569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.702595:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.702613:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866674048 00000100:00100000:0.0:1746142889.702620:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866674048 00000100:00100000:0.0:1746142889.702647:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866674176 00000100:00100000:0.0:1746142889.702649:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866674176 00000100:00100000:0.0:1746142889.702658:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866674304 00000100:00100000:0.0:1746142889.702660:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866674304 00000100:00100000:0.0:1746142889.702667:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866674432 00000100:00100000:0.0:1746142889.702668:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866674432 00000100:00100000:0.0:1746142889.703028:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12482 00000100:00100000:0.0:1746142889.703034:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+22:2006:x1830962866674176:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142889.703206:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142889.703209:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142889 -> 1746142890 00002000:00010000:0.0:1746142889.703211:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142888 -> 1746142890 00002000:00010000:0.0:1746142889.703213:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142889 -> 1746142890 00002000:00010000:0.0:1746142889.703214:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142889.703232:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866674176:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 197us (686us total) trans 17179873579 rc 0/0 00000100:00100000:0.0:1746142889.703237:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12482 00000100:00100000:0.0:1746142889.703250:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12484 00000100:00100000:0.0:1746142889.703254:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962866674432:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142889.703287:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142889.703289:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142888 -> 1746142890 00002000:00010000:0.0:1746142889.703291:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142888 -> 1746142890 00002000:00010000:0.0:1746142889.703292:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142889 -> 1746142890 00002000:00010000:0.0:1746142889.703294:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142889.703306:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962866674432:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 52us (710us total) trans 21474840854 rc 0/0 00000100:00100000:0.0:1746142889.703311:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12484 00000100:00100000:0.0:1746142889.703334:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.703346:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866674560 00000100:00100000:0.0:1746142889.703348:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866674560 00000100:00100000:0.0:1746142889.703363:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12485 00000100:00100000:0.0:1746142889.703367:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962866674560:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142889.703402:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:0.0:1746142889.703404:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.703406:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.703408:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.703409:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142889.703422:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962866674560:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 54us (87us total) trans 21474840855 rc 0/0 00000100:00100000:0.0:1746142889.703429:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12485 00000100:00100000:0.0:1746142889.703478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.703487:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866674688 00000100:00100000:0.0:1746142889.703489:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866674688 00000100:00100000:0.0:1746142889.703501:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12486 00000100:00100000:0.0:1746142889.703504:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866674688:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142889.703536:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142889.703538:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142889 -> 1746142890 00002000:00010000:0.0:1746142889.703539:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142889 -> 1746142890 00002000:00010000:0.0:1746142889.703541:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142889 -> 1746142890 00002000:00010000:0.0:1746142889.703542:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142889.703553:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+25:2006:x1830962866674688:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 49us (75us total) trans 17179873580 rc 0/0 00000100:00100000:0.0:1746142889.703557:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12486 00000100:00100000:0.0:1746142889.705801:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.709244:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.712011:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867543936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.712074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.712096:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867544448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.712108:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.712118:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867544960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142889.712129:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.712139:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867545472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.712150:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142889.712174:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543936 00000100:00100000:0.0:1746142889.712178:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543936 00000100:00100000:0.0:1746142889.712204:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544448 00000100:00100000:0.0:1746142889.712206:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544448 00000100:00100000:0.0:1746142889.712227:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544960 00000100:00100000:0.0:1746142889.712229:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544960 00000100:00100000:0.0:1746142889.712239:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545472 00000100:00100000:0.0:1746142889.712240:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545472 00000100:00100000:0.0:1746142889.712245:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543808 00000100:00100000:0.0:1746142889.712247:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543808 00000100:00100000:0.0:1746142889.712252:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544192 00000100:00100000:0.0:1746142889.712253:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544192 00000100:00100000:0.0:1746142889.712259:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544832 00000100:00100000:0.0:1746142889.712261:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544832 00000100:00100000:0.0:1746142889.712269:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12487 00000100:00100000:0.0:1746142889.712274:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3765:x1830962867543936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.712339:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12489 00000100:00100000:0.0:1746142889.712344:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:3765:x1830962867544960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142889.712392:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142889.712394:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142889.712396:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142889.712398:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142889.712400:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142889.712418:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+79:3765:x1830962867544960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (287us total) trans 17179873581 rc 0/0 00000100:00100000:0.0:1746142889.712423:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12489 00000100:00100000:0.0:1746142889.712432:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12491 00000100:00100000:0.0:1746142889.712436:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:3764:x1830962867543808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142889.712468:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142889.712471:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712473:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712474:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712476:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746142889.712492:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+79:3764:x1830962867543808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (321us total) trans 17179873582 rc 0/0 00000100:00100000:0.0:1746142889.712496:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12491 00002000:00010000:0.0:1746142889.712526:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142889.712529:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712530:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712532:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712533:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142889.712548:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3765:x1830962867543936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 274us (476us total) trans 21474840857 rc 0/0 00000100:00100000:0.0:1746142889.712553:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12487 00000100:00100000:0.0:1746142889.712615:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544064 00000100:00100000:0.0:1746142889.712617:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544064 00000100:00100000:0.0:1746142889.712630:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12494 00000100:00100000:0.0:1746142889.712634:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:3762:x1830962867544064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142889.712670:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142889.712672:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712673:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712675:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.712676:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142889.712693:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3762:x1830962867544064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (92us total) trans 21474840860 rc 0/0 00000100:00100000:0.0:1746142889.712700:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12494 00000100:00100000:0.0:1746142889.712706:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545600 00000100:00100000:0.0:1746142889.712708:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545600 00000100:00100000:0.0:1746142889.712715:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12496 00000100:00100000:0.0:1746142889.712718:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+66:3762:x1830962867545088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142889.713037:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3762:x1830962867545088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (387us total) trans 21474840861 rc 0/0 00000100:00100000:0.0:1746142889.713041:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12496 00000100:00100000:0.0:1746142889.713131:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545344 00000100:00100000:0.0:1746142889.713134:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545344 00000100:00100000:0.0:1746142889.713148:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12499 00000100:00100000:0.0:1746142889.713152:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+83:3764:x1830962867545344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142889.713200:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+84:3764:x1830962867545344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (81us total) trans 17179873587 rc 0/0 00000100:00100000:0.0:1746142889.713205:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12499 00000100:00100000:0.0:1746142889.713212:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543680 00000100:00100000:0.0:1746142889.713214:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543680 00000100:00100000:0.0:1746142889.713220:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544320 00000100:00100000:0.0:1746142889.713222:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544320 00000100:00100000:0.0:1746142889.713226:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544704 00000100:00100000:0.0:1746142889.713228:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544704 00000100:00100000:0.0:1746142889.713233:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545216 00000100:00100000:0.0:1746142889.713235:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545216 00000100:00100000:0.0:1746142889.713241:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12500 00000100:00100000:0.0:1746142889.713244:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+85:3763:x1830962867543680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142889.713277:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142889.713279:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.713281:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.713283:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.713285:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142889.713305:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3763:x1830962867543680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (138us total) trans 17179873588 rc 0/0 00000100:00100000:0.0:1746142889.713309:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12500 00000100:00100000:0.0:1746142889.713387:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12503 00000100:00100000:0.0:1746142889.713392:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3763:x1830962867545216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142889.713423:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142889.713425:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142889.713427:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142889.713428:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142889.713430:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142889.713449:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3763:x1830962867545216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (217us total) trans 21474840863 rc 0/0 00000100:00100000:0.0:1746142889.713453:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12503 00000100:00100000:0.0:1746142889.718538:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.723340:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.747724:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.749264:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.759257:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.760210:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.760228:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866676352 00000100:00100000:0.0:1746142889.760235:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866676352 00000100:00100000:0.0:1746142889.760274:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14051 00000100:00100000:0.0:1746142889.760280:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:31528:x1830962866676352:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142889.760302:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.760318:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe5c00/0x2fa243e067cc8bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8807f expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.760412:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093378000/0x2fa243e067cc8bfd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142889.760425:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e691400/0x2fa243e067cc8bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8806a expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.760431:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0c00/0x2fa243e067cc8be8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88071 expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.760437:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093378000/0x2fa243e067cc8bfd lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142889.760465:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0c00/0x2fa243e067cc8be8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88071 expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.760475:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0c00/0x2fa243e067cc8be8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88071 expref: 27 pid: 7232 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.760485:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867545856:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142889.761129:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e691400/0x2fa243e067cc8bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8806a expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.761143:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e691400/0x2fa243e067cc8bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8806a expref: 10 pid: 7232 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.761151:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867545984:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142889.761172:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142889.763517:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.763548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.763574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.763605:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866676736 00000100:00100000:0.0:1746142889.763611:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866676736 00000100:00100000:0.0:1746142889.763811:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14052 00000100:00100000:0.0:1746142889.763817:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:31530:x1830962866676736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.763830:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.763840:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067cc8c0b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88086 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.763946:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067cc8c0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88086 expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.763957:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067cc8c0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88086 expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.763970:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142889.763972:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142889.763974:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093379a00, rc 0) 00000100:00100000:0.0:1746142889.763997:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:31530:x1830962866676736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 180us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.764001:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14052 00000100:00100000:0.0:1746142889.768506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.777406:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.782441:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.788138:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.788324:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.793989:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866678016 00000100:00100000:0.0:1746142889.793997:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866678016 00000100:00100000:0.0:1746142889.794046:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12506 00000100:00100000:0.0:1746142889.794054:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:31530:x1830962866678016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.794069:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.794083:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cc8c51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb880a2 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.794103:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.794105:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.794112:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cc8c51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880a2 expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.794124:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cc8c51 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880a2 expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.794133:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d000, rc 0) 00000100:00100000:0.0:1746142889.794183:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:31530:x1830962866678016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 130us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.794189:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12506 00000100:00100000:0.0:1746142889.799825:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.800874:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.801540:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.808029:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.810228:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547904 00000100:00100000:0.0:1746142889.810233:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547904 00000100:00100000:0.0:1746142889.810253:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548416 00000100:00100000:0.0:1746142889.810256:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548416 00000100:00100000:0.0:1746142889.810267:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547776 00000100:00100000:0.0:1746142889.810269:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547776 00000100:00100000:0.0:1746142889.810280:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12521 00000100:00100000:0.0:1746142889.810285:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3763:x1830962867547904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142889.810689:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:0.0:1746142889.810692:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.810694:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.810695:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142889.810697:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142889.810721:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+78:3763:x1830962867547904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 436us (1047us total) trans 21474840869 rc 0/0 00000100:00100000:0.0:1746142889.810727:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12521 00000100:00100000:0.0:1746142889.814519:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867547520:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142889.814554:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7200/0x2fa243e067cc8c43 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8809b expref: 28 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746142889.814581:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cc8c4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8809b expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.814605:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e7a00, rc 0) 00000100:00100000:0.0:1746142889.814640:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:31526:x1830962866677888:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 26001us (26316us total) trans 8589936110 rc 0/0 00000100:00100000:0.0:1746142889.814647:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14054 00000100:00100000:0.0:1746142889.815656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.815692:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.815748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.815772:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866678784 00000100:00100000:0.0:1746142889.815776:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866678784 00000100:00100000:0.0:1746142889.815796:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866678912 00000100:00100000:0.0:1746142889.815798:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866678912 00000100:00100000:0.0:1746142889.815811:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14056 00000100:00100000:0.0:1746142889.815817:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:31530:x1830962866678784:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142889.815825:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.815836:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cc8c66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb880b7 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.815867:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cc8c66 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880b7 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.815878:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cc8c66 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880b7 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.815888:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142889.815891:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142889.815894:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3ca00, rc 0) 00000100:00100000:0.0:1746142889.815927:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:31530:x1830962866678784:12345-192.168.204.50@tcp:101:cat.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.815932:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14056 00000100:00100000:0.0:1746142889.821545:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 706 00000100:00100000:0.0:1746142889.821553:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962866679168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.821561:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.821665:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cc8c66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880b7 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.822222:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142889.822226:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.822249:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962866679168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 698us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.822255:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 706 00000100:00100000:0.0:1746142889.827033:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.827363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.827767:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.836283:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866680192 00000100:00100000:0.0:1746142889.836289:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866680192 00010000:00010000:0.0:1746142889.836311:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24e00/0x2fa243e067cc8b4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8804e expref: 20 pid: 1854 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.837230:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5486 00000100:00100000:0.0:1746142889.837239:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:2003:x1830962866680192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.837251:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.837269:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb24e00/0x2fa243e067cc8b4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8804e expref: 20 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.837281:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb24e00/0x2fa243e067cc8b4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8804e expref: 20 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.837299:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24e00/0x2fa243e067cc8b4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8804e expref: 20 pid: 1854 timeout: 763 lvb_type: 1 00010000:00010000:0.0:1746142889.837331:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.837333:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.837338:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067cc8c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880cc expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.837345:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067cc8c7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880cc expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.837369:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067cc8c7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1794048->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880cc expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142889.837379:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867549184:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142889.837472:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142889.849810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.855005:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.855042:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.855120:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.860696:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866681088 00000100:00100000:0.0:1746142889.860700:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866681088 00000100:00100000:0.0:1746142889.860722:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12529 00000100:00100000:0.0:1746142889.860726:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:31526:x1830962866681088:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142889.860737:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142889.860747:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb880e1 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.860773:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067cc8b6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88055 expref: 18 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.860779:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.860780:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.860783:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->2310143] (req 2097152->2310143) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e1 expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.860797:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067cc8b6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88055 expref: 18 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142889.860806:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067cc8b6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88055 expref: 18 pid: 11421 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.860813:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867549440:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142889.860838:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142889.863715:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866681600 00000100:00100000:0.0:1746142889.863719:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866681600 00002000:00100000:0.0:1746142889.863747:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880091c07b80 x1830962866681600/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.863766:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07b80 with x1830962866681600 ext(1048576->2097151) 00002000:00010000:0.0:1746142889.863770:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c07b80 00000100:00100000:0.0:1746142889.863785:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866681728 00000100:00100000:0.0:1746142889.863787:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866681728 00002000:00100000:0.0:1746142889.863799:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880091c05c00 x1830962866681728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.863805:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05c00 with x1830962866681728 ext(1048576->2097151) 00002000:00010000:0.0:1746142889.863807:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c05c00 00000100:00100000:0.0:1746142889.863814:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866682112 00000100:00100000:0.0:1746142889.863816:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866682112 00002000:00100000:0.0:1746142889.863823:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1699840->1703935) req@ffff880091c05180 x1830962866682112/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:40/0 lens 488/0 e 0 to 0 dl 1746142900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142889.863829:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05180 with x1830962866682112 ext(1699840->1703935) 00002000:00010000:0.0:1746142889.863832:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c05180 00000100:00100000:0.0:1746142889.863839:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3531 00000100:00100000:0.0:1746142889.863843:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962866681728:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:0.0:1746142889.864397:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067cc8b6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88055 expref: 19 pid: 11421 timeout: 763 lvb_type: 1 00000100:00100000:0.0:1746142889.864418:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867549440:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142889.864435:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e1 expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.864443:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3ce00, rc 0) 00000100:00100000:0.0:1746142889.864464:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:31526:x1830962866681088:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3737us (3839us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.864470:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12529 00000100:00100000:0.0:1746142889.864532:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc62a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867549312:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142889.864540:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142889.864554:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962866680960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4327us (4401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142889.864559:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5488 00000100:00100000:0.0:1746142889.869377:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.881063:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.887490:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.887532:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.892339:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.899120:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.902198:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.902272:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.916539:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.916589:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.921454:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.921795:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.924583:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.932524:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.934872:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.934936:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866685056 00000100:00100000:0.0:1746142889.934941:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866685056 00010000:00010000:0.0:1746142889.934964:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e1 expref: 39 pid: 9579 timeout: 763 lvb_type: 0 00000100:00100000:0.0:1746142889.935003:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5491 00000100:00100000:0.0:1746142889.935010:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962866685056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142889.935020:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142889.935037:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e1 expref: 39 pid: 9579 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.935047:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e1 expref: 39 pid: 9579 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.935068:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3ce00/0x2fa243e067cc8c90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2310143) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e1 expref: 39 pid: 9579 timeout: 763 lvb_type: 0 00010000:00010000:0.0:1746142889.935091:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.935093:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142889.935098:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c880200/0x2fa243e067cc8cb3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88104 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.935104:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880200/0x2fa243e067cc8cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88104 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142889.935130:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c880200/0x2fa243e067cc8cb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88104 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142889.935140:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867550336:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142889.935186:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142889.947423:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.949689:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.954131:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.982889:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.999628:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.999651:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142889.999675:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.003072:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.005132:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142890.006407:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142890.008528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.009326:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.009361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.019222:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.022555:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.022648:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.024462:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142890.025401:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142890.027728:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.028806:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034299:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034337:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034364:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034375:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034387:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034398:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034438:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.034596:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12547 00000100:00100000:0.0:1746142890.034603:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+22:2006:x1830962866689920:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142890.034617:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0000/0x2fa243e067cc8d62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.034626:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25c00/0x2fa243e067cc8b5c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88039 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.034632:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800923f2a00/0x2fa243e067cc8c3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88094 expref: 38 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.034643:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094715600/0x2fa243e067cc8c04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88078 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.034647:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.034649:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.034650:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0000/0x2fa243e067cc8d62 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.034663:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094715600/0x2fa243e067cc8c04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88078 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.034670:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094715600/0x2fa243e067cc8c04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88078 expref: 25 pid: 9578 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.034676:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867551872:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142890.035977:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800923f2a00/0x2fa243e067cc8c3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88094 expref: 38 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.035988:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800923f2a00/0x2fa243e067cc8c3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88094 expref: 38 pid: 9580 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.035996:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867553152:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142890.036028:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb25c00/0x2fa243e067cc8b5c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88039 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.036040:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25c00/0x2fa243e067cc8b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88039 expref: 22 pid: 1854 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746142890.036048:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867553280:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142890.036062:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142890.051544:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051560:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051572:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051588:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051603:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051615:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051626:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051641:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866690816 00000100:00100000:0.0:1746142890.051644:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866690816 00010000:00010000:0.0:1746142890.051658:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067cc8cf2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88127 expref: 24 pid: 9579 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746142890.051670:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866691456 00000100:00100000:0.0:1746142890.051672:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866691456 00010000:00010000:0.0:1746142890.051681:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920ce400/0x2fa243e067cc8c89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880da expref: 16 pid: 1852 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.051691:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5496 00000100:00100000:0.0:1746142890.051696:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962866690944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.051702:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.051712:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984b1400/0x2fa243e067cc8c97 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e8 expref: 27 pid: 9579 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.051720:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984b1400/0x2fa243e067cc8c97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880e8 expref: 27 pid: 9579 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.051734:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.051780:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962866690944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.051788:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5496 00000100:00100000:0.0:1746142890.051802:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5498 00000100:00100000:0.0:1746142890.051806:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962866691200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.051814:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.051825:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c880400/0x2fa243e067cc8c82 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880d3 expref: 35 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.051832:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c880400/0x2fa243e067cc8c82 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880d3 expref: 35 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.051845:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c880400/0x2fa243e067cc8c82 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880d3 expref: 35 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.051857:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.051872:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962866691200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.051878:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5498 00000100:00100000:0.0:1746142890.051920:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.051980:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867552896:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142890.051993:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.052024:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.053889:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.054129:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866691840 00000100:00100000:0.0:1746142890.054134:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866691840 00010000:00010000:0.0:1746142890.054153:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f2a00/0x2fa243e067cc8c3c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88094 expref: 39 pid: 9580 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.054169:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5502 00000100:00100000:0.0:1746142890.054175:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+26:2003:x1830962866691712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.054184:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.054195:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067cc8b63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88047 expref: 26 pid: 9579 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054204:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067cc8b63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88047 expref: 26 pid: 9579 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054219:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067cc8b63 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88047 expref: 26 pid: 9579 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054229:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.054231:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.054234:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054244:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054259:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.054279:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+25:2003:x1830962866691712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.054284:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5502 00000100:00100000:0.0:1746142890.054296:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5503 00000100:00100000:0.0:1746142890.054300:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962866691840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.054305:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.054312:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800923f2a00/0x2fa243e067cc8c3c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88094 expref: 39 pid: 9580 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.054320:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800923f2a00/0x2fa243e067cc8c3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88094 expref: 38 pid: 9580 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.054330:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.054339:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962866691840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 39us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.054343:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5503 00010000:00010000:0.0:1746142890.054357:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054364:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054380:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054386:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054392:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054396:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ebec00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142890.054399:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054405:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054412:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054416:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067cc8d69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.054442:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866690176:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 19735us (20043us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.054448:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12548 00000100:00100000:0.0:1746142890.054493:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867553024:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142890.054532:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.054539:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866691968 00000100:00100000:0.0:1746142890.054541:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866691968 00010000:00010000:0.0:1746142890.054550:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671200/0x2fa243e067cc8ca5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880fd expref: 16 pid: 9578 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746142890.054560:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5504 00000100:00100000:0.0:1746142890.054564:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962866691968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.054569:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.054576:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e671200/0x2fa243e067cc8ca5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880fd expref: 16 pid: 9578 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054583:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e671200/0x2fa243e067cc8ca5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880fd expref: 16 pid: 9578 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054591:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e671200/0x2fa243e067cc8ca5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880fd expref: 16 pid: 9578 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054598:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.054608:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962866691968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 44us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.054612:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5504 00000100:00100000:0.0:1746142890.054654:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867553408:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142890.054674:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.054700:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.054708:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866692096 00000100:00100000:0.0:1746142890.054710:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866692096 00010000:00010000:0.0:1746142890.054718:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8cdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88119 expref: 38 pid: 9578 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.054726:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5505 00000100:00100000:0.0:1746142890.054730:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962866692096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.054734:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.054740:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8cdd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88119 expref: 38 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.054746:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8cdd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88119 expref: 38 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.054767:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8cdd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88119 expref: 38 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.054774:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.054785:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962866692096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 55us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.054789:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5505 00000100:00100000:0.0:1746142890.054813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.054820:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866692352 00000100:00100000:0.0:1746142890.054822:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866692352 00010000:00010000:0.0:1746142890.054830:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25400/0x2fa243e067cc8b55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8805c expref: 24 pid: 1854 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746142890.054838:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5506 00000100:00100000:0.0:1746142890.054841:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866692352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.054846:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.054851:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb25400/0x2fa243e067cc8b55 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8805c expref: 24 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054857:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb25400/0x2fa243e067cc8b55 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8805c expref: 24 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054864:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25400/0x2fa243e067cc8b55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8805c expref: 24 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054870:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.054880:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+23:2006:x1830962866692352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 38us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.054883:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5506 00000100:00100000:0.0:1746142890.054919:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.054926:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866692224 00000100:00100000:0.0:1746142890.054928:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866692224 00010000:00010000:0.0:1746142890.054935:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25c00/0x2fa243e067cc8b5c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88039 expref: 21 pid: 1854 timeout: 764 lvb_type: 1 00000100:00100000:0.0:1746142890.054944:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5507 00000100:00100000:0.0:1746142890.054947:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962866692224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.054953:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.054957:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb25c00/0x2fa243e067cc8b5c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88039 expref: 21 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054964:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb25c00/0x2fa243e067cc8b5c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88039 expref: 21 pid: 1854 timeout: 764 lvb_type: 1 00010000:00010000:0.0:1746142890.054971:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.054972:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.054975:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0000/0x2fa243e067cc8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054980:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0000/0x2fa243e067cc8d62 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.054987:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.054997:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962866692224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 49us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.055001:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5507 00000100:00100000:0.0:1746142890.055024:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.055031:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866692480 00000100:00100000:0.0:1746142890.055033:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866692480 00010000:00010000:0.0:1746142890.055040:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880200/0x2fa243e067cc8cb3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88104 expref: 24 pid: 9578 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.055048:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5508 00000100:00100000:0.0:1746142890.055052:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962866692480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.055059:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.055064:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880200/0x2fa243e067cc8cb3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88104 expref: 24 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.055071:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880200/0x2fa243e067cc8cb3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88104 expref: 24 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.055079:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.055080:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.055083:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cc8d70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055088:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cc8d70 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055096:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.055107:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962866692480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 55us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.055111:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5508 00000100:00100000:0.0:1746142890.055562:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.055581:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866692608 00000100:00100000:0.0:1746142890.055583:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866692608 00010000:00010000:0.0:1746142890.055595:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067cc8cba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8810b expref: 34 pid: 9578 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.055609:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5509 00000100:00100000:0.0:1746142890.055614:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962866692608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.055622:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.055628:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067cc8cba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8810b expref: 34 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.055635:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067cc8cba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8810b expref: 34 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.055644:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067cc8cba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8810b expref: 34 pid: 9578 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.055658:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.055659:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.055661:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055666:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055678:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.055690:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962866692608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.055695:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5509 00010000:00010000:0.0:1746142890.055707:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055712:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055724:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055729:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055741:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055745:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe6200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142890.055754:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055760:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055769:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.055774:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cc8d54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.055800:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+22:2006:x1830962866690560:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 21252us (21423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.055805:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12545 00000100:00100000:0.0:1746142890.063417:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142890.063676:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063682:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063693:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063697:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063701:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063705:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ebe800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142890.063707:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063711:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063718:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.063721:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebe800/0x2fa243e067cc8d4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.063772:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962866690048:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 29231us (29433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.063778:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12544 00000100:00100000:0.0:1746142890.065030:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.067325:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866693248 00000100:00100000:0.0:1746142890.067330:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866693248 00010000:00010000:0.0:1746142890.067351:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cc8c4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8809b expref: 29 pid: 7231 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.067378:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866693120 00000100:00100000:0.0:1746142890.067381:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866693120 00010000:00010000:0.0:1746142890.067391:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067cc8c58 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb880a9 expref: 10 pid: 22383 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.067406:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5511 00000100:00100000:0.0:1746142890.067411:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962866693248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.067420:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.067424:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cc8c4a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8809b expref: 29 pid: 7231 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.067431:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cc8c4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8809b expref: 29 pid: 7231 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.067445:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cc8c4a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8809b expref: 29 pid: 7231 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.067455:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142890.067460:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea53600/0x2fa243e067cc8d77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.067465:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.068072:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962866693248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 660us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.068078:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5511 00000100:00100000:0.0:1746142890.070185:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12553 00000100:00100000:0.0:1746142890.070194:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3764:x1830962867554688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.070988:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3764:x1830962867554688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 795us (1184us total) trans 21474840879 rc 0/0 00000100:00100000:0.0:1746142890.070993:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12553 00000100:00100000:0.0:1746142890.071000:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12562 00000100:00100000:0.0:1746142890.071004:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3762:x1830962867554048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.071039:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+86:3762:x1830962867554048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (1090us total) trans 21474840880 rc 0/0 00000100:00100000:0.0:1746142890.071043:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12562 00000100:00100000:0.0:1746142890.071050:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12564 00000100:00100000:0.0:1746142890.071053:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+101:3762:x1830962867555072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142890.071084:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142890.071087:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142890.071088:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142890.071090:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142890.071091:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142890.071106:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3762:x1830962867555072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1122us total) trans 17179873604 rc 0/0 00000100:00100000:0.0:1746142890.071114:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12564 00000100:00100000:0.0:1746142890.071122:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12565 00000100:00100000:0.0:1746142890.071125:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+102:3762:x1830962867555584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142890.071157:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142890.071158:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142890.071160:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142890.071161:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142890.071163:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:0.0:1746142890.071176:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+103:3762:x1830962867555584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (1166us total) trans 17179873606 rc 0/0 00000100:00100000:0.0:1746142890.071429:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12565 00000100:00100000:0.0:1746142890.073441:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.075199:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077465:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077496:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077566:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866694016 00000100:00100000:0.0:1746142890.077569:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866694016 00000100:00100000:0.0:1746142890.077586:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866693632 00000100:00100000:0.0:1746142890.077588:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866693632 00000100:00100000:0.0:1746142890.077608:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12568 00000100:00100000:0.0:1746142890.077613:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962866694016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142890.077620:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.077629:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067cc8d9a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88189 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142890.077646:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406aa, atime: 0x681406aa, ctime: 0x681406aa, blocks: 0x808 00010000:00010000:0.0:1746142890.077659:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.077661:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.077667:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067cc8d9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88189 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.077678:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067cc8d9a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88189 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.077686:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe7600, rc 0) 00000100:00100000:0.0:1746142890.077715:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962866694016:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 102us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.077721:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12568 00000100:00100000:0.0:1746142890.077732:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12570 00000100:00100000:0.0:1746142890.077737:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962866693632:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142890.077742:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.077759:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8da8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88174 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142890.077769:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406aa, atime: 0x681406aa, ctime: 0x681406aa, blocks: 0x7f0 00010000:00010000:0.0:1746142890.077776:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.077777:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.077781:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8da8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88174 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.077789:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6400/0x2fa243e067cc8da8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88174 expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.077796:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6400, rc 0) 00000100:00100000:0.0:1746142890.077809:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962866693632:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.077814:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12570 00000100:00100000:0.0:1746142890.077837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077886:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.077896:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866693888 00000100:00100000:0.0:1746142890.077918:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866693888 00000100:00100000:0.0:1746142890.077949:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12571 00000100:00100000:0.0:1746142890.077954:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+23:2006:x1830962866693888:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142890.077960:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.077966:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe7200/0x2fa243e067cc8daf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88182 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142890.077975:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406aa, atime: 0x681406aa, ctime: 0x681406aa, blocks: 0x800 00010000:00010000:0.0:1746142890.077981:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.077983:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.077987:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe7200/0x2fa243e067cc8daf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88182 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.077994:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe7200/0x2fa243e067cc8daf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88182 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.078000:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe7200, rc 0) 00000100:00100000:0.0:1746142890.078014:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866693888:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 61us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.078019:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12571 00000100:00100000:0.0:1746142890.081471:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.081507:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.081535:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.081573:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.081706:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866694400 00000100:00100000:0.0:1746142890.081711:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866694400 00000100:00100000:0.0:1746142890.081739:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12574 00000100:00100000:0.0:1746142890.081744:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962866694784:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142890.081809:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962866694784:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 65us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.081816:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12574 00000100:00100000:0.0:1746142890.081830:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12576 00000100:00100000:0.0:1746142890.081834:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962866694400:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142890.081874:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962866694400:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.081879:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12576 00000100:00100000:0.0:1746142890.081926:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.081969:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085001:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085021:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085042:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085054:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085064:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085085:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.085858:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12583 00000100:00100000:0.0:1746142890.085865:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866695424:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142890.085914:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866695424:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 35us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.085920:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12583 00000100:00100000:0.0:1746142890.088098:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.090245:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.095700:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.100724:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.100776:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.107785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.107820:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.109925:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.109940:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866697600 00000100:00100000:0.0:1746142890.109944:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866697600 00000100:00100000:0.0:1746142890.109968:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3551 00000100:00100000:0.0:1746142890.109972:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+29:2006:x1830962866697600:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142890.109987:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3a00/0x2fa243e067cc8de0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.109994:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.109996:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.109998:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3a00/0x2fa243e067cc8de0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.110005:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3a00/0x2fa243e067cc8de0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.110459:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3553 00000100:00100000:0.0:1746142890.110464:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c8243383-433c-45fe-9bef-8828afa9ff81+31:2005:x1830962866698112:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142890.110478:0:20331:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.110484:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.110485:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.110487:0:20331:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.110494:0:20331:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.124312:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866698624 00000100:00100000:0.0:1746142890.124319:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866698624 00000100:00100000:0.0:1746142890.124356:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14066 00000100:00100000:0.0:1746142890.124363:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:31542:x1830962866698624:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142890.124380:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.124392:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfa00/0x2fa243e067cc8e11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb881a5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.124445:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebe000/0x2fa243e067cc8e18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124455:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebe000/0x2fa243e067cc8e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124464:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebe000/0x2fa243e067cc8e18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124478:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebf000/0x2fa243e067cc8e1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124483:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebf000/0x2fa243e067cc8e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124488:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebf000/0x2fa243e067cc8e1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124559:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cc8e26 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124567:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cc8e26 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142890.124574:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cc8e26 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142890.127989:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142890.142037:0:20331:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.142050:0:20331:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.142057:0:20331:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.142064:0:20331:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d3600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142890.142067:0:20331:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.142078:0:20331:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.142093:0:20331:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.142098:0:20331:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3600/0x2fa243e067cc8dee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.142189:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c8243383-433c-45fe-9bef-8828afa9ff81+25:2005:x1830962866698112:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 31721us (31993us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142890.142198:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3553 00000100:00100000:0.0:1746142890.150735:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.154627:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.155136:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.160091:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.160669:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.167013:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867557504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142890.167033:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142890.167047:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867558016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142890.167058:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142890.167069:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746142890.167073:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867557376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142890.167086:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142890.167094:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867557888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142890.167104:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142890.167125:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556480 00000100:00100000:0.0:1746142890.167131:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556480 00000100:00100000:0.0:1746142890.167167:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556992 00000100:00100000:0.0:1746142890.167169:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556992 00000100:00100000:0.0:1746142890.167176:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556352 00000100:00100000:0.0:1746142890.167177:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556352 00000100:00100000:0.0:1746142890.167182:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556864 00000100:00100000:0.0:1746142890.167184:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556864 00000100:00100000:0.0:1746142890.167189:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556736 00000100:00100000:0.0:1746142890.167190:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556736 00000100:00100000:0.0:1746142890.167195:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557248 00000100:00100000:0.0:1746142890.167197:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557248 00000100:00100000:0.0:1746142890.167202:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557504 00000100:00100000:0.0:1746142890.167203:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557504 00000100:00100000:0.0:1746142890.167210:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867558016 00000100:00100000:0.0:1746142890.167211:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867558016 00000100:00100000:0.0:1746142890.167217:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557376 00000100:00100000:0.0:1746142890.167218:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557376 00000100:00100000:0.0:1746142890.167224:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557888 00000100:00100000:0.0:1746142890.167226:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557888 00000100:00100000:0.0:1746142890.167234:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12587 00000100:00100000:0.0:1746142890.167240:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3763:x1830962867556480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142890.167345:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142890.167348:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.167350:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.167352:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.167353:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142890.167379:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3763:x1830962867556480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (616us total) trans 21474840883 rc 0/0 00000100:00100000:0.0:1746142890.167385:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12587 00000100:00100000:0.0:1746142890.167397:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12588 00000100:00100000:0.0:1746142890.167401:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3763:x1830962867556992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.167447:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3763:x1830962867556992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (650us total) trans 21474840884 rc 0/0 00000100:00100000:0.0:1746142890.167451:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12588 00000100:00100000:0.0:1746142890.167459:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12589 00000100:00100000:0.0:1746142890.167463:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3763:x1830962867556352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142890.167498:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142890.167500:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.167502:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.167504:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.167506:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142890.167522:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3763:x1830962867556352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (693us total) trans 21474840885 rc 0/0 00000100:00100000:0.0:1746142890.167526:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12589 00000100:00100000:0.0:1746142890.167534:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12590 00000100:00100000:0.0:1746142890.167537:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3763:x1830962867556864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.167580:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3763:x1830962867556864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (730us total) trans 21474840886 rc 0/0 00000100:00100000:0.0:1746142890.167585:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12590 00000100:00100000:0.0:1746142890.167592:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12591 00000100:00100000:0.0:1746142890.167596:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3765:x1830962867556736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.167639:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+91:3765:x1830962867556736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (762us total) trans 21474840887 rc 0/0 00000100:00100000:0.0:1746142890.167644:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12591 00000100:00100000:0.0:1746142890.167652:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12592 00000100:00100000:0.0:1746142890.167656:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3765:x1830962867557248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.169543:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3765:x1830962867557248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1886us (2645us total) trans 21474840890 rc 0/0 00000100:00100000:0.0:1746142890.169550:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12592 00000100:00100000:0.0:1746142890.171295:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.177315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.177340:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.177353:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.177364:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.177384:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866699904 00000100:00100000:0.0:1746142890.177391:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866699904 00000100:00100000:0.0:1746142890.177422:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866700160 00000100:00100000:0.0:1746142890.177424:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866700160 00000100:00100000:0.0:1746142890.177448:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866700416 00000100:00100000:0.0:1746142890.177450:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866700416 00000100:00100000:0.0:1746142890.177459:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866700032 00000100:00100000:0.0:1746142890.177461:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866700032 00000100:00100000:0.0:1746142890.177472:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12604 00000100:00100000:0.0:1746142890.177479:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+22:2003:x1830962866699904:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142890.178174:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142890.178177:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.178179:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.178180:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.178182:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142890.178393:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+23:2003:x1830962866699904:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 914us (1084us total) trans 21474840892 rc 0/0 00000100:00100000:0.0:1746142890.178626:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12604 00000100:00100000:0.0:1746142890.178744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.179246:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.179433:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12609 00000100:00100000:0.0:1746142890.179439:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+27:2003:x1830962866700544:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142890.179483:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142890.179485:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.179487:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.179489:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142890 -> 1746142890 00002000:00010000:0.0:1746142890.179490:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142890.179504:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+28:2003:x1830962866700544:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 65us (760us total) trans 17179873621 rc 0/0 00000100:00100000:0.0:1746142890.179509:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12609 00000100:00100000:0.0:1746142890.185329:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.187118:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.190678:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.190726:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.197024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.200432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.200467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.201316:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.202024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.202040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.202081:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12612 00000100:00100000:0.0:1746142890.202089:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962866702080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142890.202097:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.202111:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067cc8e8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb881d6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.202133:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.202134:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.202143:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067cc8e8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb881d6 expref: 36 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.202158:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067cc8e8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb881d6 expref: 36 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.202168:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:0.0:1746142890.202210:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962866702080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 123us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.202216:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12612 00000100:00100000:0.0:1746142890.202233:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12615 00000100:00100000:0.0:1746142890.202238:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962866702336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142890.202245:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.202251:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cd800/0x2fa243e067cc8ea4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb881e4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.202260:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.202262:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.202265:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cd800/0x2fa243e067cc8ea4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb881e4 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.202274:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cd800/0x2fa243e067cc8ea4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb881e4 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.202286:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cd800, rc 0) 00000100:00100000:0.0:1746142890.202299:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962866702336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 61us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.202304:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12615 00000100:00100000:0.0:1746142890.202344:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.203412:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.208348:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.223082:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.223155:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866703360 00000100:00100000:0.0:1746142890.223163:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866703360 00002000:00100000:0.0:1746142890.223199:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88011e13d180 x1830962866703360/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.223209:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d180 with x1830962866703360 ext(0->1048575) 00002000:00010000:0.0:1746142890.223214:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13d180 00000100:00100000:0.0:1746142890.223232:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3556 00000100:00100000:0.0:1746142890.223239:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962866703360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142890.253475:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.255161:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.257954:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.258237:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.258251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.258949:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.259214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.260200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.260227:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.270491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.272223:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866706432 00000100:00100000:0.0:1746142890.272227:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866706432 00002000:00100000:0.0:1746142890.272244:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc61880 x1830962866706432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.272250:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61880 with x1830962866706432 ext(1048576->2097151) 00002000:00010000:0.0:1746142890.272252:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61880 00000100:00100000:0.0:1746142890.272271:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3561 00000100:00100000:0.0:1746142890.272276:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962866706432:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142890.272956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.287675:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962866706432:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15396us (15463us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142890.287683:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3561 00002000:00100000:0.0:1746142890.287691:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc61880 x1830962866706432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/440 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.287701:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61880 with x1830962866706432 ext(1048576->2097151) 00002000:00010000:0.0:1746142890.287706:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61880 00000100:00100000:0.0:1746142890.298213:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.298252:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.318380:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.328057:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.335810:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.335862:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.336007:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3566 00000100:00100000:0.0:1746142890.336015:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962866707840:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142890.353392:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.364188:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962866707840:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28171us (28383us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142890.364197:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3566 00002000:00100000:0.0:1746142890.364207:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880097a5b100 x1830962866707840/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/440 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.364215:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a5b100 with x1830962866707840 ext(2097152->4194303) 00002000:00010000:0.0:1746142890.364220:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a5b100 00000100:00100000:0.0:1746142890.365389:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.365420:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.365459:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.365484:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866708736 00000100:00100000:0.0:1746142890.365487:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866708736 00000100:00100000:0.0:1746142890.365515:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14074 00000100:00100000:0.0:1746142890.365521:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:31545:x1830962866708736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142890.365539:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.365552:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc000/0x2fa243e067cc8f22 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88246 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.365598:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc000/0x2fa243e067cc8f22 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88246 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.365713:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc000/0x2fa243e067cc8f22 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88246 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.365758:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142890.365761:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142890.365763:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebc000, rc 0) 00000100:00100000:0.0:1746142890.365791:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:31545:x1830962866708736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 265us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.365797:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14074 00000100:00100000:0.0:1746142890.370368:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.370402:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.370423:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.370454:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.372183:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867559936:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142890.372200:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc2200/0x2fa243e067cc8f30 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8824d expref: 41 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.372210:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2200/0x2fa243e067cc8f30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8824d expref: 41 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.372221:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2200, rc 0) 00000100:00100000:0.0:1746142890.372240:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962866709120:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1263us (1815us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142890.372245:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12626 00000100:00100000:0.0:1746142890.373536:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.373553:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866709504 00000100:00100000:0.0:1746142890.373558:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866709504 00002000:00100000:0.0:1746142890.373585:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9b:0x0] (2895872->2899967) req@ffff88012de12300 x1830962866709504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.373594:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12300 with x1830962866709504 ext(2895872->2899967) 00010000:00010000:0.0:1746142890.373601:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 40 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.373610:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 40 pid: 1853 timeout: 764 lvb_type: 0 00002000:00010000:0.0:1746142890.373616:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012de12300 00000100:00100000:0.0:1746142890.373629:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1128 00000100:00100000:0.0:1746142890.373635:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962866709504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142890.373723:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962866709504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 88us (189us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142890.373728:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1128 00002000:00100000:0.0:1746142890.373733:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9b:0x0] (2895872->2899967) req@ffff88012de12300 x1830962866709504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746142901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.373741:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12300 with x1830962866709504 ext(2895872->2899967) 00010000:00010000:0.0:1746142890.373757:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 40 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.373765:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 40 pid: 1853 timeout: 764 lvb_type: 0 00002000:00010000:0.0:1746142890.373771:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012de12300 00000100:00100000:0.0:1746142890.375011:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.380493:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866709888 00000100:00100000:0.0:1746142890.380500:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866709888 00002000:00100000:0.0:1746142890.380536:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2895872->3145727) req@ffff880091c07100 x1830962866709888/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.380545:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07100 with x1830962866709888 ext(2895872->3145727) 00010000:00010000:0.0:1746142890.380556:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 40 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.380568:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 40 pid: 1853 timeout: 764 lvb_type: 0 00002000:00010000:0.0:1746142890.380574:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c07100 00000100:00100000:0.0:1746142890.380593:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1129 00000100:00100000:0.0:1746142890.380599:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962866709888:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142890.386617:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962866709888:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6015us (6242us total) trans 21474840895 rc 0/0 00000100:00100000:0.0:1746142890.386627:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1129 00002000:00100000:0.0:1746142890.386636:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2895872->3145727) req@ffff880091c07100 x1830962866709888/t21474840895(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/448 e 0 to 0 dl 1746142901 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.386644:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07100 with x1830962866709888 ext(2895872->3145727) 00010000:00010000:0.0:1746142890.386653:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 42 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.386665:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 42 pid: 1853 timeout: 764 lvb_type: 0 00002000:00010000:0.0:1746142890.386676:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c07100 00000100:00100000:0.0:1746142890.390626:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.392974:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.393041:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.393095:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5522 00000100:00100000:0.0:1746142890.393101:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962866710272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.393113:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.393130:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 42 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.393140:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 42 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.393155:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc8f0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2895872->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88238 expref: 42 pid: 1853 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.393167:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.393169:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.393174:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.393181:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.393188:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.393189:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.393193:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cc8f3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8825b expref: 41 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.393199:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cc8f3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8825b expref: 41 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.393219:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cc8f3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8825b expref: 41 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.393230:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867560576:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142890.393281:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.393289:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867560704:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142890.393319:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142890.400347:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.400426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.403316:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.406508:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.408951:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.416218:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.417123:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.423352:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866712320 00000100:00100000:0.0:1746142890.423360:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866712320 00000100:00100000:0.0:1746142890.423403:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12631 00000100:00100000:0.0:1746142890.423410:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:31550:x1830962866712320:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142890.423426:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.423441:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88270 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.423462:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142890.423467:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cc8f4c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88269 expref: 19 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.423472:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746142890.423476:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88270 expref: 19 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.423505:0:9579:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cc8f4c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3805184->4194303] (req 3805184->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88269 expref: 19 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.423515:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88270 expref: 19 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.423524:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2e00, rc 0) 00000100:00100000:0.0:1746142890.424925:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:31550:x1830962866712320:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1509us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.424932:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12631 00000100:00100000:0.0:1746142890.436649:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.449524:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.450301:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.456211:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866713344 00000100:00100000:0.0:1746142890.456218:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866713344 00010000:00010000:0.0:1746142890.456240:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 29 pid: 1397 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.456273:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5527 00000100:00100000:0.0:1746142890.456280:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962866713344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.456291:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.456304:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 29 pid: 1397 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.456313:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 29 pid: 1397 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.456329:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cc8f37 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88254 expref: 29 pid: 1397 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.456350:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.456352:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.456357:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cc8f5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4214783) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88277 expref: 28 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.456364:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cc8f5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4214783) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88277 expref: 28 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.456388:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cc8f5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4214783) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88277 expref: 28 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.456399:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867561600:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142890.456471:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142890.458508:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962866712960:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 8006us (8202us total) trans 17179873623 rc 0/0 00000100:00100000:0.0:1746142890.458518:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1133 00002000:00100000:0.0:1746142890.458528:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3805184->4194303) req@ffff880097430a80 x1830962866712960/t17179873623(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/448 e 0 to 0 dl 1746142901 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.458536:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430a80 with x1830962866712960 ext(3805184->4194303) 00010000:00010000:0.0:1746142890.458544:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cc8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88269 expref: 21 pid: 9579 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.458556:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cc8f4c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3805184->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88269 expref: 21 pid: 9579 timeout: 764 lvb_type: 0 00002000:00010000:0.0:1746142890.458562:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097430a80 00000100:00100000:0.0:1746142890.460628:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.460958:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.467020:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.479733:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.490449:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.501691:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.504094:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.508677:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.513144:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.513181:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.525165:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.529244:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.532675:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.535112:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.543972:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.548227:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.548262:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.548287:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.548314:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.548326:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.548349:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.556607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.564259:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866718976 00000100:00100000:0.0:1746142890.564263:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866718976 00010000:00010000:0.0:1746142890.564277:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88270 expref: 18 pid: 9579 timeout: 764 lvb_type: 0 00000100:00100000:0.0:1746142890.564293:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5545 00000100:00100000:0.0:1746142890.564298:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962866718976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.564305:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.564313:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88270 expref: 18 pid: 9579 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.564321:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88270 expref: 18 pid: 9579 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.564332:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cc8f53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88270 expref: 18 pid: 9579 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.564362:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.564364:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.564367:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096131e00/0x2fa243e067cc8fdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.564373:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096131e00/0x2fa243e067cc8fdf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.564386:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142890.564415:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962866718976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 117us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.564421:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5545 00000100:00100000:0.0:1746142890.568894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.572441:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.575979:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.577151:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.583300:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566720 00000100:00100000:0.0:1746142890.583304:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566720 00000100:00100000:0.0:1746142890.583319:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12658 00000100:00100000:0.0:1746142890.583324:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+120:3763:x1830962867566720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142890.583808:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+121:3763:x1830962867566720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 483us (519us total) trans 17179873632 rc 0/0 00000100:00100000:0.0:1746142890.583814:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12658 00010000:00010000:0.0:1746142890.584131:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142890.584137:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142890.584143:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142890.584147:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096130e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142890.584151:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142890.584156:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142890.584164:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142890.584171:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142890.584173:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142890.584177:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cc8ff4 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142890.597818:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.597840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.597864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.598080:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12663 00000100:00100000:0.0:1746142890.598086:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+23:2006:x1830962866720384:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142890.598092:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.598101:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067cc902c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb882d2 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142890.598113:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406aa, atime: 0x681406aa, ctime: 0x681406aa, blocks: 0x808 00010000:00010000:0.0:1746142890.598121:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.598122:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.598127:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067cc902c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882d2 expref: 24 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.598135:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067cc902c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882d2 expref: 24 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142890.598141:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37400, rc 0) 00000100:00100000:0.0:1746142890.598611:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+24:2006:x1830962866720384:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 525us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.598615:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12663 00000100:00100000:0.0:1746142890.604607:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.605424:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.605452:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.605470:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866720896 00000100:00100000:0.0:1746142890.605478:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866720896 00000100:00100000:0.0:1746142890.605520:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866720768 00000100:00100000:0.0:1746142890.605522:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866720768 00000100:00100000:0.0:1746142890.605534:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866721024 00000100:00100000:0.0:1746142890.605535:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866721024 00000100:00100000:0.0:1746142890.605548:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12665 00000100:00100000:0.0:1746142890.605554:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+29:2005:x1830962866720896:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142890.606700:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+29:2005:x1830962866720896:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 1144us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.606706:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12665 00000100:00100000:0.0:1746142890.607960:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12670 00000100:00100000:0.0:1746142890.607967:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+28:2005:x1830962866721408:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142890.608022:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+28:2005:x1830962866721408:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.608473:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12670 00000100:00100000:0.0:1746142890.612803:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.617378:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12672 00000100:00100000:0.0:1746142890.617389:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+25:2006:x1830962866721536:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142890.617477:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+25:2006:x1830962866721536:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 91us (3451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.617484:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12672 00000100:00100000:0.0:1746142890.618217:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.618249:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.629323:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.635987:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.644463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.645201:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.645233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.649571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.649593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.649612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.649626:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866723456 00000100:00100000:0.0:1746142890.649632:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866723456 00000100:00100000:0.0:1746142890.649676:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866723712 00000100:00100000:0.0:1746142890.649678:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866723712 00000100:00100000:0.0:1746142890.649694:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3575 00000100:00100000:0.0:1746142890.649705:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+28:2006:x1830962866723456:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142890.649733:0:20334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.649757:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.649758:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.649762:0:20334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.649772:0:20334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.650412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.650448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.650962:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866724224 00000100:00100000:0.0:1746142890.650966:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866724224 00000100:00100000:0.0:1746142890.650988:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866724480 00000100:00100000:0.0:1746142890.650989:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866724480 00000100:00100000:0.0:1746142890.651001:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3578 00000100:00100000:0.0:1746142890.651007:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+31:2006:x1830962866724224:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142890.651024:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067cc9064 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.651033:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.651034:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.651038:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067cc9064 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.651046:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067cc9064 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679113:0:20334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679126:0:20334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679133:0:20334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679140:0:20334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142890.679142:0:20334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679150:0:20334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679163:0:20334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.679169:0:20334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cc904f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.682450:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+27:2006:x1830962866723456:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 32736us (32875us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142890.682461:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3575 00000100:00100000:0.0:1746142890.696282:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.701669:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.701706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.701748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.701781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.701795:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.705001:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.709018:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:0.0:1746142890.713517:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936136 is committed 00000004:00080000:0.0:1746142890.713525:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 453 committed 00000004:00080000:0.0:1746142890.714132:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 504 committed 00000004:00080000:0.0:1746142890.714173:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 503 committed 00000004:00080000:0.0:1746142890.714175:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 452 committed 00000004:00080000:0.0:1746142890.714177:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 502 committed 00000004:00080000:0.0:1746142890.714178:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 451 committed 00000004:00080000:0.0:1746142890.714180:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 501 committed 00000004:00080000:0.0:1746142890.714181:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 450 committed 00000004:00080000:0.0:1746142890.714182:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 500 committed 00000004:00080000:0.0:1746142890.714183:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 449 committed 00000004:00080000:0.0:1746142890.714185:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 499 committed 00000004:00080000:0.0:1746142890.714186:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 498 committed 00000004:00080000:0.0:1746142890.714187:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 448 committed 00000004:00080000:0.0:1746142890.714188:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 447 committed 00000004:00080000:0.0:1746142890.714189:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 497 committed 00000004:00080000:0.0:1746142890.714191:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 496 committed 00000004:00080000:0.0:1746142890.714192:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 446 committed 00000100:00100000:0.0:1746142890.715219:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867566976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142890.716546:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12694 00000100:00100000:0.0:1746142890.716551:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+104:3763:x1830962867568896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142890.716600:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142890.716602:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142890.716604:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142890.716606:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142890.716608:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142890.716629:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+107:3763:x1830962867568896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (205us total) trans 21474840909 rc 0/0 00000100:00100000:0.0:1746142890.716635:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12694 00000100:00100000:0.0:1746142890.716684:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.716698:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866726016 00000100:00100000:0.0:1746142890.716701:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866726016 00000100:00100000:0.0:1746142890.716721:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14083 00000100:00100000:0.0:1746142890.716725:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+6:31559:x1830962866726016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142890.716748:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.716759:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cc9080 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb882e7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.716792:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cc9080 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882e7 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.716803:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cc9080 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882e7 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.716815:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142890.716818:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142890.716819:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1800, rc 0) 00000100:00100000:0.0:1746142890.716840:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:31559:x1830962866726016:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 114us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142890.716845:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14083 00000100:00100000:0.0:1746142890.719128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.741427:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.741470:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.745604:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.750866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.750935:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.761601:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.761936:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.772509:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.799316:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.799383:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.809000:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.828292:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.828352:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.828373:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.828397:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.833040:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569664 00000100:00100000:0.0:1746142890.833043:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569664 00000100:00100000:0.0:1746142890.833057:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570176 00000100:00100000:0.0:1746142890.833058:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570176 00000100:00100000:0.0:1746142890.833065:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569792 00000100:00100000:0.0:1746142890.833066:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569792 00000100:00100000:0.0:1746142890.833073:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570304 00000100:00100000:0.0:1746142890.833074:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570304 00000100:00100000:0.0:1746142890.833082:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12711 00000100:00100000:0.0:1746142890.833085:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+116:3762:x1830962867569664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142890.833122:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142890.833125:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.833127:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.833128:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.833130:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142890.833150:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+117:3762:x1830962867569664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (215us total) trans 21474840921 rc 0/0 00000100:00100000:0.0:1746142890.833154:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12711 00000100:00100000:0.0:1746142890.833162:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12712 00000100:00100000:0.0:1746142890.833165:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+116:3762:x1830962867570176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142890.833200:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+117:3762:x1830962867570176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 34us (243us total) trans 21474840922 rc 0/0 00000100:00100000:0.0:1746142890.833204:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12712 00000100:00100000:0.0:1746142890.833209:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12713 00000100:00100000:0.0:1746142890.833212:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+116:3762:x1830962867569792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142890.833236:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:0.0:1746142890.833238:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.833240:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.833241:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.833243:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142890.833254:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+117:3762:x1830962867569792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (275us total) trans 21474840923 rc 0/0 00000100:00100000:0.0:1746142890.833257:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12713 00000100:00100000:0.0:1746142890.833264:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12714 00000100:00100000:0.0:1746142890.833268:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+116:3762:x1830962867570304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142890.833299:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142890.833301:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142890.833303:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142890.833304:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142890.833305:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142890.833321:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+117:3762:x1830962867570304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (326us total) trans 21474840924 rc 0/0 00000100:00100000:0.0:1746142890.833326:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12714 00000100:00100000:0.0:1746142890.834278:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570688 00000100:00100000:0.0:1746142890.834282:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570688 00000100:00100000:0.0:1746142890.834296:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571200 00000100:00100000:0.0:1746142890.834298:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571200 00000100:00100000:0.0:1746142890.834303:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570816 00000100:00100000:0.0:1746142890.834305:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570816 00000100:00100000:0.0:1746142890.834310:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571328 00000100:00100000:0.0:1746142890.834311:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571328 00000100:00100000:0.0:1746142890.834319:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12715 00000100:00100000:0.0:1746142890.834324:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+133:3762:x1830962867570688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142890.834374:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142890.834376:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.834378:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.834380:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.834381:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746142890.834403:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+134:3762:x1830962867570688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (910us total) trans 17179873646 rc 0/0 00000100:00100000:0.0:1746142890.834407:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12715 00000100:00100000:0.0:1746142890.834414:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12716 00000100:00100000:0.0:1746142890.834418:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+133:3762:x1830962867571200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142890.834445:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142890.834447:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142890.834449:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142890.834450:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142890.834452:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142890.834464:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+134:3762:x1830962867571200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (942us total) trans 17179873647 rc 0/0 00000100:00100000:0.0:1746142890.834469:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12716 00000100:00100000:0.0:1746142890.834475:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12717 00000100:00100000:0.0:1746142890.834947:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+135:3762:x1830962867570816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142890.834989:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142890.834992:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.834993:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.834995:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142890.834996:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142890.835014:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+136:3762:x1830962867570816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1394us total) trans 17179873648 rc 0/0 00000100:00100000:0.0:1746142890.836345:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12717 00000100:00100000:0.0:1746142890.836850:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.845963:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.851468:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.862845:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.864072:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.866583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.866851:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.874086:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.878090:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962866730880:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10989us (11507us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142890.878100:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3586 00002000:00100000:0.0:1746142890.878109:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009a28ce00 x1830962866730880/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/440 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.878117:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ce00 with x1830962866730880 ext(1048576->2097151) 00002000:00010000:0.0:1746142890.878122:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ce00 00000100:00100000:0.0:1746142890.881753:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962866731136:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14615us (14894us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142890.881762:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3587 00002000:00100000:0.0:1746142890.881771:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009a28df80 x1830962866731136/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/440 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.881779:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28df80 with x1830962866731136 ext(1048576->2097151) 00002000:00010000:0.0:1746142890.881784:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28df80 00000100:00100000:0.0:1746142890.889651:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.890437:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.890457:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866732032 00000100:00100000:0.0:1746142890.890464:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866732032 00002000:00100000:0.0:1746142890.890517:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1093632->1097727) req@ffff88009cfee300 x1830962866732032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.890526:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee300 with x1830962866732032 ext(1093632->1097727) 00002000:00010000:0.0:1746142890.890545:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfee300 00000100:00100000:0.0:1746142890.890563:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3588 00000100:00100000:0.0:1746142890.890570:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962866732032:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142890.890707:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962866732032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 137us (270us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142890.890714:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3588 00002000:00100000:0.0:1746142890.890720:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1093632->1097727) req@ffff88009cfee300 x1830962866732032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.890727:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee300 with x1830962866732032 ext(1093632->1097727) 00002000:00010000:0.0:1746142890.890730:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfee300 00000100:00100000:0.0:1746142890.900105:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866732800 00000100:00100000:0.0:1746142890.900111:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866732800 00002000:00100000:0.0:1746142890.900138:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1859584->1863679) req@ffff88009601c700 x1830962866732800/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.900147:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009601c700 with x1830962866732800 ext(1859584->1863679) 00002000:00010000:0.0:1746142890.900151:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009601c700 00000100:00100000:0.0:1746142890.900164:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3589 00000100:00100000:0.0:1746142890.900169:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962866732800:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142890.900252:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962866732800:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 83us (314us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142890.900257:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3589 00002000:00100000:0.0:1746142890.900262:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1859584->1863679) req@ffff88009601c700 x1830962866732800/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.900268:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009601c700 with x1830962866732800 ext(1859584->1863679) 00002000:00010000:0.0:1746142890.900271:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009601c700 00000100:00100000:0.0:1746142890.908675:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.909416:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.909441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.909658:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3591 00000100:00100000:0.0:1746142890.909665:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962866733568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142890.917837:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.917949:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.949234:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.952684:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.952722:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.960823:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.961313:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.961400:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.964723:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5558 00000100:00100000:0.0:1746142890.964742:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962866734976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142890.964750:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142890.964760:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067cc912f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8833b expref: 40 pid: 1397 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.964770:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067cc912f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8833b expref: 40 pid: 1397 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.964782:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067cc912f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8833b expref: 40 pid: 1397 timeout: 764 lvb_type: 0 00010000:00010000:0.0:1746142890.964795:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.964797:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142890.964802:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067cc916e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2023423) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8837a expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.964809:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067cc916e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2023423) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8837a expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142890.964834:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067cc916e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2023423) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8837a expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.964848:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867572864:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142890.964924:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142890.965070:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.965192:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866735104 00000100:00100000:0.0:1746142890.965197:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866735104 00000100:00100000:0.0:1746142890.965227:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12735 00000100:00100000:0.0:1746142890.965232:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962866735104:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142890.965243:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.965252:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130650400/0x2fa243e067cc917c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88388 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.970496:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.970970:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.987961:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866736000 00000100:00100000:0.0:1746142890.987969:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866736000 00002000:00100000:0.0:1746142890.988009:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (2019328->2023423) req@ffff880130375f80 x1830962866736000/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/0 e 0 to 0 dl 1746142901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.988017:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375f80 with x1830962866736000 ext(2019328->2023423) 00002000:00010000:0.0:1746142890.988022:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130375f80 00000100:00100000:0.0:1746142890.988038:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3597 00000100:00100000:0.0:1746142890.988043:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962866736000:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142890.988168:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962866736000:12345-192.168.204.50@tcp:3:cat.0 Request processed in 124us (321us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142890.988173:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3597 00002000:00100000:0.0:1746142890.988179:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (2019328->2023423) req@ffff880130375f80 x1830962866736000/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:41/0 lens 488/4536 e 0 to 0 dl 1746142901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142890.988186:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375f80 with x1830962866736000 ext(2019328->2023423) 00002000:00010000:0.0:1746142890.988188:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130375f80 00000100:00100000:0.0:1746142890.988968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.991418:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.992685:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142890.999776:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866736768 00000100:00100000:0.0:1746142890.999784:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866736768 00000100:00100000:0.0:1746142890.999818:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12738 00000100:00100000:0.0:1746142890.999825:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962866736768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142890.999839:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142890.999854:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098290400/0x2fa243e067cc9191 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8839d expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142890.999930:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867573376:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142891.000128:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142891.002521:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867573376:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142891.002547:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098290400/0x2fa243e067cc9191 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8839d expref: 38 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.002558:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098290400/0x2fa243e067cc9191 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8839d expref: 38 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.002567:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098290400, rc 0) 00000100:00100000:0.0:1746142891.002601:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962866736768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2776us (2898us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142891.002609:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12738 00000100:00080000:0.0:1746142891.007433:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142891.129686:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.132309:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.141485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142891.141695:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746142891.148439:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142891.168992:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.172993:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142891.173951:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142891.202084:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.213225:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.213292:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.213331:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866738560 00000100:00100000:0.0:1746142891.213341:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866738560 00002000:00100000:0.0:1746142891.213384:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009734ce00 x1830962866738560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:42/0 lens 488/0 e 0 to 0 dl 1746142902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.213394:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ce00 with x1830962866738560 ext(1048576->2097151) 00002000:00010000:0.0:1746142891.213399:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734ce00 00000100:00100000:0.0:1746142891.213420:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866738816 00000100:00100000:0.0:1746142891.213425:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866738816 00002000:00100000:0.0:1746142891.213441:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880094cd4380 x1830962866738816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:42/0 lens 504/0 e 0 to 0 dl 1746142902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.213447:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094cd4380 with x1830962866738816 ext(1048576->2097151) 00002000:00010000:0.0:1746142891.213450:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094cd4380 00000100:00100000:0.0:1746142891.213469:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3599 00000100:00100000:0.0:1746142891.213477:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962866738560:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142891.215252:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3600 00000100:00100000:0.0:1746142891.215263:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962866738816:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142891.235294:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.241001:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.241028:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.250511:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.252197:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.254251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.256569:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.256634:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142891.257215:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142891.258802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.258817:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.258827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.259299:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.259681:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866740608 00000100:00100000:0.0:1746142891.259683:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866740608 00000100:00100000:0.0:1746142891.259699:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12743 00000100:00100000:0.0:1746142891.259703:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962866740480:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.259711:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.259720:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093378e00/0x2fa243e067cc9232 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb883dc expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.259742:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.259748:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093378e00/0x2fa243e067cc9232 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883dc expref: 30 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.259760:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093378e00/0x2fa243e067cc9232 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883dc expref: 30 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.259770:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378e00, rc 0) 00000100:00100000:0.0:1746142891.259784:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962866740480:12345-192.168.204.50@tcp:101:cat.0 Request processed in 80us (967us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142891.259795:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12743 00000100:00100000:0.0:1746142891.259839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.259875:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866740864 00000100:00100000:0.0:1746142891.259878:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866740864 00002000:00100000:0.0:1746142891.259896:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1458176->2023423) req@ffff880088fd8a80 x1830962866740864/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:42/0 lens 488/0 e 0 to 0 dl 1746142902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.259922:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8a80 with x1830962866740864 ext(1458176->2023423) 00010000:00010000:0.0:1746142891.259927:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067cc916e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8837a expref: 38 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.259935:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067cc916e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8837a expref: 38 pid: 11421 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746142891.259941:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088fd8a80 00000100:00100000:0.0:1746142891.259951:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1136 00000100:00100000:0.0:1746142891.259956:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962866740864:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142891.261169:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.268485:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.269448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.271194:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.273074:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.275306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.277631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.285772:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.295219:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.295626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.295652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.295680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.296683:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866742912 00000100:00100000:0.0:1746142891.296686:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866742912 00010000:00010000:0.0:1746142891.296716:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82000/0x2fa243e067cc913d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88349 expref: 31 pid: 1397 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746142891.296743:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5566 00000100:00100000:0.0:1746142891.296752:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962866742528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.296763:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.296777:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067cc9201 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 958464->1019903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c7 expref: 44 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.296787:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067cc9201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 958464->1019903) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c7 expref: 44 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.296803:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067cc9201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 958464->1019903) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c7 expref: 44 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.296821:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.296823:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.296828:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 31 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.296834:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 31 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.296858:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 31 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142891.296868:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867575552:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142891.296922:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142891.300642:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867575552:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142891.300650:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.301079:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962866742528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4329us (5866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.301085:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5566 00000100:00100000:0.0:1746142891.304027:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.304064:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.304108:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.309475:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.328527:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.348694:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.349443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.350800:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.353520:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866745216 00000100:00100000:0.0:1746142891.353526:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866745216 00010000:00010000:0.0:1746142891.353549:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc91f3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c0 expref: 34 pid: 7231 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746142891.353567:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5570 00000100:00100000:0.0:1746142891.353573:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962866745216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.353583:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.353587:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc91f3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c0 expref: 34 pid: 7231 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.353602:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc91f3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c0 expref: 34 pid: 7231 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.353620:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc91f3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883c0 expref: 34 pid: 7231 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.353644:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142891.353648:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cc926a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142891.353656:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cc926a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142891.353662:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cc926a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142891.353683:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.353711:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962866745216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 138us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.353720:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5570 00000100:00100000:0.0:1746142891.356292:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.356314:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.356366:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.357303:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.360249:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.362662:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.366979:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.368491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.374167:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.374196:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.374263:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.374419:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.374684:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866746752 00000100:00100000:0.0:1746142891.374687:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866746752 00000100:00100000:0.0:1746142891.379364:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.379410:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.379425:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866747392 00000100:00100000:0.0:1746142891.379430:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866747392 00010000:00010000:0.0:1746142891.379451:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097fb8a00/0x2fa243e067cc9278 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88406 expref: 30 pid: 12211 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.379479:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866747520 00000100:00100000:0.0:1746142891.379481:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866747520 00010000:00010000:0.0:1746142891.379489:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 30 pid: 11943 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746142891.379504:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5572 00000100:00100000:0.0:1746142891.379511:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+30:2005:x1830962866747392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.379522:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.379539:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097fb8a00/0x2fa243e067cc9278 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88406 expref: 30 pid: 12211 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.379548:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097fb8a00/0x2fa243e067cc9278 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88406 expref: 30 pid: 12211 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.379564:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097fb8a00/0x2fa243e067cc9278 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88406 expref: 30 pid: 12211 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.379590:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.379619:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+29:2005:x1830962866747392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.379624:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5572 00000100:00100000:0.0:1746142891.379637:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5573 00000100:00100000:0.0:1746142891.379642:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962866747520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.379648:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.379655:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 30 pid: 11943 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.379662:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 30 pid: 11943 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.379674:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067cc9247 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883f1 expref: 30 pid: 11943 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.379686:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.379687:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.379690:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3800/0x2fa243e067cc92be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.379697:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3800/0x2fa243e067cc92be lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.379711:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.379739:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962866747520:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.379744:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5573 00000100:00100000:0.0:1746142891.381290:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.387060:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866747904 00000100:00100000:0.0:1746142891.387065:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866747904 00010000:00010000:0.0:1746142891.387091:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009711be00/0x2fa243e067cc9271 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8840d expref: 34 pid: 9578 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.387108:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866747776 00000100:00100000:0.0:1746142891.387111:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866747776 00010000:00010000:0.0:1746142891.387119:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067cc9159 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8835e expref: 41 pid: 1852 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.387127:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866748032 00000100:00100000:0.0:1746142891.387129:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866748032 00010000:00010000:0.0:1746142891.387135:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cc91e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883b9 expref: 39 pid: 11421 timeout: 765 lvb_type: 0 00000100:00100000:0.0:1746142891.387146:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866748416 00000100:00100000:0.0:1746142891.387148:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866748416 00010000:00010000:0.0:1746142891.387153:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebc000/0x2fa243e067cc9152 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88365 expref: 29 pid: 11421 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.387160:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866748672 00000100:00100000:0.0:1746142891.387161:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866748672 00010000:00010000:0.0:1746142891.387166:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cc9160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88373 expref: 22 pid: 1852 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.387172:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866748800 00000100:00100000:0.0:1746142891.387173:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866748800 00010000:00010000:0.0:1746142891.387178:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cc9033 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882e0 expref: 35 pid: 9580 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.387187:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5575 00000100:00100000:0.0:1746142891.387255:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+35:2006:x1830962866747904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.387265:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.387280:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009711be00/0x2fa243e067cc9271 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8840d expref: 35 pid: 9578 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387289:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009711be00/0x2fa243e067cc9271 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8840d expref: 35 pid: 9578 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387306:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711be00/0x2fa243e067cc9271 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8840d expref: 35 pid: 9578 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387322:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.387352:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+34:2006:x1830962866747904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.387358:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5575 00000100:00100000:0.0:1746142891.387372:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5576 00000100:00100000:0.0:1746142891.387377:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962866747776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.387383:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.387394:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067cc9159 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8835e expref: 41 pid: 1852 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387406:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067cc9159 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8835e expref: 41 pid: 1852 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387418:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067cc9159 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8835e expref: 41 pid: 1852 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387425:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.387438:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962866747776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 62us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.387443:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5576 00000100:00100000:0.0:1746142891.387453:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5577 00000100:00100000:0.0:1746142891.387457:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962866748032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.387463:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.387469:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cc91e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883b9 expref: 39 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.387476:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cc91e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883b9 expref: 39 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.387485:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cc91e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883b9 expref: 39 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.387492:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.387504:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962866748032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 46us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.387508:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5577 00000100:00100000:0.0:1746142891.387516:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5578 00000100:00100000:0.0:1746142891.387520:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962866748416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.387525:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.387531:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ebc000/0x2fa243e067cc9152 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88365 expref: 29 pid: 11421 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387539:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ebc000/0x2fa243e067cc9152 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88365 expref: 29 pid: 11421 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387548:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ebc000/0x2fa243e067cc9152 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88365 expref: 29 pid: 11421 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387561:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.387563:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.387566:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc92c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.387574:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc92c5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.387588:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.387601:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:2003:x1830962866748416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.387606:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5578 00000100:00100000:0.0:1746142891.387634:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5579 00000100:00100000:0.0:1746142891.387638:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962866748672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.387643:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.387650:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cc9160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88373 expref: 23 pid: 1852 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387657:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cc9160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88373 expref: 23 pid: 1852 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387666:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cc9160 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88373 expref: 23 pid: 1852 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387673:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.387684:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962866748672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 46us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.387688:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5579 00000100:00100000:0.0:1746142891.387695:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5580 00000100:00100000:0.0:1746142891.387698:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+33:2003:x1830962866748800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.387703:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.387708:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cc9033 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882e0 expref: 33 pid: 9580 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387713:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cc9033 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882e0 expref: 33 pid: 9580 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387721:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cc9033 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb882e0 expref: 33 pid: 9580 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.387739:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.387750:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+32:2003:x1830962866748800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.387754:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5580 00000100:00100000:0.0:1746142891.387771:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1140 00000100:00100000:0.0:1746142891.387775:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962866748288:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142891.388142:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866748544 00000100:00100000:0.0:1746142891.388145:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866748544 00010000:00010000:0.0:1746142891.388155:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7200/0x2fa243e067cc9239 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883e3 expref: 23 pid: 11943 timeout: 765 lvb_type: 1 00000100:00100000:0.0:1746142891.388169:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5582 00000100:00100000:0.0:1746142891.388173:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962866748544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142891.388184:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142891.388191:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982c7200/0x2fa243e067cc9239 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883e3 expref: 23 pid: 11943 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.388199:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982c7200/0x2fa243e067cc9239 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883e3 expref: 23 pid: 11943 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.388209:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7200/0x2fa243e067cc9239 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb883e3 expref: 23 pid: 11943 timeout: 765 lvb_type: 1 00010000:00010000:0.0:1746142891.388215:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.388217:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.388219:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cc92cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.388225:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cc92cc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.388881:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142891.389127:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962866748544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 953us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.389133:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5582 00000100:00100000:0.0:1746142891.397735:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.400105:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142891.400641:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400649:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400661:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400667:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400672:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400677:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c6800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142891.400679:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400684:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400692:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.400696:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c6800/0x2fa243e067cc92d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142891.400752:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+29:2006:x1830962866746880:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 26009us (26554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.400758:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12752 00000100:00100000:0.0:1746142891.405710:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.410287:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.410318:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.411184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.414966:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867579136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.415107:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578496 00000100:00100000:0.0:1746142891.415112:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578496 00000100:00100000:0.0:1746142891.415146:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578624 00000100:00100000:0.0:1746142891.415148:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578624 00000100:00100000:0.0:1746142891.415158:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579264 00000100:00100000:0.0:1746142891.415160:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579264 00000100:00100000:0.0:1746142891.415169:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12758 00000100:00100000:0.0:1746142891.415174:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+121:3762:x1830962867578496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.415248:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12760 00000100:00100000:0.0:1746142891.415253:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+123:3765:x1830962867578624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.415310:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+124:3765:x1830962867578624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (371us total) trans 21474840929 rc 0/0 00000100:00100000:0.0:1746142891.415315:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12760 00000100:00100000:0.0:1746142891.415329:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.415344:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867579648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.415361:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.415371:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867580160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.415381:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.415391:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142891.415395:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867579776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.415407:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.415414:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867580288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.415424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.415436:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579776 00000100:00100000:0.0:1746142891.415439:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579776 00000100:00100000:0.0:1746142891.415448:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580288 00000100:00100000:0.0:1746142891.415449:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580288 00000100:00100000:0.0:1746142891.415456:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12765 00000100:00100000:0.0:1746142891.415460:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fcfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+143:3764:x1830962867579648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.415519:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fcfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+146:3764:x1830962867579648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (157us total) trans 17179873658 rc 0/0 00000100:00100000:0.0:1746142891.415523:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12765 00000100:00100000:0.0:1746142891.415534:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12768 00000100:00100000:0.0:1746142891.415538:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+144:3764:x1830962867579776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142891.416117:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142891.416120:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142891.416122:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142891.416124:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142891.416125:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142891.416142:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+148:3764:x1830962867579776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 604us (734us total) trans 17179873666 rc 0/0 00000100:00100000:0.0:1746142891.416147:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12768 00000004:00080000:0.0:1746142891.416165:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bce680/2, rc 0, transno 17179873666 00000100:00100000:0.0:1746142891.416168:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867579776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142891.416174:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cdf80/2, rc 0, transno 17179873661 00000100:00100000:0.0:1746142891.416177:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867580288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142891.416181:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c06680/2, rc 0, transno 17179873658 00000100:00100000:0.0:1746142891.416184:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867579648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142891.416189:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938d0700/2, rc 0, transno 17179873660 00000100:00100000:0.0:1746142891.416191:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867580160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142891.416196:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbf4000/2, rc 0, transno 21474840932 00000100:00100000:0.0:1746142891.416199:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867579136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.416241:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+125:3762:x1830962867578496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1066us (1553us total) trans 21474840927 rc 0/0 00000100:00100000:0.0:1746142891.416246:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12758 00000100:00100000:0.0:1746142891.417491:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.420052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.422678:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.422711:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.422746:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.422758:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.422780:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.422806:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866750208 00000100:00100000:0.0:1746142891.422811:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866750208 00000100:00100000:0.0:1746142891.422837:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866750464 00000100:00100000:0.0:1746142891.422840:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866750464 00000100:00100000:0.0:1746142891.422849:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866750720 00000100:00100000:0.0:1746142891.422851:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866750720 00000100:00100000:0.0:1746142891.422858:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866750336 00000100:00100000:0.0:1746142891.422860:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866750336 00000100:00100000:0.0:1746142891.422870:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12775 00000100:00100000:0.0:1746142891.422876:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+27:2005:x1830962866750208:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142891.422889:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.422921:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cc9304 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88445 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142891.422939:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406ab, atime: 0x681406ab, ctime: 0x681406ab, blocks: 0x7f0 00010000:00010000:0.0:1746142891.422952:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.422954:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.422961:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cc9304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88445 expref: 28 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.422973:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cc9304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88445 expref: 28 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.422981:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6800, rc 0) 00000100:00100000:0.0:1746142891.423014:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+28:2005:x1830962866750208:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 133us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.423018:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12775 00000100:00100000:0.0:1746142891.423484:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12778 00000100:00100000:0.0:1746142891.423490:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+30:2005:x1830962866750336:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142891.423496:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.423502:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cc9319 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8844c expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142891.423510:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406ab, atime: 0x681406ab, ctime: 0x681406ab, blocks: 0x808 00010000:00010000:0.0:1746142891.423516:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.423517:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.423520:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cc9319 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8844c expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.423528:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cc9319 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8844c expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.423534:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7c00, rc 0) 00000100:00100000:0.0:1746142891.423547:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+31:2005:x1830962866750336:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 58us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.423551:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12778 00000100:00100000:0.0:1746142891.423559:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12779 00000100:00100000:0.0:1746142891.423563:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+28:2005:x1830962866750592:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142891.423567:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.423572:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c7400/0x2fa243e067cc9320 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8845a expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142891.423578:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406ab, atime: 0x681406ab, ctime: 0x681406ab, blocks: 0x808 00010000:00010000:0.0:1746142891.423583:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.423584:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.423587:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c7400/0x2fa243e067cc9320 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8845a expref: 29 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.423593:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c7400/0x2fa243e067cc9320 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8845a expref: 29 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.423599:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7400, rc 0) 00000100:00100000:0.0:1746142891.423607:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+29:2005:x1830962866750592:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 45us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.423690:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12779 00000100:00100000:0.0:1746142891.425525:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.435333:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.443463:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.451076:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.453709:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.457609:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142891.461573:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1600/0x2fa243e067cc935f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.461580:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1600/0x2fa243e067cc935f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000040:00080000:0.0:1746142891.461809:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].480, 88 off49944 00000004:00080000:0.0:1746142891.461814:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665460914308ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.461853:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].532, 88 off54608 00000004:00080000:0.0:1746142891.461857:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665460957238ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.461870:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].533, 88 off54696 00000004:00080000:0.0:1746142891.461872:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665460972342ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.461881:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].481, 88 off50032 00000004:00080000:0.0:1746142891.461883:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665460983299ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.461895:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].482, 88 off50120 00000004:00080000:0.0:1746142891.461917:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665460998094ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.461942:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].534, 88 off54784 00000004:00080000:0.0:1746142891.461946:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461045664ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.461953:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].535, 88 off54872 00000004:00080000:0.0:1746142891.461955:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461055667ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.461963:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].483, 88 off50208 00000004:00080000:0.0:1746142891.461965:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665461065559ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.461977:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].536, 88 off54960 00000004:00080000:0.0:1746142891.461979:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461079244ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.461986:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].484, 88 off50296 00000004:00080000:0.0:1746142891.461988:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665461088698ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.461998:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].537, 88 off55048 00000004:00080000:0.0:1746142891.462001:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461100859ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.462008:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].485, 88 off50384 00000004:00080000:0.0:1746142891.462010:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665461110257ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.462020:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].538, 88 off55136 00000004:00080000:0.0:1746142891.462022:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461122249ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.462028:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].486, 88 off50472 00000004:00080000:0.0:1746142891.462031:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665461130784ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142891.462041:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].539, 88 off55224 00000004:00080000:0.0:1746142891.462043:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461142968ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.462061:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].540, 88 off55312 00000004:00080000:0.0:1746142891.462064:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 665461163999ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142891.462074:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].487, 88 off50560 00000004:00080000:0.0:1746142891.462077:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 665461177229ns, next at 629431245375ns, rc = 0 00000100:00100000:0.0:1746142891.469563:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.469608:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.469630:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.469643:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.469657:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142891.469661:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.469674:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.469682:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.469692:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.469712:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581056 00000100:00100000:0.0:1746142891.469717:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581056 00000100:00100000:0.0:1746142891.469749:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581568 00000100:00100000:0.0:1746142891.469750:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581568 00000100:00100000:0.0:1746142891.469758:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581184 00000100:00100000:0.0:1746142891.469760:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581184 00000100:00100000:0.0:1746142891.469768:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581696 00000100:00100000:0.0:1746142891.469769:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581696 00000100:00100000:0.0:1746142891.469779:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12781 00000100:00100000:0.0:1746142891.469784:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+128:3764:x1830962867581056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142891.469875:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142891.469878:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142891.469880:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142891.469881:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142891 -> 1746142891 00002000:00010000:0.0:1746142891.469883:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142891.469922:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+129:3764:x1830962867581056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (314us total) trans 21474840935 rc 0/0 00000100:00100000:0.0:1746142891.469927:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12781 00000100:00100000:0.0:1746142891.469937:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12782 00000100:00100000:0.0:1746142891.469941:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+128:3764:x1830962867581568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.469978:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+129:3764:x1830962867581568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (335us total) trans 21474840936 rc 0/0 00000100:00100000:0.0:1746142891.470021:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12782 00000100:00100000:0.0:1746142891.470031:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12783 00000100:00100000:0.0:1746142891.470035:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+128:3764:x1830962867581184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.471934:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12790 00000100:00100000:0.0:1746142891.471942:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+132:3763:x1830962867581824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.472009:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+133:3763:x1830962867581824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (594us total) trans 21474840937 rc 0/0 00000100:00100000:0.0:1746142891.472014:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12790 00000100:00100000:0.0:1746142891.472032:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.472049:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.472062:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009601e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.472074:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142891.472097:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c7800/2, rc 0, transno 21474840935 00000100:00100000:0.0:1746142891.472102:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142891.472110:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096095500/2, rc 0, transno 21474840936 00000100:00100000:0.0:1746142891.472113:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.472118:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142891.472122:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.472135:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142891.472142:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009601c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.472157:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142891.472174:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644ea00/2, rc 0, transno 17179873670 00000100:00100000:0.0:1746142891.472181:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.472191:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867582720 00000100:00100000:0.0:1746142891.472194:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867582720 00000100:00100000:0.0:1746142891.472206:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12793 00000100:00100000:0.0:1746142891.472210:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+154:3764:x1830962867582592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142891.472252:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142891.472254:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142891.472256:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142891.472258:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142891.472259:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142891.472283:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+155:3764:x1830962867582592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (208us total) trans 17179873671 rc 0/0 00000100:00100000:0.0:1746142891.472292:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12793 00000100:00100000:0.0:1746142891.472301:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12795 00000100:00100000:0.0:1746142891.472305:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+154:3764:x1830962867582720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142891.472353:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+156:3764:x1830962867582720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (194us total) trans 17179873673 rc 0/0 00000100:00100000:0.0:1746142891.472358:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12795 00000004:00080000:0.0:1746142891.472376:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644f800/2, rc 0, transno 17179873672 00000100:00100000:0.0:1746142891.472379:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142891.472385:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009601c380/2, rc 0, transno 17179873673 00000100:00100000:0.0:1746142891.472388:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009601c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582720:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142891.472394:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009601e300/2, rc 0, transno 17179873671 00000100:00100000:0.0:1746142891.472396:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009601e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867582592:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746142891.472445:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1600/0x2fa243e067cc935f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8847d expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.472455:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142891.472457:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746142891.472468:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9358 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8847d expref: 9 pid: 7230 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746142891.472484:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1600/0x2fa243e067cc935f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8847d expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1746142891.472507:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c4a80/2, rc 0, transno 21474840940 00000100:00100000:0.0:1746142891.472510:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142891.472516:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092d0bb80/2, rc 0, transno 21474840941 00000100:00100000:0.0:1746142891.472519:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867581696:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746142891.472537:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142891.472539:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746142891.472541:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1600, rc 0) 00000100:00100000:0.0:1746142891.472573:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:31593:x1830962866751616:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 18728us (18869us total) trans 8589936159 rc 0/0 00000100:00100000:0.0:1746142891.472579:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14103 00000004:00080000:0.0:1746142891.473882:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092430700/2, rc 0, transno 21474840942 00000100:00100000:0.0:1746142891.473886:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867580928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142891.484113:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.484142:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866752256 00000100:00100000:0.0:1746142891.484150:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866752256 00000100:00100000:0.0:1746142891.484186:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14104 00000100:00100000:0.0:1746142891.484192:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:31597:x1830962866752256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.484212:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.484227:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cc936d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8848b expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.484286:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484296:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484304:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484318:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484323:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484328:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484413:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484420:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484425:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142891.484432:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142891.484487:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484493:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484498:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484502:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0a0200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142891.484505:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484511:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484518:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142891.484520:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142891.484523:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484528:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067cc9382 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484546:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484550:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484554:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484558:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484561:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c5600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142891.484563:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484567:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484572:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142891.484574:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142891.484576:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484580:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cc9374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484587:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484591:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484595:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484598:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982c7600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142891.484600:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484604:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.484608:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3d00) 00010000:00010000:0.0:1746142891.484610:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142891.484612:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.486115:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067cc937b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142891.486226:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cc936d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8848b expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.486233:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cc936d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8848b expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.486240:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4600, rc 0) 00000100:00100000:0.0:1746142891.486495:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:31597:x1830962866752256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2300us (2387us total) trans 8589936160 rc 301/301 00000100:00100000:0.0:1746142891.486502:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14104 00000100:00100000:0.0:1746142891.486800:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.489753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.494151:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496279:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496310:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496332:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496349:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866753152 00000100:00100000:0.0:1746142891.496354:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866753152 00000100:00100000:0.0:1746142891.496386:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866753408 00000100:00100000:0.0:1746142891.496388:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866753408 00000100:00100000:0.0:1746142891.496398:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866753664 00000100:00100000:0.0:1746142891.496399:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866753664 00000100:00100000:0.0:1746142891.496410:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12799 00000100:00100000:0.0:1746142891.496415:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962866753152:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.496427:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.496440:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067cc93c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb884a0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142891.496478:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867583360:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142891.496535:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142891.496558:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496626:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496668:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.496701:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12802 00000100:00100000:0.0:1746142891.498102:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962866753280:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.498111:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.498117:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed4c00/0x2fa243e067cc93e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb884a7 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.498126:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.498128:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.498132:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed4c00/0x2fa243e067cc93e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884a7 expref: 40 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.498140:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed4c00/0x2fa243e067cc93e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884a7 expref: 40 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.498146:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed4c00, rc 0) 00000100:00100000:0.0:1746142891.500376:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962866753280:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3660us (3807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.500386:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12802 00002000:00010000:0.0:1746142891.501183:0:1852:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746142891 -> 1746142892 00002000:00010000:0.0:1746142891.501186:0:1852:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746142891 -> 1746142892 00000100:00100000:0.0:1746142891.501201:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095c31880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867583360:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142891.501227:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067cc93c1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884a0 expref: 43 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.501237:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067cc93c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884a0 expref: 43 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.501246:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa51600, rc 0) 00000100:00100000:0.0:1746142891.501280:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962866753152:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4864us (5006us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142891.501286:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12799 00000100:00100000:0.0:1746142891.504658:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.504697:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.504992:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.508388:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866754688 00000100:00100000:0.0:1746142891.508394:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866754688 00002000:00100000:0.0:1746142891.508421:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (917504->1032191) req@ffff880088d7c380 x1830962866754688/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:42/0 lens 488/0 e 0 to 0 dl 1746142902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.508429:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c380 with x1830962866754688 ext(917504->1032191) 00010000:00010000:0.0:1746142891.508435:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cc9366 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1032191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88484 expref: 30 pid: 1853 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.508446:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cc9366 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 917504->1032191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88484 expref: 30 pid: 1853 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746142891.508451:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7c380 00000100:00100000:0.0:1746142891.508480:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1141 00000100:00100000:0.0:1746142891.508486:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962866754688:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142891.513476:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.515620:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.515921:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.515934:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.515947:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.515959:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.515990:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.516879:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12807 00000100:00100000:0.0:1746142891.516889:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+36:2005:x1830962866755328:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.516897:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.516922:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed5a00/0x2fa243e067cc942a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb884f4 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.516933:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.516935:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.516940:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed5a00/0x2fa243e067cc942a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884f4 expref: 38 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.516950:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed5a00/0x2fa243e067cc942a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884f4 expref: 38 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.516957:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed5a00, rc 0) 00000100:00100000:0.0:1746142891.516977:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+38:2005:x1830962866755328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 91us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.516983:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12807 00000100:00100000:0.0:1746142891.516997:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12810 00000100:00100000:0.0:1746142891.517002:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962866755456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.517008:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.517015:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed4800/0x2fa243e067cc943f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb884fb expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142891.517025:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.517026:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142891.517030:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed4800/0x2fa243e067cc943f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884fb expref: 25 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.517039:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed4800/0x2fa243e067cc943f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884fb expref: 24 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142891.517045:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed4800, rc 0) 00000100:00100000:0.0:1746142891.517060:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962866755456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 58us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142891.517065:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12810 00000100:00100000:0.0:1746142891.517701:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+36:2005:x1830962866754688:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 9214us (9452us total) trans 21474840943 rc 0/0 00000100:00100000:0.0:1746142891.517708:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1141 00002000:00100000:0.0:1746142891.517716:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (917504->1032191) req@ffff880088d7c380 x1830962866754688/t21474840943(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:42/0 lens 488/448 e 0 to 0 dl 1746142902 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.517736:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c380 with x1830962866754688 ext(917504->1032191) 00010000:00010000:0.0:1746142891.517742:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cc9366 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 917504->1032191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88484 expref: 36 pid: 1853 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.517752:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cc9366 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 917504->1032191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88484 expref: 36 pid: 1853 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746142891.517757:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7c380 00000100:00100000:0.0:1746142891.527067:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.527115:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.538870:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.538942:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.538970:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.538984:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.538995:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.539007:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.539021:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.539051:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.539798:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3614 00000100:00100000:0.0:1746142891.539803:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009601ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+35:2003:x1830962866757248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142891.543915:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.554055:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.554451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.554481:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.562337:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.570411:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009601ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+35:2003:x1830962866757248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 30599us (31406us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142891.570421:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3614 00002000:00100000:0.0:1746142891.570431:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009601ea00 x1830962866757248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:42/0 lens 488/440 e 0 to 0 dl 1746142902 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.570440:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009601ea00 with x1830962866757248 ext(0->1048575) 00002000:00010000:0.0:1746142891.570444:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009601ea00 00000100:00100000:0.0:1746142891.593743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.593832:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.595755:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.595823:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.598641:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.613051:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.617608:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.617631:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866760192 00000100:00100000:0.0:1746142891.617635:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866760192 00002000:00100000:0.0:1746142891.617662:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3104768->3145727) req@ffff8800979b1880 x1830962866760192/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:42/0 lens 488/0 e 0 to 0 dl 1746142902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.617669:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1880 with x1830962866760192 ext(3104768->3145727) 00010000:00010000:0.0:1746142891.617675:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fae00/0x2fa243e067cc9454 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88510 expref: 45 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.617683:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fae00/0x2fa243e067cc9454 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3104768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88510 expref: 45 pid: 11421 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746142891.617689:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979b1880 00000100:00100000:0.0:1746142891.617701:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1143 00000100:00100000:0.0:1746142891.617706:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962866760192:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142891.619577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.630389:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.630863:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.638453:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.638573:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.639541:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.643303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.657576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.673995:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.675374:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.680290:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.684093:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962866762368:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8109us (8717us total) trans 17179873676 rc 0/0 00000100:00100000:0.0:1746142891.684126:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1144 00002000:00100000:0.0:1746142891.684134:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2506751) req@ffff88009862fb80 x1830962866762368/t17179873676(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:42/0 lens 488/448 e 0 to 0 dl 1746142902 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142891.684142:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862fb80 with x1830962866762368 ext(2097152->2506751) 00010000:00010000:0.0:1746142891.684162:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009495ce00/0x2fa243e067cc945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88517 expref: 44 pid: 11421 timeout: 765 lvb_type: 0 00010000:00010000:0.0:1746142891.684181:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009495ce00/0x2fa243e067cc945b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88517 expref: 44 pid: 11421 timeout: 765 lvb_type: 0 00002000:00010000:0.0:1746142891.684187:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009862fb80 00000100:00100000:0.0:1746142891.715258:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.717799:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.717841:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.720657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.724617:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.725979:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.726587:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.729545:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.743830:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.755128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.756891:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.768042:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.772053:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.772095:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.784502:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.789287:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.801654:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.862403:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.974167:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.994065:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.995593:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.995650:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.995679:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866767104 00000100:00100000:0.0:1746142891.995684:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866767104 00000100:00100000:0.0:1746142891.995733:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14112 00000100:00100000:0.0:1746142891.995739:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013240ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:31617:x1830962866767104:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142891.995752:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142891.995764:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fc00/0x2fa243e067cc9511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88580 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142891.997068:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142891.999932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.000225:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.000260:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.000752:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12827 00000100:00100000:0.0:1746142892.000757:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013240f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962866767616:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142892.000763:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142892.000768:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067cc9542 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8858e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142892.000806:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013240fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867586944:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142892.000824:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.005799:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.008567:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.012458:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.019326:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.019378:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.019398:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866768768 00000100:00100000:0.0:1746142892.019402:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866768768 00002000:00100000:0.0:1746142892.019430:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7b:0x0] (3452928->4194303) req@ffff880091de0e00 x1830962866768768/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:43/0 lens 488/0 e 0 to 0 dl 1746142903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.019439:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0e00 with x1830962866768768 ext(3452928->4194303) 00010000:00010000:0.0:1746142892.019446:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067cc950a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3452928->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88572 expref: 42 pid: 1853 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.019457:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067cc950a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3452928->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88572 expref: 42 pid: 1853 timeout: 766 lvb_type: 0 00002000:00010000:0.0:1746142892.019463:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091de0e00 00000100:00100000:0.0:1746142892.019488:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1147 00000100:00100000:0.0:1746142892.019495:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962866768768:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142892.032422:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.035014:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.047783:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.047819:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.047842:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.047997:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866769664 00000100:00100000:0.0:1746142892.048001:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866769664 00000100:00100000:0.0:1746142892.048490:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12831 00000100:00100000:0.0:1746142892.048496:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962866769664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142892.048503:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142892.048511:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067cc9581 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb885b1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142892.048534:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867587712:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142892.048565:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.049600:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.052893:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.055509:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.056750:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.059798:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.060383:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.065369:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962866771072:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5406us (5575us total) trans 17179873678 rc 0/0 00000100:00100000:0.0:1746142892.065377:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1151 00002000:00100000:0.0:1746142892.065385:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3338239) req@ffff880091de3480 x1830962866771072/t17179873678(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:43/0 lens 488/448 e 0 to 0 dl 1746142903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.065394:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de3480 with x1830962866771072 ext(3145728->3338239) 00010000:00010000:0.0:1746142892.065402:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067cc9549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88595 expref: 27 pid: 12211 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.065414:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067cc9549 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88595 expref: 27 pid: 12211 timeout: 766 lvb_type: 0 00002000:00010000:0.0:1746142892.065421:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091de3480 00000100:00100000:0.0:1746142892.075029:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.075076:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.081023:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.101105:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.101161:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.101551:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.107811:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867588224:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142892.107838:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cc9596 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885c6 expref: 38 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.107853:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d2a00, rc 0) 00000100:00100000:0.0:1746142892.107913:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+38:31617:x1830962866772224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6655us (6801us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142892.107921:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12834 00000100:00100000:0.0:1746142892.110281:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.132341:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.132391:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.142353:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.142394:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.156312:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.174820:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.177464:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.193793:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.224170:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.231061:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.233499:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.236722:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.241299:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.245650:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.246717:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866776192 00000100:00100000:0.0:1746142892.246720:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866776192 00010000:00010000:0.0:1746142892.246736:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cc9596 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885c6 expref: 39 pid: 12211 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746142892.246751:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5614 00000100:00100000:0.0:1746142892.246756:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+39:2006:x1830962866776192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142892.246763:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142892.246771:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cc9596 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885c6 expref: 39 pid: 12211 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.246779:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cc9596 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885c6 expref: 39 pid: 12211 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.246790:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cc9596 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885c6 expref: 39 pid: 12211 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.246895:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.246897:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.246918:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc95ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885e2 expref: 38 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.246925:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc95ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885e2 expref: 38 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.246948:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc95ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885e2 expref: 38 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142892.246958:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867589248:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142892.247010:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.255213:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.258340:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.288532:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.313993:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.335066:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.342838:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.362153:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.381477:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.385421:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.389216:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.394853:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+40:2006:x1830962866778752:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4267us (4385us total) trans 21474840948 rc 0/0 00000100:00100000:0.0:1746142892.394864:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1154 00002000:00100000:0.0:1746142892.394873:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3477503) req@ffff880088d7df80 x1830962866778752/t21474840948(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:43/0 lens 488/448 e 0 to 0 dl 1746142903 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.394882:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7df80 with x1830962866778752 ext(3145728->3477503) 00010000:00010000:0.0:1746142892.394890:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc95ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885e2 expref: 40 pid: 12211 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.394929:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc95ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb885e2 expref: 40 pid: 12211 timeout: 766 lvb_type: 0 00002000:00010000:0.0:1746142892.394941:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7df80 00000100:00100000:0.0:1746142892.402487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.402530:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.405304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.411411:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.411446:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.411479:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.412018:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5618 00000100:00100000:0.0:1746142892.412026:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962866779520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142892.412032:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142892.412040:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cc9431 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ed expref: 8 pid: 11421 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746142892.412048:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cc9431 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ed expref: 8 pid: 11421 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746142892.412058:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cc9431 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ed expref: 8 pid: 11421 timeout: 766 lvb_type: 1 00010000:00010000:0.0:1746142892.412069:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.412070:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.412075:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 7 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.412081:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 7 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.412106:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 7 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142892.412115:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132406680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867590016:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142892.412151:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.414745:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.414955:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3647 00000100:00100000:0.0:1746142892.414963:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962866779904:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142892.415065:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962866779904:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 103us (321us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142892.415071:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3647 00002000:00100000:0.0:1746142892.415076:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1273856->1277951) req@ffff880132406a00 x1830962866779904/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746142903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.415083:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132406a00 with x1830962866779904 ext(1273856->1277951) 00002000:00010000:0.0:1746142892.415086:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132406a00 00000100:00100000:0.0:1746142892.422450:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866780288 00000100:00100000:0.0:1746142892.422454:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866780288 00002000:00100000:0.0:1746142892.422479:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1495040->1499135) req@ffff880130377100 x1830962866780288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:43/0 lens 488/0 e 0 to 0 dl 1746142903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.422487:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377100 with x1830962866780288 ext(1495040->1499135) 00002000:00010000:0.0:1746142892.422491:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130377100 00000100:00100000:0.0:1746142892.422546:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3648 00000100:00100000:0.0:1746142892.422553:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962866780288:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142892.422644:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962866780288:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 91us (212us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142892.422650:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3648 00002000:00100000:0.0:1746142892.422655:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1495040->1499135) req@ffff880130377100 x1830962866780288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:43/0 lens 488/4536 e 0 to 0 dl 1746142903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.422661:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377100 with x1830962866780288 ext(1495040->1499135) 00002000:00010000:0.0:1746142892.422664:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130377100 00000100:00100000:0.0:1746142892.429028:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.429071:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.431604:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.441230:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.444938:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.447005:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.447038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.447559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.447577:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866781696 00000100:00100000:0.0:1746142892.447580:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866781696 00000100:00100000:0.0:1746142892.448322:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12842 00000100:00100000:0.0:1746142892.448329:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962866781952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142892.448335:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142892.448343:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5a00/0x2fa243e067cc967d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88621 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142892.448363:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132406d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867590528:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142892.448384:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.449182:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867590272:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142892.449195:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142892.449218:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132407800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962866781568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2964us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142892.449224:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5619 00000100:00100000:0.0:1746142892.452777:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.463232:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.468179:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866782592 00000100:00100000:0.0:1746142892.470142:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866782592 00000100:00100000:0.0:1746142892.470197:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12843 00000100:00100000:0.0:1746142892.470205:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:31638:x1830962866782592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142892.470218:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142892.470232:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc9684 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88628 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.470257:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 6 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.470263:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142892.470264:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142892.470267:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc9684 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88628 expref: 23 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.470291:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 6 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.470302:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 6 pid: 12211 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746142892.470322:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132405f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867590656:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142892.470414:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.472516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.481409:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962866782720:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 8392us (8884us total) trans 21474840949 rc 0/0 00000100:00100000:0.0:1746142892.481422:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1156 00002000:00100000:0.0:1746142892.481432:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1273856->1499135) req@ffff880132406300 x1830962866782720/t21474840949(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:43/0 lens 488/448 e 0 to 0 dl 1746142903 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.481441:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132406300 with x1830962866782720 ext(1273856->1499135) 00010000:00010000:0.0:1746142892.481449:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 9 pid: 12211 timeout: 766 lvb_type: 0 00010000:00010000:0.0:1746142892.481460:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9645 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88605 expref: 9 pid: 12211 timeout: 766 lvb_type: 0 00002000:00010000:0.0:1746142892.481467:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880132406300 00000100:00100000:0.0:1746142892.485809:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.494590:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866783104 00000100:00100000:0.0:1746142892.494598:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866783104 00002000:00100000:0.0:1746142892.494636:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088d7ea00 x1830962866783104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:43/0 lens 488/0 e 0 to 0 dl 1746142903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142892.494646:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ea00 with x1830962866783104 ext(1048576->2097151) 00002000:00010000:0.0:1746142892.494650:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7ea00 00000100:00100000:0.0:1746142892.495361:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3650 00000100:00100000:0.0:1746142892.495369:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962866783104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142892.517341:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.517391:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.517890:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.517942:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.518628:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03f00 going to sleep for 11 seconds 00002000:00010000:0.0:1746142892.522256:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142892 -> 1746142893 00000100:00100000:0.0:1746142892.522268:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867591040:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142892.522282:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3fc00/0x2fa243e067cc96bc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88644 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142892.522290:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3fc00/0x2fa243e067cc96bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88644 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142892.522310:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3fc00, rc 0) 00000100:00100000:0.0:1746142892.522326:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962866783872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4299us (4384us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142892.522331:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12846 00000100:00100000:0.0:1746142892.577374:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.577424:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.582542:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.606297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.611397:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.611588:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.617263:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.620025:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.666328:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.681361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.683045:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.690087:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.691716:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.701022:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.710946:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.714103:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.745580:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.745659:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.751309:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.751957:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.751996:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.762288:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.775070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.775194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.776317:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.787617:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.787693:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.795724:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.819695:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.827814:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.827894:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.827946:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866791424 00000100:00100000:0.0:1746142892.827953:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866791424 00000100:00100000:0.0:1746142892.827994:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12858 00000100:00100000:0.0:1746142892.828001:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:31654:x1830962866791424:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142892.828016:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142892.828029:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb886b4 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.828047:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.828052:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e400/0x2fa243e067cc9764 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2600960->3145727] (req 2600960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886a6 expref: 10 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.828057:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142892.828059:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886b4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.828083:0:1854:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e400/0x2fa243e067cc9764 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2600960->3145727] (req 2600960->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886a6 expref: 10 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.828092:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886b4 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.828101:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc79c00, rc 0) 00000100:00100000:0.0:1746142892.828130:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:31654:x1830962866791424:12345-192.168.204.50@tcp:101:cat.0 Request processed in 130us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142892.828135:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12858 00000100:00100000:0.0:1746142892.843349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.843386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.846945:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.848300:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.849194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.849268:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.856253:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.865624:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.873842:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.875412:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866793344 00000100:00100000:0.0:1746142892.875417:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866793344 00000100:00100000:0.0:1746142892.875445:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12861 00000100:00100000:0.0:1746142892.875450:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:31650:x1830962866793344:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142892.875458:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142892.875467:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cc97aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb886d0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.875485:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cc9748 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8868a expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.875494:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e200/0x2fa243e067cc975d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8869f expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.875499:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.875606:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142892.875611:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cc97aa lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886d0 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.875629:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e200/0x2fa243e067cc975d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8869f expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.875639:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e200/0x2fa243e067cc975d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8869f expref: 26 pid: 11421 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746142892.875647:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867593472:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142892.875676:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cc9748 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8868a expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142892.875683:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cc9748 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8868a expref: 11 pid: 11421 timeout: 766 lvb_type: 0 00000100:00100000:0.0:1746142892.875691:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867593600:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142892.875734:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142892.877417:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.880584:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.880623:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.887536:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.892452:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867593728:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142892.892467:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142892.892485:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962866794112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4839us (4955us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142892.892492:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5631 00000100:00100000:0.0:1746142892.893539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.902780:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.904190:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.915452:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.927551:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.931556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.931806:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142892.958410:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.025853:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.034380:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.034439:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.034483:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866796800 00000100:00100000:0.0:1746142893.034490:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866796800 00000100:00100000:0.0:1746142893.034532:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12864 00000100:00100000:0.0:1746142893.035777:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962866796800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142893.035791:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142893.035805:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb886ec expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.035823:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.035825:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.035832:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886ec expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.035846:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886ec expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.035855:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495ca00, rc 0) 00000100:00100000:0.0:1746142893.036633:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962866796800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2094us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.036639:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12864 00000100:00100000:0.0:1746142893.039495:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.045052:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.045126:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.045168:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866797312 00000100:00100000:0.0:1746142893.045173:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866797312 00010000:00010000:0.0:1746142893.045194:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cc944d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88509 expref: 12 pid: 1853 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.045211:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866797440 00000100:00100000:0.0:1746142893.045213:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866797440 00010000:00010000:0.0:1746142893.045221:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cc93f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ca expref: 28 pid: 1852 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.045232:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5633 00000100:00100000:0.0:1746142893.045238:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866797312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.045249:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.045266:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cc944d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88509 expref: 12 pid: 1853 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.045275:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cc944d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88509 expref: 12 pid: 1853 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.045293:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cc944d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88509 expref: 12 pid: 1853 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.045304:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.045321:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866797312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.045326:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5633 00000100:00100000:0.0:1746142893.045336:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5634 00000100:00100000:0.0:1746142893.045340:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962866797440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.045345:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.045351:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cc93f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ca expref: 28 pid: 1852 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.045360:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cc93f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ca expref: 28 pid: 1852 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.045369:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cc93f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884ca expref: 28 pid: 1852 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.045378:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.045379:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.045384:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cc97e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 851968->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886f3 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.045391:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cc97e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 851968->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886f3 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.045414:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cc97e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 851968->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886f3 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142893.045424:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867594368:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142893.045467:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142893.048467:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.048508:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.049150:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.049172:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866797952 00000100:00100000:0.0:1746142893.049175:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866797952 00000100:00100000:0.0:1746142893.049191:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12866 00000100:00100000:0.0:1746142893.049195:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:31666:x1830962866797952:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142893.049208:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142893.049217:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495d200/0x2fa243e067cc9813 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88701 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.049233:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc9684 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88628 expref: 26 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.049240:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc96ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88636 expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.049245:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.049246:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.049249:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495d200/0x2fa243e067cc9813 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1564672->1617919] (req 1564672->1617919) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88701 expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.049267:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc96ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88636 expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.049275:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3b000/0x2fa243e067cc96ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88636 expref: 12 pid: 12211 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.049284:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867594496:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142893.049323:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc9684 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88628 expref: 26 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.049331:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5200/0x2fa243e067cc9684 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88628 expref: 26 pid: 12211 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.049342:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867594624:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142893.049356:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142893.054347:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.054401:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.055297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.055321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.056156:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.056211:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866798848 00000100:00100000:0.0:1746142893.056214:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866798848 00002000:00100000:0.0:1746142893.056235:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88009cfeca80 x1830962866798848/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:44/0 lens 488/0 e 0 to 0 dl 1746142904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142893.056242:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfeca80 with x1830962866798848 ext(2097152->3145727) 00002000:00010000:0.0:1746142893.056245:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfeca80 00000100:00100000:0.0:1746142893.056255:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3672 00000100:00100000:0.0:1746142893.056260:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866798848:12345-192.168.204.50@tcp:3:multiop.0 00000100:00080000:0.0:1746142893.056738:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746142893.057922:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142893.065583:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866798848:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 9323us (9427us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142893.065590:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3672 00002000:00100000:0.0:1746142893.065596:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88009cfeca80 x1830962866798848/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:44/0 lens 488/440 e 0 to 0 dl 1746142904 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142893.065603:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfeca80 with x1830962866798848 ext(2097152->3145727) 00002000:00010000:0.0:1746142893.065607:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfeca80 00000100:00080000:0.0:1746142893.065622:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142893.077173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.086584:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866799872 00000100:00100000:0.0:1746142893.086592:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866799872 00000100:00100000:0.0:1746142893.087322:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12869 00000100:00100000:0.0:1746142893.087328:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866799872:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142893.087334:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142893.087342:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495c400/0x2fa243e067cc9828 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8870f expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142893.087364:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867595520:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142893.087398:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142893.088705:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.102475:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.102530:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.103156:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12871 00000100:00100000:0.0:1746142893.103163:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962866800896:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142893.103171:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142893.103179:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495c400/0x2fa243e067cc9836 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8871d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142893.103201:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867595776:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142893.105329:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142893.106240:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867595776:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142893.106417:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495c400/0x2fa243e067cc9836 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8871d expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.106427:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495c400/0x2fa243e067cc9836 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8871d expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.106446:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495c400, rc 0) 00000100:00100000:0.0:1746142893.106471:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962866800896:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3308us (3940us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142893.106476:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12871 00000100:00100000:0.0:1746142893.106818:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142893.107689:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142893.108211:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.108311:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866801536 00000100:00100000:0.0:1746142893.108315:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866801536 00000100:00100000:0.0:1746142893.108333:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12872 00000100:00100000:0.0:1746142893.108337:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962866801536:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142893.108344:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142893.108352:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009495da00/0x2fa243e067cc9860 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88739 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142893.108382:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867595904:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142893.108430:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142893.110100:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.110870:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.117891:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.118809:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.118842:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.132783:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.143137:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.148733:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.173440:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.193743:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.200550:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.200601:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.211406:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.213392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.216483:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.221394:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.221688:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.221720:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.221744:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.221765:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.221785:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866804608 00000100:00100000:0.0:1746142893.221792:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866804608 00000100:00100000:0.0:1746142893.222258:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866804864 00000100:00100000:0.0:1746142893.222262:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866804864 00000100:00100000:0.0:1746142893.228068:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.232966:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867596928:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142893.232989:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142893.233289:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866805504 00000100:00100000:0.0:1746142893.233294:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866805504 00010000:00010000:0.0:1746142893.233317:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950400/0x2fa243e067cc9891 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8874e expref: 11 pid: 7231 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.233334:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5642 00000100:00100000:0.0:1746142893.233341:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962866805504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.233351:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.233356:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950400/0x2fa243e067cc9891 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8874e expref: 11 pid: 7231 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.233364:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950400/0x2fa243e067cc9891 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8874e expref: 11 pid: 7231 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.233382:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950400/0x2fa243e067cc9891 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8874e expref: 11 pid: 7231 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.233404:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142893.233407:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142893.233415:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142893.233421:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142893.233433:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.233460:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962866805504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.233465:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5642 00010000:00010000:0.0:1746142893.233498:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142893.233502:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142893.233519:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142893.233606:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951400/0x2fa243e067cc98bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88778 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.233616:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88778 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.233621:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142893.233624:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142893.233626:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d951c00, rc 0) 00000100:00100000:0.0:1746142893.233658:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b759180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:31674:x1830962866805376:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 5374us (5597us total) trans 8589936205 rc 0/0 00000100:00100000:0.0:1746142893.233663:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14129 00000100:00100000:0.0:1746142893.238741:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866805760 00000100:00100000:0.0:1746142893.238749:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866805760 00000100:00100000:0.0:1746142893.238785:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14130 00000100:00100000:0.0:1746142893.238792:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:31674:x1830962866805760:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142893.238811:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142893.238814:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746142893.238835:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cc98c2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88778 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.238848:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142893.238851:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142893.238860:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25800/0x2fa243e067cc98d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8877f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.238961:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25200/0x2fa243e067cc98d7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142893.238972:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25200/0x2fa243e067cc98d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142893.238979:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25200/0x2fa243e067cc98d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142893.238988:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142893.239065:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25800/0x2fa243e067cc98d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8877f expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.239076:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25200/0x2fa243e067cc98d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8877f expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.239081:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142893.239962:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142893.239965:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25200, rc 0) 00000100:00100000:0.0:1746142893.240023:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:31674:x1830962866805760:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 1229us (1364us total) trans 8589936206 rc 0/0 00000100:00100000:0.0:1746142893.240030:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14130 00000100:00100000:0.0:1746142893.241843:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.245354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.246487:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.246553:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.246567:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.246579:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.246599:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142893.256022:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc2c00/0x2fa243e067cc98b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8876a expref: 10 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142893.256034:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fc2c00/0x2fa243e067cc98b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8876a expref: 10 pid: 11943 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.256046:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b75ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867597824:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142893.256116:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cc97b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886de expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.256125:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cc97b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886de expref: 28 pid: 11421 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.256132:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b75b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867597952:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142893.256315:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142893.257142:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130375180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867597312:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142893.257321:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866806784 00000100:00100000:0.0:1746142893.257325:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866806784 00010000:00010000:0.0:1746142893.257337:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cc97e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 851968->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886f3 expref: 29 pid: 11421 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.269886:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866807296 00000100:00100000:0.0:1746142893.269892:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866807296 00010000:00010000:0.0:1746142893.269941:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cc989f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88763 expref: 10 pid: 1853 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.269971:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5647 00000100:00100000:0.0:1746142893.269977:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962866807296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.269987:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.270004:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cc989f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88763 expref: 10 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.270012:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cc989f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88763 expref: 10 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.270029:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cc989f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88763 expref: 10 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.270052:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.270086:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962866807296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.270091:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5647 00000100:00100000:0.0:1746142893.277798:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.277839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.277866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.277889:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.277955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.277972:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.277990:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866808448 00000100:00100000:0.0:1746142893.277997:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866808448 00010000:00010000:0.0:1746142893.278024:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886ec expref: 12 pid: 11421 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.278042:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866807552 00000100:00100000:0.0:1746142893.278044:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866807552 00010000:00010000:0.0:1746142893.278052:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cc97b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886de expref: 28 pid: 11421 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.278059:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866807424 00000100:00100000:0.0:1746142893.278061:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866807424 00010000:00010000:0.0:1746142893.278069:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc2c00/0x2fa243e067cc98b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8876a expref: 9 pid: 11943 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.278076:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866807808 00000100:00100000:0.0:1746142893.278078:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866807808 00010000:00010000:0.0:1746142893.278085:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f38e200/0x2fa243e067cc930b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88453 expref: 13 pid: 1853 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.278093:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866808064 00000100:00100000:0.0:1746142893.278094:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866808064 00010000:00010000:0.0:1746142893.278100:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067cc98a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88771 expref: 14 pid: 1853 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.278107:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866808320 00000100:00100000:0.0:1746142893.278109:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866808320 00010000:00010000:0.0:1746142893.278115:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc9875 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88747 expref: 29 pid: 1854 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.278124:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5648 00000100:00100000:0.0:1746142893.278130:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866808448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278142:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278158:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886ec expref: 12 pid: 11421 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278167:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886ec expref: 12 pid: 11421 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278184:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495ca00/0x2fa243e067cc97e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886ec expref: 12 pid: 11421 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278196:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278228:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866808448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278234:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5648 00000100:00100000:0.0:1746142893.278246:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5649 00000100:00100000:0.0:1746142893.278250:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962866807552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278256:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278262:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cc97b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886de expref: 29 pid: 11421 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.278270:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cc97b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886de expref: 29 pid: 11421 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.278280:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cc97b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886de expref: 29 pid: 11421 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.278291:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278303:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962866807552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278308:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5649 00000100:00100000:0.0:1746142893.278335:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5650 00000100:00100000:0.0:1746142893.278339:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962866807424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278345:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278351:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fc2c00/0x2fa243e067cc98b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8876a expref: 9 pid: 11943 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278358:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fc2c00/0x2fa243e067cc98b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8876a expref: 9 pid: 11943 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278368:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2c00/0x2fa243e067cc98b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8876a expref: 9 pid: 11943 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278376:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.278377:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.278381:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.278388:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.278403:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278416:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962866807424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278420:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5650 00000100:00100000:0.0:1746142893.278429:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5651 00000100:00100000:0.0:1746142893.278433:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962866807808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278440:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278449:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f38e200/0x2fa243e067cc930b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88453 expref: 14 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278456:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f38e200/0x2fa243e067cc930b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88453 expref: 14 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278466:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f38e200/0x2fa243e067cc930b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88453 expref: 14 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278474:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278485:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962866807808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 52us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278490:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5651 00000100:00100000:0.0:1746142893.278498:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5652 00000100:00100000:0.0:1746142893.278502:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962866808064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278507:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278514:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067cc98a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88771 expref: 12 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278521:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067cc98a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88771 expref: 12 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278531:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067cc98a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88771 expref: 12 pid: 1853 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278540:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278552:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962866808064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278556:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5652 00000100:00100000:0.0:1746142893.278565:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5653 00000100:00100000:0.0:1746142893.278569:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962866808320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278574:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278581:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc9875 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88747 expref: 27 pid: 1854 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.278587:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc9875 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88747 expref: 27 pid: 1854 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.278596:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed1200/0x2fa243e067cc9875 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88747 expref: 27 pid: 1854 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.278602:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.278604:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.278606:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067cc9908 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.278611:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067cc9908 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.278623:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278636:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962866808320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278641:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5653 00000100:00100000:0.0:1746142893.278664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.278675:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866807680 00000100:00100000:0.0:1746142893.278678:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866807680 00010000:00010000:0.0:1746142893.278686:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067cc9423 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884e6 expref: 9 pid: 9578 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.278710:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5654 00000100:00100000:0.0:1746142893.278714:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962866807680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278720:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278725:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067cc9423 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884e6 expref: 9 pid: 9578 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278732:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067cc9423 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884e6 expref: 9 pid: 9578 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278742:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067cc9423 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb884e6 expref: 9 pid: 9578 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278749:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.278751:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.278753:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067cc98f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.278763:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067cc98f3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.278774:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278786:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962866807680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278791:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5654 00000100:00100000:0.0:1746142893.278827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.278835:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866807936 00000100:00100000:0.0:1746142893.278837:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866807936 00010000:00010000:0.0:1746142893.278844:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ee00/0x2fa243e067cc97b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886d7 expref: 8 pid: 1854 timeout: 767 lvb_type: 1 00000100:00100000:0.0:1746142893.278853:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5655 00000100:00100000:0.0:1746142893.278857:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962866807936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.278861:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.278867:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ee00/0x2fa243e067cc97b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886d7 expref: 8 pid: 1854 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278873:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ee00/0x2fa243e067cc97b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886d7 expref: 8 pid: 1854 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278883:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ee00/0x2fa243e067cc97b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886d7 expref: 8 pid: 1854 timeout: 767 lvb_type: 1 00010000:00010000:0.0:1746142893.278890:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.278921:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962866807936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 62us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.278926:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5655 00000100:00100000:0.0:1746142893.278967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.278977:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866808192 00000100:00100000:0.0:1746142893.278980:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866808192 00010000:00010000:0.0:1746142893.278989:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886b4 expref: 28 pid: 1854 timeout: 767 lvb_type: 0 00000100:00100000:0.0:1746142893.278999:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5656 00000100:00100000:0.0:1746142893.279002:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962866808192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142893.279007:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142893.279012:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886b4 expref: 28 pid: 1854 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.279019:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886b4 expref: 28 pid: 1854 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.279028:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cc79c00/0x2fa243e067cc9772 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb886b4 expref: 28 pid: 1854 timeout: 767 lvb_type: 0 00010000:00010000:0.0:1746142893.279035:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.279036:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142893.279039:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067cc990f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279044:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067cc990f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279061:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142893.279075:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962866808192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.279079:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5656 00010000:00010000:0.0:1746142893.279590:0:12211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279597:0:12211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279611:0:12211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279617:0:12211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279623:0:12211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279628:0:12211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800920cfe00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142893.279631:0:12211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279638:0:12211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279652:0:12211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142893.279657:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc98fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142893.279704:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b759f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962866806528:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 32851us (33150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.279711:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12883 00000100:00100000:0.0:1746142893.289828:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.294868:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.295574:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.301323:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867599744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142893.301753:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301778:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.301794:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301807:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142893.301825:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301840:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867601280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.301854:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301868:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746142893.301872:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867599616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.301883:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301893:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142893.301925:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301932:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.301944:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301950:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867601152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.301961:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142893.301979:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12888 00000100:00100000:0.0:1746142893.301985:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3765:x1830962867599488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142893.303108:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3765:x1830962867599488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1123us (1336us total) trans 17179873686 rc 0/0 00000100:00100000:0.0:1746142893.303115:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12888 00000100:00100000:0.0:1746142893.305555:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867600512 00000100:00100000:0.0:1746142893.305561:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867600512 00000100:00100000:0.0:1746142893.305580:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867601024 00000100:00100000:0.0:1746142893.305582:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867601024 00000100:00100000:0.0:1746142893.305589:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867599360 00000100:00100000:0.0:1746142893.305592:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867599360 00000100:00100000:0.0:1746142893.305599:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12897 00000100:00100000:0.0:1746142893.305604:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fcfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3765:x1830962867600512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.305711:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fcfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867600512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (3258us total) trans 21474840961 rc 0/0 00000100:00100000:0.0:1746142893.305716:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12897 00000100:00100000:0.0:1746142893.305822:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12898 00000100:00100000:0.0:1746142893.305826:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3765:x1830962867601024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142893.305877:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142893.305879:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142893.305881:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142893.305883:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142893.305885:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:0.0:1746142893.305920:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3765:x1830962867601024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (3427us total) trans 17179873687 rc 0/0 00000100:00100000:0.0:1746142893.305925:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12898 00000100:00100000:0.0:1746142893.305934:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12899 00000100:00100000:0.0:1746142893.305938:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3764:x1830962867599360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142893.305988:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867599360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (3480us total) trans 17179873688 rc 0/0 00000100:00100000:0.0:1746142893.305992:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12899 00000004:00080000:0.0:1746142893.306023:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b75b800/2, rc 0, transno 21474840958 00000100:00100000:0.0:1746142893.306028:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b75b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867599616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142893.306036:0:3763:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873675 gen 2 00000004:00080000:0.0:1746142893.306039:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c3100, transno 17179873489 00000004:00080000:0.0:1746142893.306045:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c3480, transno 17179873490 00000004:00080000:0.0:1746142893.306047:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c1180, transno 17179873491 00000004:00080000:0.0:1746142893.306049:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092137800, transno 17179873492 00000004:00080000:0.0:1746142893.306051:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092134700, transno 17179873493 00000004:00080000:0.0:1746142893.306053:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800968e9c00, transno 17179873494 00000004:00080000:0.0:1746142893.306055:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c2d80, transno 17179873495 00000004:00080000:0.0:1746142893.306057:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c2300, transno 17179873496 00000004:00080000:0.0:1746142893.306059:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5e680, transno 17179873501 00000004:00080000:0.0:1746142893.306061:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5f800, transno 17179873502 00000004:00080000:0.0:1746142893.306063:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5fb80, transno 17179873503 00000004:00080000:0.0:1746142893.306064:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5ca80, transno 17179873504 00000004:00080000:0.0:1746142893.306066:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5f100, transno 17179873505 00000004:00080000:0.0:1746142893.306067:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5f480, transno 17179873506 00000004:00080000:0.0:1746142893.306070:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5df80, transno 17179873507 00000004:00080000:0.0:1746142893.306072:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5ce00, transno 17179873508 00000004:00080000:0.0:1746142893.306074:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5c000, transno 17179873509 00000004:00080000:0.0:1746142893.306075:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1a300, transno 17179873513 00000004:00080000:0.0:1746142893.306077:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1bb80, transno 17179873514 00000004:00080000:0.0:1746142893.306078:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1b480, transno 17179873515 00000004:00080000:0.0:1746142893.306080:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f18a80, transno 17179873516 00000004:00080000:0.0:1746142893.306082:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1b100, transno 17179873517 00000004:00080000:0.0:1746142893.306083:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f19880, transno 17179873518 00000004:00080000:0.0:1746142893.306086:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f18380, transno 17179873519 00000004:00080000:0.0:1746142893.306088:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f19c00, transno 17179873520 00000004:00080000:0.0:1746142893.306090:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f19f80, transno 17179873521 00000004:00080000:0.0:1746142893.306092:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096070000, transno 17179873522 00000004:00080000:0.0:1746142893.306094:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096070e00, transno 17179873523 00000004:00080000:0.0:1746142893.306095:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096072300, transno 17179873524 00000004:00080000:0.0:1746142893.306097:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096070a80, transno 17179873525 00000004:00080000:0.0:1746142893.306099:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096071500, transno 17179873526 00000004:00080000:0.0:1746142893.306101:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096071880, transno 17179873527 00000004:00080000:0.0:1746142893.306103:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096072680, transno 17179873528 00000004:00080000:0.0:1746142893.306105:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096073480, transno 17179873529 00000004:00080000:0.0:1746142893.306107:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc63b80, transno 17179873530 00000004:00080000:0.0:1746142893.306109:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862c000, transno 17179873533 00000004:00080000:0.0:1746142893.306111:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862d180, transno 17179873534 00000004:00080000:0.0:1746142893.306113:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862ce00, transno 17179873535 00000004:00080000:0.0:1746142893.306114:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862f800, transno 17179873536 00000004:00080000:0.0:1746142893.306116:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862c700, transno 17179873537 00000004:00080000:0.0:1746142893.306118:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862d880, transno 17179873538 00000004:00080000:0.0:1746142893.306121:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862c380, transno 17179873539 00000004:00080000:0.0:1746142893.306122:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862df80, transno 17179873540 00000004:00080000:0.0:1746142893.306124:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862dc00, transno 17179873541 00000004:00080000:0.0:1746142893.306127:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a35b100, transno 17179873546 00000004:00080000:0.0:1746142893.306129:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a359c00, transno 17179873547 00000004:00080000:0.0:1746142893.306131:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130120a80, transno 17179873548 00000004:00080000:0.0:1746142893.306133:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130123100, transno 17179873549 00000004:00080000:0.0:1746142893.306134:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a358a80, transno 17179873550 00000004:00080000:0.0:1746142893.306137:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130121c00, transno 17179873551 00000004:00080000:0.0:1746142893.306139:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130121f80, transno 17179873552 00000004:00080000:0.0:1746142893.306140:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130120000, transno 17179873553 00000004:00080000:0.0:1746142893.306143:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130122300, transno 17179873554 00000004:00080000:0.0:1746142893.306144:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130121180, transno 17179873555 00000004:00080000:0.0:1746142893.306146:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130120700, transno 17179873556 00000004:00080000:0.0:1746142893.306147:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130123480, transno 17179873557 00000004:00080000:0.0:1746142893.306149:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862e680, transno 17179873558 00000004:00080000:0.0:1746142893.306151:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130122680, transno 17179873559 00000004:00080000:0.0:1746142893.306153:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862ed80, transno 17179873560 00000004:00080000:0.0:1746142893.306154:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5c700, transno 17179873561 00000004:00080000:0.0:1746142893.306156:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862d500, transno 17179873562 00000004:00080000:0.0:1746142893.306158:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862ea00, transno 17179873563 00000004:00080000:0.0:1746142893.306160:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e518700, transno 17179873568 00000004:00080000:0.0:1746142893.306162:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e51a300, transno 17179873569 00000004:00080000:0.0:1746142893.306164:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d3b80, transno 17179873570 00000004:00080000:0.0:1746142893.306166:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e519880, transno 17179873571 00000004:00080000:0.0:1746142893.306168:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e519f80, transno 17179873572 00000004:00080000:0.0:1746142893.306170:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d1f80, transno 17179873573 00000004:00080000:0.0:1746142893.306172:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809fb80, transno 17179873574 00000004:00080000:0.0:1746142893.306174:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d0e00, transno 17179873575 00000004:00080000:0.0:1746142893.306176:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e518e00, transno 17179873576 00000004:00080000:0.0:1746142893.306178:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1a3480, transno 17179873581 00000004:00080000:0.0:1746142893.306180:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734aa00, transno 17179873582 00000004:00080000:0.0:1746142893.306182:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1a1500, transno 17179873583 00000004:00080000:0.0:1746142893.306185:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1a0700, transno 17179873584 00000004:00080000:0.0:1746142893.306187:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009601ce00, transno 17179873585 00000004:00080000:0.0:1746142893.306189:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cfec700, transno 17179873586 00000004:00080000:0.0:1746142893.306191:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1a1c00, transno 17179873587 00000004:00080000:0.0:1746142893.306193:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097348000, transno 17179873588 00000004:00080000:0.0:1746142893.306195:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097349880, transno 17179873589 00000004:00080000:0.0:1746142893.306197:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092405180, transno 17179873590 00000004:00080000:0.0:1746142893.306199:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e2a00, transno 17179873591 00000004:00080000:0.0:1746142893.306201:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092407480, transno 17179873592 00000004:00080000:0.0:1746142893.306202:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e0e00, transno 17179873593 00000004:00080000:0.0:1746142893.306204:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c3800, transno 17179873594 00000004:00080000:0.0:1746142893.306206:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e3800, transno 17179873595 00000004:00080000:0.0:1746142893.306207:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092404700, transno 17179873596 00000004:00080000:0.0:1746142893.306209:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e1880, transno 17179873597 00000004:00080000:0.0:1746142893.306211:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c5500, transno 17179873598 00000004:00080000:0.0:1746142893.306213:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c6a00, transno 17179873600 00000004:00080000:0.0:1746142893.306215:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c5c00, transno 17179873601 00000004:00080000:0.0:1746142893.306217:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e679180, transno 17179873602 00000004:00080000:0.0:1746142893.306219:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e679f80, transno 17179873603 00000004:00080000:0.0:1746142893.306220:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e67b800, transno 17179873604 00000004:00080000:0.0:1746142893.306222:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734a300, transno 17179873605 00000004:00080000:0.0:1746142893.306225:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800979b0380, transno 17179873606 00000004:00080000:0.0:1746142893.306226:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c5880, transno 17179873607 00000004:00080000:0.0:1746142893.306228:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e1c00, transno 17179873608 00000004:00080000:0.0:1746142893.306230:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e3100, transno 17179873610 00000004:00080000:0.0:1746142893.306232:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c6680, transno 17179873611 00000004:00080000:0.0:1746142893.306233:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e1500, transno 17179873612 00000004:00080000:0.0:1746142893.306235:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e0a80, transno 17179873613 00000004:00080000:0.0:1746142893.306237:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e0380, transno 17179873614 00000004:00080000:0.0:1746142893.306239:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092134a80, transno 17179873615 00000004:00080000:0.0:1746142893.306241:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e3480, transno 17179873616 00000004:00080000:0.0:1746142893.306243:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092136680, transno 17179873617 00000004:00080000:0.0:1746142893.306245:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800979f2d80, transno 17179873618 00000004:00080000:0.0:1746142893.306247:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092406a00, transno 17179873624 00000004:00080000:0.0:1746142893.306249:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092406d80, transno 17179873625 00000004:00080000:0.0:1746142893.306251:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092404a80, transno 17179873626 00000004:00080000:0.0:1746142893.306253:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092407100, transno 17179873627 00000004:00080000:0.0:1746142893.306254:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092405f80, transno 17179873628 00000004:00080000:0.0:1746142893.306256:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092406300, transno 17179873629 00000004:00080000:0.0:1746142893.306258:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130120380, transno 17179873630 00000004:00080000:0.0:1746142893.306260:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092404000, transno 17179873631 00000004:00080000:0.0:1746142893.306261:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130122d80, transno 17179873632 00000004:00080000:0.0:1746142893.306263:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a28ed80, transno 17179873637 00000004:00080000:0.0:1746142893.306265:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a28f100, transno 17179873638 00000004:00080000:0.0:1746142893.306267:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a28c000, transno 17179873639 00000004:00080000:0.0:1746142893.306269:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a28e300, transno 17179873640 00000004:00080000:0.0:1746142893.306271:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a28d180, transno 17179873641 00000004:00080000:0.0:1746142893.306273:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e51a680, transno 17179873642 00000004:00080000:0.0:1746142893.306275:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a28ca80, transno 17179873643 00000004:00080000:0.0:1746142893.306277:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cc700, transno 17179873644 00000004:00080000:0.0:1746142893.306279:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e51b800, transno 17179873645 00000004:00080000:0.0:1746142893.306281:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13df80, transno 17179873646 00000004:00080000:0.0:1746142893.306283:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092136300, transno 17179873647 00000004:00080000:0.0:1746142893.306284:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13d500, transno 17179873648 00000004:00080000:0.0:1746142893.306286:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de11500, transno 17179873649 00000004:00080000:0.0:1746142893.306288:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13e300, transno 17179873650 00000004:00080000:0.0:1746142893.306289:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13dc00, transno 17179873651 00000004:00080000:0.0:1746142893.306291:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800979f2a00, transno 17179873652 00000004:00080000:0.0:1746142893.306293:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009601df80, transno 17179873653 00000004:00080000:0.0:1746142893.306295:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092134000, transno 17179873654 00000004:00080000:0.0:1746142893.306298:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c06680, transno 17179873658 00000004:00080000:0.0:1746142893.306300:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c06d80, transno 17179873659 00000004:00080000:0.0:1746142893.306302:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d0700, transno 17179873660 00000004:00080000:0.0:1746142893.306304:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cdf80, transno 17179873661 00000004:00080000:0.0:1746142893.306306:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d1880, transno 17179873662 00000004:00080000:0.0:1746142893.306308:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734ed80, transno 17179873663 00000004:00080000:0.0:1746142893.306310:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bcc700, transno 17179873664 00000004:00080000:0.0:1746142893.306312:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cfeea00, transno 17179873665 00000004:00080000:0.0:1746142893.306314:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bce680, transno 17179873666 00000004:00080000:0.0:1746142893.306316:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cc000, transno 17179873667 00000004:00080000:0.0:1746142893.306318:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009601dc00, transno 17179873668 00000004:00080000:0.0:1746142893.306320:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009601ed80, transno 17179873669 00000004:00080000:0.0:1746142893.306322:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644ea00, transno 17179873670 00000004:00080000:0.0:1746142893.306324:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009601e300, transno 17179873671 00000004:00080000:0.0:1746142893.306325:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644f800, transno 17179873672 00000004:00080000:0.0:1746142893.306328:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009601c380, transno 17179873673 00000004:00080000:0.0:1746142893.306330:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f18e00, transno 17179873674 00000004:00080000:0.0:1746142893.306331:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1a680, transno 17179873675 00000100:00100000:0.0:1746142893.306337:0:3763:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880097433800 x1830962867600128/t17179873685(17179873685) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142909 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746142893.306349:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097433800/2, rc 0, transno 17179873685 00000100:00100000:0.0:1746142893.306353:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142893.306365:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b75b480/2, rc 0, transno 21474840959 00000100:00100000:0.0:1746142893.306368:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b75b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142893.306374:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d4380/2, rc 0, transno 21474840960 00000100:00100000:0.0:1746142893.306377:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867601152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142893.306384:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924f4000/2, rc 0, transno 17179873683 00000100:00100000:0.0:1746142893.306387:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867599744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142893.306393:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b75b100/2, rc 0, transno 21474840955 00000100:00100000:0.0:1746142893.306395:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b75b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142893.306401:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d0000/2, rc 0, transno 17179873684 00000100:00100000:0.0:1746142893.306404:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867600768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142893.306410:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d4700/2, rc 0, transno 21474840957 00000100:00100000:0.0:1746142893.306413:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867601280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142893.306871:0:8109:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 128 done 00000100:00100000:0.0:1746142893.316776:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.319941:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.319976:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.319994:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.320052:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.324631:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.324683:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.330141:0:9582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867601536 00000100:00100000:0.0:1746142893.330148:0:9582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867601536 00000100:00100000:0.0:1746142893.330197:0:9582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1746142893.330204:0:9582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830962867601536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746142893.330229:0:9582:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1305218752 pending 1785856 free 3908063232 avail 3676540928 00000100:00100000:0.0:1746142893.330264:0:9582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830962867601536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.330270:0:9582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1746142893.838670:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.838719:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.838749:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.838776:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.838795:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866810752 00000100:00100000:0.0:1746142893.838802:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866810752 00000100:00100000:0.0:1746142893.838831:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866811264 00000100:00100000:0.0:1746142893.838833:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866811264 00000100:00100000:0.0:1746142893.838847:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 532 00000100:00100000:0.0:1746142893.838853:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962866810752:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.838930:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962866810752:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.838936:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 532 00000100:00100000:0.0:1746142893.838948:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 533 00000100:00100000:0.0:1746142893.838952:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962866811264:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.838970:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962866811264:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 18us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.838975:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 533 00000100:00100000:0.0:1746142893.838999:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.839016:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866810496 00000100:00100000:0.0:1746142893.839018:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866810496 00000100:00100000:0.0:1746142893.839034:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866811008 00000100:00100000:0.0:1746142893.839036:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866811008 00000100:00100000:0.0:1746142893.839044:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866811520 00000100:00100000:0.0:1746142893.839045:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866811520 00000100:00100000:0.0:1746142893.839054:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 850 00000100:00100000:0.0:1746142893.839058:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962866810496:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839085:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962866810496:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839093:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 850 00000100:00100000:0.0:1746142893.839100:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 851 00000100:00100000:0.0:1746142893.839104:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962866811008:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839121:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962866811008:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 16us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839125:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 851 00000100:00100000:0.0:1746142893.839131:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 852 00000100:00100000:0.0:1746142893.839135:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962866811520:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839148:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962866811520:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 13us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839152:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 852 00000100:00100000:0.0:1746142893.839194:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.839204:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866811776 00000100:00100000:0.0:1746142893.839207:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866811776 00000100:00100000:0.0:1746142893.839220:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 534 00000100:00100000:0.0:1746142893.839224:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962866811776:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839242:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962866811776:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 18us (48us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839245:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 534 00000100:00100000:0.0:1746142893.839278:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.839292:0:8100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866810368 00000100:00100000:0.0:1746142893.839295:0:8100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866810368 00000100:00100000:0.0:1746142893.839315:0:8100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:0.0:1746142893.839319:0:8100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800944af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9590e9a3-538a-49d5-a431-e1408ed78761+15:2005:x1830962866810368:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839335:0:8100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800944af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9590e9a3-538a-49d5-a431-e1408ed78761+15:2005:x1830962866810368:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 16us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839339:0:8100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 177 00000100:00100000:0.0:1746142893.839370:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.839379:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866810624 00000100:00100000:0.0:1746142893.839381:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866810624 00000100:00100000:0.0:1746142893.839406:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 853 00000100:00100000:0.0:1746142893.839410:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962866810624:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839426:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962866810624:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 17us (56us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839431:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 853 00000100:00100000:0.0:1746142893.839455:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.839471:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.839479:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866811136 00000100:00100000:0.0:1746142893.839482:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866811136 00000100:00100000:0.0:1746142893.839503:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 854 00000100:00100000:0.0:1746142893.839507:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+5:2005:x1830962866811136:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.839527:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+5:2005:x1830962866811136:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 19us (54us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.839531:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 854 00000100:00100000:0.0:1746142893.841409:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.841425:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866811392 00000100:00100000:0.0:1746142893.841431:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866811392 00000100:00100000:0.0:1746142893.841459:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 536 00000100:00100000:0.0:1746142893.841465:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962866811392:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142893.841504:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962866811392:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142893.841509:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 536 00000100:00100000:0.0:1746142893.841705:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142893.841749:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.113116:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867601664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746142894.113172:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.114495:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867601664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746142894.331407:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.331449:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.331474:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.331499:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.331513:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.331527:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866812416 00000100:00100000:0.0:1746142894.331530:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866812416 00000100:00100000:0.0:1746142894.331552:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866812672 00000100:00100000:0.0:1746142894.331553:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866812672 00000100:00100000:0.0:1746142894.331562:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866812288 00000100:00100000:0.0:1746142894.331564:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866812288 00000100:00100000:0.0:1746142894.331577:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12911 00000100:00100000:0.0:1746142894.331582:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866812160:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.331659:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866812160:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.331666:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12911 00000100:00100000:0.0:1746142894.331704:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12912 00000100:00100000:0.0:1746142894.331709:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962866812672:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.331739:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962866812672:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.331743:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12912 00000100:00100000:0.0:1746142894.331752:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12914 00000100:00100000:0.0:1746142894.331756:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962866812288:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.331783:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962866812288:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.331788:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12914 00000100:00100000:0.0:1746142894.331869:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866812544 00000100:00100000:0.0:1746142894.331872:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866812544 00000100:00100000:0.0:1746142894.331895:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12915 00000100:00100000:0.0:1746142894.331929:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866812544:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.331962:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866812544:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.331967:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12915 00000100:00100000:0.0:1746142894.335612:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.335643:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.335667:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.335696:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866812928 00000100:00100000:0.0:1746142894.335703:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866812928 00000100:00100000:0.0:1746142894.335738:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866813440 00000100:00100000:0.0:1746142894.335741:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866813440 00000100:00100000:0.0:1746142894.335797:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12918 00000100:00100000:0.0:1746142894.335802:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962866813440:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.335836:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962866813440:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.335953:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12918 00000100:00100000:0.0:1746142894.335966:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12919 00000100:00100000:0.0:1746142894.335971:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962866812800:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.336004:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962866812800:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.336009:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12919 00000100:00100000:0.0:1746142894.336021:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866813312 00000100:00100000:0.0:1746142894.336023:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866813312 00000100:00100000:0.0:1746142894.336041:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12921 00000100:00100000:0.0:1746142894.336045:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962866813312:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142894.336071:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962866813312:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 26us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.336076:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12921 00000100:00100000:0.0:1746142894.339658:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.341294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.349489:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.349528:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.349576:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.349590:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866814208 00000100:00100000:0.0:1746142894.349594:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866814208 00000100:00100000:0.0:1746142894.350138:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3683 00000100:00100000:0.0:1746142894.350146:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962866813952:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:0.0:1746142894.350185:0:29473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091fc2e00/0x2fa243e067cc995c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.350208:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.350210:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.350214:0:29473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc2e00/0x2fa243e067cc995c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.350225:0:29473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc2e00/0x2fa243e067cc995c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.352180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.352200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.352222:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.352233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.352245:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866814720 00000100:00100000:0.0:1746142894.352251:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866814720 00000100:00100000:0.0:1746142894.352271:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866814976 00000100:00100000:0.0:1746142894.352272:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866814976 00000100:00100000:0.0:1746142894.352279:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866815232 00000100:00100000:0.0:1746142894.352280:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866815232 00000100:00100000:0.0:1746142894.352288:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866815488 00000100:00100000:0.0:1746142894.352290:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866815488 00000100:00100000:0.0:1746142894.352298:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3686 00000100:00100000:0.0:1746142894.352303:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962866814720:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:0.0:1746142894.352318:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130ab5400/0x2fa243e067cc9971 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.352326:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.352327:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.352330:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130ab5400/0x2fa243e067cc9971 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.352342:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130ab5400/0x2fa243e067cc9971 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.352955:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.411379:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.415731:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866816128 00000100:00100000:0.0:1746142894.415738:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866816128 00000100:00100000:0.0:1746142894.415769:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5067 00000100:00100000:0.0:1746142894.415776:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88006d8b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:31674:x1830962866816128:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:0.0:1746142894.415962:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88006d8b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:31674:x1830962866816128:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 185us (346us total) trans 8589936208 rc 0/0 00000100:00100000:0.0:1746142894.415968:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5067 00000100:00100000:0.0:1746142894.417304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.440459:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.446683:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.446727:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.446742:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.446773:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.446786:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.446805:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866816768 00000100:00100000:0.0:1746142894.446812:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866816768 00000100:00100000:0.0:1746142894.446840:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866816896 00000100:00100000:0.0:1746142894.446841:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866816896 00000100:00100000:0.0:1746142894.446850:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866817024 00000100:00100000:0.0:1746142894.446851:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866817024 00000100:00100000:0.0:1746142894.446858:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866817152 00000100:00100000:0.0:1746142894.446859:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866817152 00000100:00100000:0.0:1746142894.446872:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12924 00000100:00100000:0.0:1746142894.446878:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962866816768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142894.446892:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142894.446928:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131323400/0x2fa243e067cc99b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb887cc expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.446946:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.446948:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.446955:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131323400/0x2fa243e067cc99b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887cc expref: 28 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142894.446968:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131323400/0x2fa243e067cc99b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887cc expref: 28 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142894.446978:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131323400, rc 0) 00000100:00100000:0.0:1746142894.447013:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962866816768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 134us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.447019:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12924 00000100:00100000:0.0:1746142894.457128:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.457251:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.460973:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.461129:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.461210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.467386:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.467422:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.467443:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.467482:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.487068:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.487275:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.491545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.491577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.491598:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.491609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.491639:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.491655:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866820736 00000100:00100000:0.0:1746142894.491658:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866820736 00000100:00100000:0.0:1746142894.491691:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14140 00000100:00100000:0.0:1746142894.491702:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:31687:x1830962866820736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142894.491718:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142894.491730:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb7000/0x2fa243e067cc9a4a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8883c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.491768:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb7000/0x2fa243e067cc9a4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8883c expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.491777:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb7000/0x2fa243e067cc9a4a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8883c expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.491789:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142894.491791:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142894.491793:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fb7000, rc 0) 00000100:00100000:0.0:1746142894.491811:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:31687:x1830962866820736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 114us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.491816:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14140 00000100:00100000:0.0:1746142894.497049:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867603840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746142894.497099:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.497175:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746142894.497180:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867603968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746142894.497196:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.497563:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867603968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746142894.497573:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867603840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746142894.508731:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.508778:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.513433:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866822528 00000100:00100000:0.0:1746142894.513437:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866822528 00000100:00100000:0.0:1746142894.513470:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14141 00000100:00100000:0.0:1746142894.513476:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:31683:x1830962866822528:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142894.513487:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142894.513490:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746142894.513511:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb7000/0x2fa243e067cc9a4a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8883c expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513528:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142894.513532:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142894.513541:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cc9a6d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88843 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513575:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067cc9a74 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142894.513585:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc9a2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8880b expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513591:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067cc991d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8878d expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513598:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1c00/0x2fa243e067cc9a19 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88804 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513603:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067cc9a74 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142894.513625:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1c00/0x2fa243e067cc9a19 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88804 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513635:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1c00/0x2fa243e067cc9a19 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88804 expref: 10 pid: 10924 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746142894.513644:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867604096:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142894.513730:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067cc991d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8878d expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513738:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067cc991d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8878d expref: 8 pid: 7230 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746142894.513744:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867604224:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142894.513763:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc9a2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8880b expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.513769:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067cc9a2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8880b expref: 10 pid: 7231 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746142894.513776:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867604352:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142894.513789:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.516310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.529978:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867605888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.529999:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.530012:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.530021:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.530029:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142894.530032:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.530042:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.530048:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.530057:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.530068:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605888 00000100:00100000:0.0:1746142894.530071:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605888 00000100:00100000:0.0:1746142894.530083:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606400 00000100:00100000:0.0:1746142894.530085:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606400 00000100:00100000:0.0:1746142894.530090:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606016 00000100:00100000:0.0:1746142894.530091:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606016 00000100:00100000:0.0:1746142894.530096:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606528 00000100:00100000:0.0:1746142894.530097:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606528 00000100:00100000:0.0:1746142894.530102:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12945 00000100:00100000:0.0:1746142894.530106:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867605888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142894.530153:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142894.530155:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142893 -> 1746142893 00002000:00010000:0.0:1746142894.530157:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142892 -> 1746142892 00002000:00010000:0.0:1746142894.530158:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142893 -> 1746142893 00002000:00010000:0.0:1746142894.530160:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142894.530176:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3764:x1830962867605888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (176us total) trans 21474840964 rc 0/0 00000100:00100000:0.0:1746142894.530181:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12945 00000100:00100000:0.0:1746142894.530189:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12946 00000100:00100000:0.0:1746142894.530192:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867606400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.530227:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3764:x1830962867606400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (206us total) trans 21474840965 rc 0/0 00000100:00100000:0.0:1746142894.530232:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12946 00000100:00100000:0.0:1746142894.530238:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12947 00000100:00100000:0.0:1746142894.530241:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867606016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142894.530275:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:0.0:1746142894.530277:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142893 -> 1746142893 00002000:00010000:0.0:1746142894.530279:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142893 -> 1746142893 00002000:00010000:0.0:1746142894.530280:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142893 -> 1746142893 00002000:00010000:0.0:1746142894.530282:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142894.530295:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3764:x1830962867606016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (252us total) trans 21474840966 rc 0/0 00000100:00100000:0.0:1746142894.530299:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12947 00000100:00100000:0.0:1746142894.530306:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12948 00000100:00100000:0.0:1746142894.530310:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867606528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142894.530341:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142894.530343:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142894.530345:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142894.530346:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142894.530348:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142894.530364:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3764:x1830962867606528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (306us total) trans 21474840967 rc 0/0 00000100:00100000:0.0:1746142894.530369:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12948 00000004:00080000:0.0:1746142894.530391:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d6680/2, rc 0, transno 21474840966 00000100:00100000:0.0:1746142894.530395:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142894.530401:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d7100/2, rc 0, transno 21474840967 00000100:00100000:0.0:1746142894.530403:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142894.530408:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d5500/2, rc 0, transno 21474840964 00000100:00100000:0.0:1746142894.530410:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867605888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142894.530415:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d7800/2, rc 0, transno 21474840965 00000100:00100000:0.0:1746142894.530417:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.534498:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.554711:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.560301:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560324:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867607040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560339:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.560353:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867607552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.560408:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867608064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560425:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.560443:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607168 00000100:00100000:0.0:1746142894.560446:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607168 00000100:00100000:0.0:1746142894.560457:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607680 00000100:00100000:0.0:1746142894.560458:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607680 00000100:00100000:0.0:1746142894.560468:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12953 00000100:00100000:0.0:1746142894.560473:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867606784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560547:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12958 00000100:00100000:0.0:1746142894.560552:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3765:x1830962867607552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560596:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3765:x1830962867607552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (201us total) trans 21474840975 rc 0/0 00000100:00100000:0.0:1746142894.560602:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12958 00000100:00100000:0.0:1746142894.560614:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.560626:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867607424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560640:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.560652:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867607936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560682:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142894.560694:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867608448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560709:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142894.560729:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130374380/2, rc 0, transno 17179873705 00000100:00100000:0.0:1746142894.560735:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867607424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142894.560745:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130377100/2, rc 0, transno 17179873706 00000100:00100000:0.0:1746142894.560747:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867606912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560751:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746142894.560755:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867608576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560768:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142894.560786:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096141880/2, rc 0, transno 21474840977 00000100:00100000:0.0:1746142894.560790:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867607936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560802:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12965 00000100:00100000:0.0:1746142894.560807:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830962867608576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560855:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830962867608576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (85us total) trans 17179873708 rc 0/0 00000100:00100000:0.0:1746142894.560860:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12965 00000004:00080000:0.0:1746142894.560878:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130377480/2, rc 0, transno 17179873703 00000100:00100000:0.0:1746142894.560880:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867608064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142894.560889:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096141c00/2, rc 0, transno 21474840973 00000100:00100000:0.0:1746142894.560892:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867607040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142894.560915:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096142d80/2, rc 0, transno 21474840975 00000100:00100000:0.0:1746142894.560918:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867607552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142894.560928:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867609088 00000100:00100000:0.0:1746142894.560931:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867609088 00000100:00100000:0.0:1746142894.560938:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608704 00000100:00100000:0.0:1746142894.560940:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608704 00000100:00100000:0.0:1746142894.560947:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12968 00000100:00100000:0.0:1746142894.560950:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867609088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.560999:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3763:x1830962867609088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (126us total) trans 17179873709 rc 0/0 00000100:00100000:0.0:1746142894.561004:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12968 00000004:00080000:0.0:1746142894.561022:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c4700/2, rc 0, transno 17179873708 00000100:00100000:0.0:1746142894.561025:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867608576:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142894.561032:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c6d80/2, rc 0, transno 17179873707 00000100:00100000:0.0:1746142894.561034:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867608448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142894.563073:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.563096:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.563363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.565861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.565891:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.570530:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.572253:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.572656:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.572723:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.572743:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866824320 00000100:00100000:0.0:1746142894.572748:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866824320 00010000:00010000:0.0:1746142894.572770:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cc9a58 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88827 expref: 16 pid: 9579 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.572789:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866824192 00000100:00100000:0.0:1746142894.572791:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866824192 00010000:00010000:0.0:1746142894.572799:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009397b200/0x2fa243e067cc99cc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887e1 expref: 29 pid: 12211 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.572810:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866824448 00000100:00100000:0.0:1746142894.572811:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866824448 00010000:00010000:0.0:1746142894.572818:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89ce00/0x2fa243e067cc9947 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b0 expref: 10 pid: 9580 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.572829:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5667 00000100:00100000:0.0:1746142894.572835:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962866824320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.572843:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.572858:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cc9a58 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88827 expref: 16 pid: 9579 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.572866:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cc9a58 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88827 expref: 16 pid: 9579 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.572882:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cc9a58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88827 expref: 15 pid: 9579 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.572894:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.572929:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962866824320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.572934:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5667 00000100:00100000:0.0:1746142894.572945:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5669 00000100:00100000:0.0:1746142894.572949:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962866824448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.572955:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.572962:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a89ce00/0x2fa243e067cc9947 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b0 expref: 10 pid: 9580 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.572969:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a89ce00/0x2fa243e067cc9947 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b0 expref: 10 pid: 9580 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.572980:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a89ce00/0x2fa243e067cc9947 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b0 expref: 10 pid: 9580 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.572987:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.572988:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.572993:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067cc9a9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88866 expref: 13 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.573000:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067cc9a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88866 expref: 13 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.573019:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067cc9a9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88866 expref: 13 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.573028:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867609600:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142894.573594:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.574891:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d73b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867609600:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142894.575170:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.575199:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962866824448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2248us (2475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.575205:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5669 00000100:00100000:0.0:1746142894.575454:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.575471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.575869:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3701 00000100:00100000:0.0:1746142894.575875:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866824832:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142894.579479:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866825472 00000100:00100000:0.0:1746142894.579484:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866825472 00010000:00010000:0.0:1746142894.579505:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009397a400/0x2fa243e067cc99c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887da expref: 32 pid: 12211 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.579536:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5670 00000100:00100000:0.0:1746142894.579543:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962866825472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.579552:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.579708:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009397a400/0x2fa243e067cc99c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887da expref: 31 pid: 12211 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.579723:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009397a400/0x2fa243e067cc99c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887da expref: 31 pid: 12211 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.579836:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009397a400/0x2fa243e067cc99c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887da expref: 31 pid: 12211 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.579851:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.579870:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962866825472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 328us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.579875:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5670 00000100:00100000:0.0:1746142894.584713:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.584745:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.584868:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866824832:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 8992us (10015us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142894.584876:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3701 00002000:00100000:0.0:1746142894.584886:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096141500 x1830962866824832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:45/0 lens 488/440 e 0 to 0 dl 1746142905 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142894.584895:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141500 with x1830962866824832 ext(1048576->2097151) 00002000:00010000:0.0:1746142894.584920:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141500 00000100:00100000:0.0:1746142894.584936:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866826112 00000100:00100000:0.0:1746142894.584941:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866826112 00002000:00100000:0.0:1746142894.584961:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880135d72a00 x1830962866826112/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:45/0 lens 488/0 e 0 to 0 dl 1746142905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142894.584967:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d72a00 with x1830962866826112 ext(3145728->4194303) 00002000:00010000:0.0:1746142894.584971:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d72a00 00000100:00100000:0.0:1746142894.591755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.591790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.596576:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866826880 00000100:00100000:0.0:1746142894.596580:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866826880 00000100:00100000:0.0:1746142894.596661:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12972 00000100:00100000:0.0:1746142894.596677:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:31688:x1830962866826880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142894.596688:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142894.596699:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067cc9aac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88874 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.596713:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067cc9aa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1581055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8886d expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.596718:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142894.596719:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142894.596721:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067cc9aac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88874 expref: 11 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.596737:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067cc9aa5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1581055) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8886d expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.596747:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067cc9aa5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1159168->1581055) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8886d expref: 31 pid: 9578 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746142894.596755:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096094000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867610240:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142894.596774:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.601936:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867610112:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142894.601952:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.601983:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962866826752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5670us (5819us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.601990:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5672 00000100:00100000:0.0:1746142894.610107:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.611392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.615807:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.622968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.623003:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.624660:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.636217:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.636464:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.639827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.639968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.640000:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.645003:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.664254:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.664305:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.665718:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3710 00000100:00100000:0.0:1746142894.665725:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962866830336:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142894.699978:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.710237:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.756027:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.760810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.763145:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.763167:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.763186:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.763214:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866831360 00000100:00100000:0.0:1746142894.763219:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866831360 00010000:00010000:0.0:1746142894.763240:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131323400/0x2fa243e067cc99b7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887cc expref: 30 pid: 9578 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.763271:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866831616 00000100:00100000:0.0:1746142894.763273:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866831616 00010000:00010000:0.0:1746142894.763282:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067cc9932 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8879b expref: 9 pid: 9580 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.763294:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866831488 00000100:00100000:0.0:1746142894.763296:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866831488 00010000:00010000:0.0:1746142894.763304:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067cc9a3c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88812 expref: 14 pid: 1397 timeout: 768 lvb_type: 1 00000100:00100000:0.0:1746142894.763316:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5674 00000100:00100000:0.0:1746142894.763322:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2004:x1830962866831360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.763331:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.763347:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131323400/0x2fa243e067cc99b7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887cc expref: 30 pid: 9578 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.763356:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131323400/0x2fa243e067cc99b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887cc expref: 30 pid: 9578 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.763375:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.763402:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2004:x1830962866831360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.763411:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5674 00000100:00100000:0.0:1746142894.763424:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5675 00000100:00100000:0.0:1746142894.763428:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962866831616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.763434:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.763441:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067cc9932 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8879b expref: 9 pid: 9580 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.763447:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067cc9932 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8879b expref: 9 pid: 9580 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.763457:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.763468:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962866831616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.763473:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5675 00000100:00100000:0.0:1746142894.763501:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5676 00000100:00100000:0.0:1746142894.763506:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962866831488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.763511:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.763518:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067cc9a3c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88812 expref: 14 pid: 1397 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.763526:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067cc9a3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88812 expref: 14 pid: 1397 timeout: 768 lvb_type: 1 00010000:00010000:0.0:1746142894.763535:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.763537:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.763542:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d2c00/0x2fa243e067cc9af9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888a5 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.763549:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d2c00/0x2fa243e067cc9af9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888a5 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.763569:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d2c00/0x2fa243e067cc9af9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888a5 expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.763578:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867611392:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142894.763620:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.768196:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.772062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.776773:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.776984:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.777023:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.781426:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866832640 00000100:00100000:0.0:1746142894.781432:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866832640 00002000:00100000:0.0:1746142894.781462:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1056768->1060863) req@ffff880094cd6300 x1830962866832640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:45/0 lens 488/0 e 0 to 0 dl 1746142905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142894.781471:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094cd6300 with x1830962866832640 ext(1056768->1060863) 00002000:00010000:0.0:1746142894.781475:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094cd6300 00000100:00100000:0.0:1746142894.781971:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3713 00000100:00100000:0.0:1746142894.781978:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962866832640:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142894.782083:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962866832640:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 104us (721us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142894.782092:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3713 00002000:00100000:0.0:1746142894.782097:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1056768->1060863) req@ffff880094cd6300 x1830962866832640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:45/0 lens 488/4536 e 0 to 0 dl 1746142905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142894.782104:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094cd6300 with x1830962866832640 ext(1056768->1060863) 00002000:00010000:0.0:1746142894.782107:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094cd6300 00000100:00100000:0.0:1746142894.783996:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.841423:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.848574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.849013:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.849051:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.849081:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866833664 00000100:00100000:0.0:1746142894.849093:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866833664 00000100:00100000:0.0:1746142894.849145:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 12981 00000100:00100000:0.0:1746142894.849151:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962866833280:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142894.849161:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142894.849172:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebc800/0x2fa243e067cc9b2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb888ba expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.849209:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867612032:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142894.849281:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.850608:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1746142894.850647:0:1852:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142893 -> 1746142895 00002000:00010000:0.0:1746142894.850650:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142893 -> 1746142895 00002000:00010000:0.0:1746142894.850651:0:1852:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142893 -> 1746142895 00000100:00100000:0.0:1746142894.850676:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867612160:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142894.850697:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098444600/0x2fa243e067cc9b31 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888c8 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142894.850706:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098444600/0x2fa243e067cc9b31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888c8 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142894.850718:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098444600, rc 0) 00000100:00100000:0.0:1746142894.850735:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962866833664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1590us (1683us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142894.850740:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 12980 00000100:00100000:0.0:1746142894.851253:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.854643:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.865392:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.876506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.876732:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3714 00000100:00100000:0.0:1746142894.876743:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962866834816:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142894.880878:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.881012:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.896031:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.898871:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.899534:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.899563:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.899617:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.931317:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.934576:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.935401:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866836736 00000100:00100000:0.0:1746142894.935405:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866836736 00000100:00100000:0.0:1746142894.935428:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866836608 00000100:00100000:0.0:1746142894.935430:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866836608 00010000:00010000:0.0:1746142894.935438:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cc9b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888ac expref: 35 pid: 1854 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746142894.935454:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5683 00000100:00100000:0.0:1746142894.935458:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962866836608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.935466:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.935481:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cc9b00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888ac expref: 35 pid: 1854 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746142894.935491:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cc9b00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888ac expref: 35 pid: 1854 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746142894.935506:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cc9b00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888ac expref: 35 pid: 1854 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746142894.935529:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.935531:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.935536:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800987fe200/0x2fa243e067cc9b85 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888eb expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.935543:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800987fe200/0x2fa243e067cc9b85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888eb expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.935549:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.935550:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.935554:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x2fa243e067cc9baf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888f9 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.935560:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x2fa243e067cc9baf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888f9 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.935583:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0e00/0x2fa243e067cc9baf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888f9 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.935593:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132404380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867613056:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142894.935652:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800987fe200/0x2fa243e067cc9b85 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888eb expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.935669:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132405880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867613184:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142894.935687:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.935704:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 715 00000100:00100000:0.0:1746142894.935709:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2003:x1830962866836736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.935716:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142894.935726:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1800/0x2fa243e067cc9ba1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888f2 expref: 35 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.936249:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142894.936253:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.936307:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962866836736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 595us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.936313:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 715 00000100:00100000:0.0:1746142894.936954:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.939924:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132404380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867613056:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142894.939934:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132405880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867613184:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142894.939947:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142894.939975:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962866836608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4515us (4748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142894.939983:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5683 00000100:00100000:0.0:1746142894.949756:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.950514:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.956057:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.963777:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.964376:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.968085:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.968862:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.969018:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.972620:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.982462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.982516:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866839168 00000100:00100000:0.0:1746142894.982526:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866839168 00010000:00010000:0.0:1746142894.982560:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1a00/0x2fa243e067cc9bb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88900 expref: 36 pid: 9578 timeout: 768 lvb_type: 0 00000100:00100000:0.0:1746142894.982592:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5687 00000100:00100000:0.0:1746142894.982601:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962866839168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142894.982614:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746142894.982632:0:7218:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142893 -> 1746142895 00002000:00010000:0.0:1746142894.982636:0:7218:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142893 -> 1746142895 00010000:00010000:0.0:1746142894.982642:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1a00/0x2fa243e067cc9bb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->3821567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88900 expref: 36 pid: 9578 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746142894.982652:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1a00/0x2fa243e067cc9bb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->3821567) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88900 expref: 36 pid: 9578 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746142894.982687:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1a00/0x2fa243e067cc9bb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3751936->3821567) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88900 expref: 36 pid: 9578 timeout: 768 lvb_type: 0 00010000:00010000:0.0:1746142894.982728:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.982731:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142894.982739:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.982748:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142894.982782:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142894.982795:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867614080:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142894.982876:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142894.999514:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142894.999823:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.012012:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.027582:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.028744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.031630:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142895.033261:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142895.037682:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.037736:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866840576 00000100:00100000:0.0:1746142895.037740:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866840576 00010000:00010000:0.0:1746142895.037754:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 11 pid: 9578 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.037770:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5689 00000100:00100000:0.0:1746142895.037775:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866840576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.037782:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.037795:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 11 pid: 9578 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.037803:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 11 pid: 9578 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.037817:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cc9bbd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88907 expref: 11 pid: 9578 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.037828:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.037829:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.037835:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1800/0x2fa243e067cc9bd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8891c expref: 10 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.037841:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1800/0x2fa243e067cc9bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8891c expref: 10 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.037868:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1800/0x2fa243e067cc9bd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8891c expref: 10 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142895.037878:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867614464:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142895.037940:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142895.042728:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142895.043404:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142895.045193:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142895.047197:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142895.056334:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.059090:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.060820:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.065218:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.065248:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.065269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.065281:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.065292:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142895.065336:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746142895.068038:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142895.069462:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.069485:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.069497:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866842752 00000100:00100000:0.0:1746142895.069499:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866842752 00010000:00010000:0.0:1746142895.069519:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067cc9955 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b7 expref: 10 pid: 1397 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746142895.069541:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5691 00000100:00100000:0.0:1746142895.069547:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866842752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.069557:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.069574:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067cc9955 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b7 expref: 10 pid: 1397 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746142895.069581:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067cc9955 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b7 expref: 10 pid: 1397 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746142895.069599:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067cc9955 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887b7 expref: 10 pid: 1397 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746142895.069611:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142895.069624:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866842752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.069629:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5691 00000100:00100000:0.0:1746142895.069640:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5692 00000100:00100000:0.0:1746142895.069644:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962866842624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.069649:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.069668:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067cc99da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887e8 expref: 31 pid: 9579 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746142895.069676:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067cc99da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887e8 expref: 31 pid: 9579 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746142895.069687:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067cc99da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb887e8 expref: 31 pid: 9579 timeout: 769 lvb_type: 1 00010000:00010000:0.0:1746142895.069698:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142895.069711:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962866842624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.069716:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5692 00000100:00100000:0.0:1746142895.074019:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962866841728:12345-192.168.204.50@tcp:4:cat.0 Request processed in 14728us (14924us total) trans 17179873714 rc 0/0 00000100:00100000:0.0:1746142895.074027:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1176 00002000:00100000:0.0:1746142895.074035:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2154496->3145727) req@ffff880091de2a00 x1830962866841728/t17179873714(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/448 e 0 to 0 dl 1746142906 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.074043:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2a00 with x1830962866841728 ext(2154496->3145727) 00010000:00010000:0.0:1746142895.074050:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1800/0x2fa243e067cc9bd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8891c expref: 12 pid: 1852 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.074061:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1800/0x2fa243e067cc9bd2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2154496->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8891c expref: 12 pid: 1852 timeout: 769 lvb_type: 0 00002000:00010000:0.0:1746142895.074067:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091de2a00 00000100:00100000:0.0:1746142895.075932:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.075969:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.077970:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.079100:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.079311:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.083448:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.084568:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866844416 00000100:00100000:0.0:1746142895.084572:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866844416 00002000:00100000:0.0:1746142895.084594:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880135d71f80 x1830962866844416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:46/0 lens 488/0 e 0 to 0 dl 1746142906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.084602:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d71f80 with x1830962866844416 ext(2097152->3145727) 00002000:00010000:0.0:1746142895.084605:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d71f80 00000100:00100000:0.0:1746142895.084631:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3725 00000100:00100000:0.0:1746142895.084636:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962866844416:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142895.089578:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142895.090369:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc9c49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.090377:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc9c49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142895.090418:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142895.090422:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142895.090433:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc9c49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.090457:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067cc9c42 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88969 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.090470:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3aa00/0x2fa243e067cc9c49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88969 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.090475:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142895.090477:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142895.090479:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3aa00, rc 0) 00000100:00100000:0.0:1746142895.090510:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:31708:x1830962866844160:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6416us (7069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.090516:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14153 00000100:00100000:0.0:1746142895.092024:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.092250:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.094063:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.096425:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.098592:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962866845056:12345-192.168.204.50@tcp:4:cat.0 Request processed in 1713us (2146us total) trans 21474840982 rc 0/0 00000100:00100000:0.0:1746142895.098598:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1177 00002000:00100000:0.0:1746142895.098605:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3194879) req@ffff880094cd5f80 x1830962866845056/t21474840982(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/448 e 0 to 0 dl 1746142906 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.098611:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094cd5f80 with x1830962866845056 ext(3145728->3194879) 00010000:00010000:0.0:1746142895.098618:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88938 expref: 18 pid: 9578 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.098628:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3b400/0x2fa243e067cc9c03 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88938 expref: 18 pid: 9578 timeout: 769 lvb_type: 0 00002000:00010000:0.0:1746142895.098633:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094cd5f80 00000100:00100000:0.0:1746142895.099833:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.099925:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.100203:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.100217:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.100433:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.100448:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.100470:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.105824:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.109493:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.113132:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866847872 00000100:00100000:0.0:1746142895.113135:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866847872 00010000:00010000:0.0:1746142895.113147:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3ac00/0x2fa243e067cc9c57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88977 expref: 12 pid: 1397 timeout: 769 lvb_type: 1 00000100:00100000:0.0:1746142895.113471:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866848000 00000100:00100000:0.0:1746142895.113474:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866848000 00010000:00010000:0.0:1746142895.113483:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471e800/0x2fa243e067cc9be0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8892a expref: 34 pid: 9578 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.114925:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866848256 00000100:00100000:0.0:1746142895.114928:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866848256 00002000:00100000:0.0:1746142895.114951:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880094cd4a80 x1830962866848256/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:46/0 lens 488/0 e 0 to 0 dl 1746142906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.114960:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094cd4a80 with x1830962866848256 ext(3145728->4194303) 00010000:00010000:0.0:1746142895.114965:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7600/0x2fa243e067cc9c5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8897e expref: 29 pid: 12211 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.114975:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800982c7600/0x2fa243e067cc9c5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8897e expref: 29 pid: 12211 timeout: 769 lvb_type: 0 00002000:00010000:0.0:1746142895.114980:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094cd4a80 00000100:00100000:0.0:1746142895.114999:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1178 00000100:00100000:0.0:1746142895.115005:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962866848256:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142895.125332:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.127541:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.128459:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.132624:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.135345:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.135364:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.135450:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866849408 00000100:00100000:0.0:1746142895.135453:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866849408 00010000:00010000:0.0:1746142895.135464:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067cc9a82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8884a expref: 16 pid: 7231 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.135544:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5714 00000100:00100000:0.0:1746142895.135548:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962866849408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.135554:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.135557:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067cc9a82 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8884a expref: 16 pid: 7231 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.135565:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067cc9a82 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8884a expref: 16 pid: 7231 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.135580:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067cc9a82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8884a expref: 16 pid: 7231 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.135592:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142895.135596:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067cc9cab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.135602:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142895.135620:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962866849408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.135626:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5714 00000100:00100000:0.0:1746142895.135651:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.135676:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866849536 00000100:00100000:0.0:1746142895.135679:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866849536 00010000:00010000:0.0:1746142895.135694:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d3400/0x2fa243e067cc9b69 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888d6 expref: 35 pid: 22383 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.135707:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5715 00000100:00100000:0.0:1746142895.135711:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962866849536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.135717:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.135721:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d3400/0x2fa243e067cc9b69 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888d6 expref: 35 pid: 22383 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.135781:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d3400/0x2fa243e067cc9b69 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888d6 expref: 35 pid: 22383 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.135791:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d3400/0x2fa243e067cc9b69 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb888d6 expref: 35 pid: 22383 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.135799:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142895.135802:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067cc9cab lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.135807:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142895.135822:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962866849536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.135827:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5715 00000100:00080000:0.0:1746142895.135840:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142895.135875:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.137878:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.139495:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867618816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.139542:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.139554:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867619328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.139571:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619072 00000100:00100000:0.0:1746142895.139574:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619072 00000100:00100000:0.0:1746142895.139599:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618816 00000100:00100000:0.0:1746142895.139601:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618816 00000100:00100000:0.0:1746142895.139612:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619584 00000100:00100000:0.0:1746142895.139614:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619584 00000100:00100000:0.0:1746142895.139622:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620096 00000100:00100000:0.0:1746142895.139623:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620096 00000100:00100000:0.0:1746142895.139631:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620608 00000100:00100000:0.0:1746142895.139633:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620608 00000100:00100000:0.0:1746142895.139641:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13010 00000100:00100000:0.0:1746142895.139646:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3763:x1830962867619072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142895.139752:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3763:x1830962867619072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (224us total) trans 21474840983 rc 0/0 00000100:00100000:0.0:1746142895.139757:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13010 00000100:00100000:0.0:1746142895.139767:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13012 00000100:00100000:0.0:1746142895.139770:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3763:x1830962867619584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142895.139807:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142895.139809:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142895.139812:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142895.139813:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142895.139815:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142895.139832:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867619584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (271us total) trans 17179873715 rc 0/0 00000100:00100000:0.0:1746142895.139839:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13012 00000100:00100000:0.0:1746142895.139847:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13014 00000100:00100000:0.0:1746142895.139850:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3763:x1830962867620608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142895.139895:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3763:x1830962867620608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (282us total) trans 21474840984 rc 0/0 00000100:00100000:0.0:1746142895.139927:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13014 00000100:00100000:0.0:1746142895.139935:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13016 00000100:00100000:0.0:1746142895.139939:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3763:x1830962867619456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142895.139981:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3763:x1830962867619456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (310us total) trans 21474840985 rc 0/0 00000100:00100000:0.0:1746142895.139986:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13016 00000100:00100000:0.0:1746142895.139993:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13018 00000100:00100000:0.0:1746142895.139996:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3763:x1830962867620480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142895.140421:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142895.140423:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142895.140425:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142895.140427:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142895.140428:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142895.140446:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3763:x1830962867620480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 449us (743us total) trans 21474840987 rc 0/0 00000100:00100000:0.0:1746142895.140451:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13018 00000100:00100000:0.0:1746142895.141183:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619200 00000100:00100000:0.0:1746142895.141186:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619200 00000100:00080000:0.0:1746142895.142241:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746142895.142245:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142895.142258:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.142275:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867619840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.142292:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142895.142323:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098191180/2, rc 0, transno 17179873716 00000100:00100000:0.0:1746142895.142326:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867618816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.142329:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746142895.142333:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867620864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.142346:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.142361:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619840 00000100:00100000:0.0:1746142895.142364:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619840 00000100:00100000:0.0:1746142895.142378:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13024 00000100:00100000:0.0:1746142895.142382:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3765:x1830962867619328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142895.142424:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746142895.142427:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142895.142428:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142895.142430:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142895.142431:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:0.0:1746142895.142462:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3765:x1830962867619328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (204us total) trans 17179873721 rc 0/0 00000100:00100000:0.0:1746142895.142468:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13024 00000004:00080000:0.0:1746142895.142490:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938d1c00/2, rc 0, transno 17179873721 00000100:00100000:0.0:1746142895.142492:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867619328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142895.142497:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938d2d80/2, rc 0, transno 17179873722 00000100:00100000:0.0:1746142895.142500:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867619840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142895.142530:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938d2300/2, rc 0, transno 17179873723 00000100:00100000:0.0:1746142895.142532:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867620864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.143939:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.145077:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.147122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.147607:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.149249:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.149335:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.149362:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.150349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.150805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.150824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.150851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.150998:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13037 00000100:00100000:0.0:1746142895.151004:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866851456:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142895.151010:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.151016:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cc9d14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb889ee expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.151075:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.151077:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.151081:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cc9d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb889ee expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142895.151091:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cc9d14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb889ee expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142895.151098:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2be00, rc 0) 00000100:00100000:0.0:1746142895.151114:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866851456:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.151119:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13037 00000100:00100000:0.0:1746142895.153194:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.153221:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.153245:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.153258:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866851712 00000100:00100000:0.0:1746142895.153264:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866851712 00000100:00100000:0.0:1746142895.153298:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866851968 00000100:00100000:0.0:1746142895.153300:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866851968 00000100:00100000:0.0:1746142895.153311:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866852224 00000100:00100000:0.0:1746142895.153313:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866852224 00000100:00100000:0.0:1746142895.154043:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13039 00000100:00100000:0.0:1746142895.154051:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866851968:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.154096:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866851968:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 46us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.154102:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13039 00000100:00100000:0.0:1746142895.154116:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13040 00000100:00100000:0.0:1746142895.154120:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866852224:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.154148:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866852224:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 28us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.154152:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13040 00000100:00100000:0.0:1746142895.154216:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.154227:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866851584 00000100:00100000:0.0:1746142895.154230:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866851584 00000100:00100000:0.0:1746142895.154244:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13041 00000100:00100000:0.0:1746142895.154249:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866851584:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.154283:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866851584:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 34us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.154287:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13041 00000100:00100000:0.0:1746142895.154331:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.154340:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866851840 00000100:00100000:0.0:1746142895.154342:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866851840 00000100:00100000:0.0:1746142895.154353:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13042 00000100:00100000:0.0:1746142895.154357:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866851840:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.154445:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866851840:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 86us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.154450:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13042 00000100:00100000:0.0:1746142895.154488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.154498:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866852096 00000100:00100000:0.0:1746142895.154501:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866852096 00000100:00100000:0.0:1746142895.154514:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13043 00000100:00100000:0.0:1746142895.154518:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866852096:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.154546:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866852096:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 27us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.154551:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13043 00000100:00100000:0.0:1746142895.154634:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.165290:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.165321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.165337:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.165354:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.165505:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13046 00000100:00100000:0.0:1746142895.165512:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962866852864:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.166026:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962866852864:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 513us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.166033:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13046 00000100:00100000:0.0:1746142895.166080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.166095:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.166103:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866853248 00000100:00100000:0.0:1746142895.166106:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866853248 00000100:00100000:0.0:1746142895.166123:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13049 00000100:00100000:0.0:1746142895.166127:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962866853248:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142895.166160:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962866853248:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 32us (64us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.166165:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13049 00000100:00100000:0.0:1746142895.169609:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.172560:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.172603:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.174239:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866854912 00000100:00100000:0.0:1746142895.174243:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866854912 00000100:00100000:0.0:1746142895.174267:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13057 00000100:00100000:0.0:1746142895.174272:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866854912:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142895.174278:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.174285:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067cc9d6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88a26 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.174294:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.174295:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.174300:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067cc9d6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a26 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142895.174313:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067cc9d6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a26 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142895.174319:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600a00, rc 0) 00000100:00100000:0.0:1746142895.174351:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866854912:12345-192.168.204.50@tcp:101:cat.0 Request processed in 78us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.174356:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13057 00000100:00100000:0.0:1746142895.179553:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.179589:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.180786:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.182403:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.186225:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.186263:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.186302:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.188567:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.189243:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.193713:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.193744:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.193769:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.193778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.193821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.195752:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3736 00000100:00100000:0.0:1746142895.195760:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962866857600:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142895.203481:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.223977:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.226215:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.227420:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.227440:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.232064:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867621504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.233374:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.233391:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867622016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.233401:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.233411:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867622528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142895.233418:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.233422:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867623040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142895.233430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.233433:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867623552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.233441:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142895.233455:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13069 00000100:00100000:0.0:1746142895.233459:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3765:x1830962867621504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142895.233500:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142895.233503:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.233505:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142893 -> 1746142893 00002000:00010000:0.0:1746142895.233507:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.233508:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142895.233531:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3765:x1830962867621504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (156us total) trans 17179873731 rc 0/0 00000100:00100000:0.0:1746142895.233536:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13069 00000100:00100000:0.0:1746142895.233548:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13072 00000100:00100000:0.0:1746142895.233553:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3765:x1830962867623040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142895.233605:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3765:x1830962867623040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (173us total) trans 21474840998 rc 0/0 00000100:00100000:0.0:1746142895.233610:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13072 00000004:00080000:0.0:1746142895.233633:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d60a80/2, rc 0, transno 21474840997 00000100:00100000:0.0:1746142895.233637:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867622528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142895.233644:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d63b80/2, rc 0, transno 21474840998 00000100:00100000:0.0:1746142895.233646:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867623040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142895.233666:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d5f80/2, rc 0, transno 17179873733 00000100:00100000:0.0:1746142895.233668:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867623552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142895.233676:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092430700/2, rc 0, transno 17179873731 00000100:00100000:0.0:1746142895.233678:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867621504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142895.233684:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d71880/2, rc 0, transno 17179873732 00000100:00100000:0.0:1746142895.233687:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867622016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142895.233726:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.240204:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.240282:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245217:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245263:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245278:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245303:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245319:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866860160 00000100:00100000:0.0:1746142895.245323:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866860160 00000100:00100000:0.0:1746142895.245344:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866860416 00000100:00100000:0.0:1746142895.245346:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866860416 00000100:00100000:0.0:1746142895.245357:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866860032 00000100:00100000:0.0:1746142895.245358:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866860032 00000100:00100000:0.0:1746142895.245370:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13076 00000100:00100000:0.0:1746142895.245376:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962866860160:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142895.245478:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142895.245481:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.245483:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142891 -> 1746142895 00002000:00010000:0.0:1746142895.245484:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.245486:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746142895.245504:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962866860160:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 128us (263us total) trans 17179873734 rc 0/0 00000100:00100000:0.0:1746142895.245511:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13076 00000100:00100000:0.0:1746142895.245522:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13078 00000100:00100000:0.0:1746142895.245526:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962866860032:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142895.245561:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142895.245563:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.245565:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142893 -> 1746142895 00002000:00010000:0.0:1746142895.245567:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.245569:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142895.245583:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b75a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962866860032:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 57us (279us total) trans 17179873735 rc 0/0 00000100:00100000:0.0:1746142895.245588:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13078 00000100:00100000:0.0:1746142895.245614:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.245667:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.246777:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866860544 00000100:00100000:0.0:1746142895.246783:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866860544 00000100:00100000:0.0:1746142895.246805:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13080 00000100:00100000:0.0:1746142895.246810:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866859904:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:0.0:1746142895.246851:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13081 00000100:00100000:0.0:1746142895.246855:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962866860544:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142895.246893:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142895.246895:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.246911:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142893 -> 1746142895 00002000:00010000:0.0:1746142895.246913:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.246915:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142895.246933:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b759c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962866860544:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 77us (1265us total) trans 17179873736 rc 0/0 00000100:00100000:0.0:1746142895.246939:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13081 00002000:00010000:0.0:1746142895.246964:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142895.246966:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.246968:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142893 -> 1746142895 00002000:00010000:0.0:1746142895.246970:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142895 -> 1746142895 00002000:00010000:0.0:1746142895.246971:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142895.246984:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b758a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962866859904:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 175us (1769us total) trans 21474841002 rc 0/0 00000100:00100000:0.0:1746142895.246989:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13080 00000100:00100000:0.0:1746142895.247050:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.247088:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.254599:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866861184 00000100:00100000:0.0:1746142895.254605:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866861184 00000100:00100000:0.0:1746142895.254630:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5082 00000100:00100000:0.0:1746142895.254635:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:31708:x1830962866861184:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1746142895.254945:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:31708:x1830962866861184:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 308us (890us total) trans 8589936238 rc 0/0 00000100:00100000:0.0:1746142895.254951:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5082 00000100:00100000:0.0:1746142895.262114:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.271749:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962866861952:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17352us (17572us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142895.271761:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3741 00002000:00100000:0.0:1746142895.271770:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880094cd4e00 x1830962866861952/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/440 e 0 to 0 dl 1746142906 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.271779:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094cd4e00 with x1830962866861952 ext(1048576->2097151) 00002000:00010000:0.0:1746142895.271785:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094cd4e00 00000100:00100000:0.0:1746142895.273871:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.273913:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.273967:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.275880:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.277254:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.285753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.287703:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.290984:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.293158:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.298516:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.298567:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.301300:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.302821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.306128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.306164:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.311549:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.311597:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.322928:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.325233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.334326:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.340184:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.354009:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.364170:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.384167:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.396059:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.396099:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.428043:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.444544:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.506861:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.511007:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.542477:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.554030:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.554235:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.556803:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.569316:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.570452:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.573545:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.583854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.587559:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.587589:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.599774:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.604861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.607735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.609849:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.616195:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.616491:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.616534:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.620916:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.625674:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.627202:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.631242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.631269:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.633964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.634561:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.634623:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.645342:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962866874752:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 10296us (10713us total) trans 0 rc 577536/577536 00000100:00100000:0.0:1746142895.645353:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3765 00002000:00100000:0.0:1746142895.645362:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1626111) req@ffff88013644d880 x1830962866874752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/440 e 0 to 0 dl 1746142906 ref 1 fl Complete:/200/0 rc 577536/577536 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.645372:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d880 with x1830962866874752 ext(1048576->1626111) 00002000:00010000:0.0:1746142895.645377:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644d880 00000100:00100000:0.0:1746142895.645393:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866875008 00000100:00100000:0.0:1746142895.645398:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866875008 00002000:00100000:0.0:1746142895.645420:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1282048->1286143) req@ffff880130376a00 x1830962866875008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/0 e 0 to 0 dl 1746142906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.645427:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376a00 with x1830962866875008 ext(1282048->1286143) 00002000:00010000:0.0:1746142895.645429:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130376a00 00000100:00100000:0.0:1746142895.645445:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3766 00000100:00100000:0.0:1746142895.645451:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962866875008:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142895.645540:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962866875008:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 88us (1990us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142895.645545:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3766 00002000:00100000:0.0:1746142895.645549:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (1282048->1286143) req@ffff880130376a00 x1830962866875008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/4536 e 0 to 0 dl 1746142906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.645556:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376a00 with x1830962866875008 ext(1282048->1286143) 00002000:00010000:0.0:1746142895.645559:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130376a00 00000100:00100000:0.0:1746142895.648433:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.655666:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.671005:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.718575:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.722955:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.722988:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.723135:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.723176:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.723196:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866876288 00000100:00100000:0.0:1746142895.723203:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866876288 00000100:00100000:0.0:1746142895.723230:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866876416 00000100:00100000:0.0:1746142895.723233:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866876416 00000100:00100000:0.0:1746142895.723241:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866876544 00000100:00100000:0.0:1746142895.723243:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866876544 00000100:00100000:0.0:1746142895.723255:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13094 00000100:00100000:0.0:1746142895.723260:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962866876288:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142895.723274:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.723287:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea53800/0x2fa243e067cc9f36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88ad5 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.723306:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.723307:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.723315:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea53800/0x2fa243e067cc9f36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ad5 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142895.723329:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea53800/0x2fa243e067cc9f36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ad5 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142895.723338:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea53800, rc 0) 00000100:00100000:0.0:1746142895.723370:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962866876288:12345-192.168.204.50@tcp:101:cat.0 Request processed in 109us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.723375:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13094 00000100:00100000:0.0:1746142895.723387:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13095 00000100:00100000:0.0:1746142895.723392:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962866876416:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142895.723398:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.723403:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea53600/0x2fa243e067cc9f3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88adc expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142895.723435:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867627520:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142895.723478:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142895.723493:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13096 00000100:00100000:0.0:1746142895.723497:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962866876544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142895.723503:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.723509:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52000/0x2fa243e067cc9f44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88ae3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142895.723528:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867627648:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142895.723541:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142895.732659:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.743375:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.746740:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.747055:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1182 00000100:00100000:0.0:1746142895.747063:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866877056:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142895.753656:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.757295:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.769453:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.777838:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.784693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.796420:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.806937:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866878336 00000100:00100000:0.0:1746142895.807153:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866878336 00000100:00100000:0.0:1746142895.807188:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14173 00000100:00100000:0.0:1746142895.807194:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:31747:x1830962866878336:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142895.807210:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.807223:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cc9f59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88af8 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.807293:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807304:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807312:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807322:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807327:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807331:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807560:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067cc9f6e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807569:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067cc9f6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807575:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067cc9f6e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142895.807582:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142895.807670:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807676:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807680:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807684:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807689:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cde00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142895.807692:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807697:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807706:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142895.807708:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142895.807711:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807715:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067cc9f60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807742:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807747:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807751:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807755:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cc800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142895.807757:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807761:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807767:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091eb9200) 00010000:00010000:0.0:1746142895.807769:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142895.807771:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807779:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cc9f67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142895.807809:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cc9f59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88af8 expref: 39 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.807969:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067cc9f6e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88af8 expref: 38 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.807977:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142895.807979:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142895.807981:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc200, rc 0) 00000100:00100000:0.0:1746142895.808015:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:31747:x1830962866878336:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 821us (1125us total) trans 8589936253 rc 0/0 00000100:00100000:0.0:1746142895.808021:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14173 00000100:00100000:0.0:1746142895.810988:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.811972:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.814868:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.820197:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.821217:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.823615:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.823685:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.825524:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.827875:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.829453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.833660:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866880256 00000100:00100000:0.0:1746142895.833668:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866880256 00000100:00100000:0.0:1746142895.833711:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5092 00000100:00100000:0.0:1746142895.833718:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:31745:x1830962866880256:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142895.833880:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:31745:x1830962866880256:12345-192.168.204.50@tcp:35:cat.0 Request processed in 161us (391us total) trans 8589936255 rc 0/0 00000100:00100000:0.0:1746142895.833885:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5092 00000100:00100000:0.0:1746142895.838145:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866880384 00000100:00100000:0.0:1746142895.838153:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866880384 00000100:00100000:0.0:1746142895.838198:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13102 00000100:00100000:0.0:1746142895.838205:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:31747:x1830962866880384:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142895.838218:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.838232:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cc9f91 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88b14 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.838257:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cc9e56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a73 expref: 12 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.838265:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974cc000/0x2fa243e067cc9e6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a88 expref: 41 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.838270:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.838272:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.838274:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cc9f91 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b14 expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.838296:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974cc000/0x2fa243e067cc9e6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a88 expref: 41 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.838310:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974cc000/0x2fa243e067cc9e6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a88 expref: 41 pid: 12211 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.838319:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867628800:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142895.839675:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cc9e56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a73 expref: 12 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.839686:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cc9e56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a73 expref: 12 pid: 9578 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.839696:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867628928:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142895.839776:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142895.844716:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867628800:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142895.844726:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a5b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867628928:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142895.844754:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cc9f91 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2117631] (req 2097152->2117631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b14 expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.845885:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cd600, rc 0) 00000100:00100000:0.0:1746142895.847875:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.850793:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.870081:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.895462:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.898369:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.898429:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.905507:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.908539:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.908581:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.912242:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.919536:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.928810:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.936404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.945796:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.963249:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.970199:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962866884352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15130us (15479us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142895.970208:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3778 00002000:00100000:0.0:1746142895.970216:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880130374e00 x1830962866884352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:46/0 lens 488/440 e 0 to 0 dl 1746142906 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142895.970224:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374e00 with x1830962866884352 ext(2097152->3145727) 00002000:00010000:0.0:1746142895.970228:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130374e00 00000100:00100000:0.0:1746142895.971785:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.971818:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.971848:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.974426:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867629952:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142895.974438:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142895.976082:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.976234:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.977948:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.978823:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866886016 00000100:00100000:0.0:1746142895.978827:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866886016 00010000:00010000:0.0:1746142895.978841:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0800/0x2fa243e067cc9e79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a8f expref: 42 pid: 22383 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.978867:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5748 00000100:00100000:0.0:1746142895.978872:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962866886016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.978880:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.978884:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0800/0x2fa243e067cc9e79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a8f expref: 42 pid: 22383 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.978891:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0800/0x2fa243e067cc9e79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a8f expref: 42 pid: 22383 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.978921:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0800/0x2fa243e067cc9e79 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a8f expref: 42 pid: 22383 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.978934:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142895.978937:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.978944:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.978950:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.978965:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142895.978976:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.978986:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142895.979015:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142895.979019:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142895.979030:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979038:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979047:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979052:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979056:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979382:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979387:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009712ae00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142895.979390:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979394:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979401:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142895.979404:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142895.979406:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979410:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ae00/0x2fa243e067cca05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979419:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979424:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979427:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979430:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009712ac00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142895.979432:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979435:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979439:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3300) 00010000:00010000:0.0:1746142895.979441:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142895.979443:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979446:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067cca063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.979469:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712be00/0x2fa243e067cca055 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b61 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.979478:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b61 expref: 12 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.979486:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142895.979488:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142895.979489:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712a600, rc 0) 00000100:00100000:0.0:1746142895.980199:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:31761:x1830962866884992:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7908us (8347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.980205:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14178 00000100:00100000:0.0:1746142895.980240:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962866886016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1368us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.980246:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5748 00000100:00100000:0.0:1746142895.985307:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.985327:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.986602:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.986635:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.987018:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.987317:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.987343:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.987629:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.987656:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866887040 00000100:00100000:0.0:1746142895.987658:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866887040 00010000:00010000:0.0:1746142895.987671:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cc9f91 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b14 expref: 42 pid: 1854 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.987687:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5749 00000100:00100000:0.0:1746142895.987691:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962866887040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142895.987698:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142895.987713:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cc9f91 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b14 expref: 42 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.987722:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cc9f91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2117631) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b14 expref: 42 pid: 1854 timeout: 769 lvb_type: 0 00010000:00010000:0.0:1746142895.987734:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.987735:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142895.987739:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1a00/0x2fa243e067cca071 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b6f expref: 13 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.987746:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1a00/0x2fa243e067cca071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b6f expref: 13 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.987761:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d1a00/0x2fa243e067cca071 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b6f expref: 13 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142895.987768:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867630464:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142895.987784:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142895.993813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.993850:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.994039:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867630464:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142895.994052:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142895.994081:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962866887040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6389us (6452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142895.994087:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5749 00000100:00100000:0.0:1746142895.994848:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142895.994865:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866887808 00000100:00100000:0.0:1746142895.994869:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866887808 00000100:00100000:0.0:1746142895.994919:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14179 00000100:00100000:0.0:1746142895.994925:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:31761:x1830962866887808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142895.994935:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142895.994948:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e000/0x2fa243e067cca0a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88ba7 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.995074:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ee00/0x2fa243e067cca0b0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.995087:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b61 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.995094:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ee00/0x2fa243e067cca0b0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142895.995116:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b61 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142895.995126:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712a600/0x2fa243e067cca06a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b61 expref: 13 pid: 7230 timeout: 769 lvb_type: 0 00000100:00100000:0.0:1746142895.995136:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de12300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867630592:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142895.995186:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.001133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142896.001343:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142896.006514:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.008610:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.010782:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866888320 00000100:00100000:0.0:1746142896.010786:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866888320 00000100:00100000:0.0:1746142896.010814:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13119 00000100:00100000:0.0:1746142896.010820:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:31758:x1830962866888320:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142896.010828:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142896.010837:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2e800/0x2fa243e067cca0d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88bbc expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.010851:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.010852:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.010858:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2e800/0x2fa243e067cca0d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bbc expref: 42 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.010871:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2e800/0x2fa243e067cca0d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bbc expref: 42 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.010879:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2e800, rc 0) 00000100:00100000:0.0:1746142896.010932:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:31758:x1830962866888320:12345-192.168.204.50@tcp:101:cat.0 Request processed in 111us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142896.010939:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13119 00000100:00100000:0.0:1746142896.012456:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.012493:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.026219:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.028577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.033662:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.037651:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.039524:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.039563:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.052000:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.052037:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.077930:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.093491:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.093544:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.101606:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.101708:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.102856:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.104455:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.110800:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.113280:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.118093:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.118110:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.118354:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.118741:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5758 00000100:00100000:0.0:1746142896.118747:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962866893312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142896.118753:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142896.118973:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968f1200/0x2fa243e067cc9f52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88af1 expref: 35 pid: 11943 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.118981:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968f1200/0x2fa243e067cc9f52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88af1 expref: 35 pid: 11943 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.118991:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1200/0x2fa243e067cc9f52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88af1 expref: 35 pid: 11943 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.119010:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.119012:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.119017:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067cca10b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bed expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.119023:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067cca10b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bed expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.119046:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067cca10b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1470463) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bed expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142896.119056:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867632256:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142896.119097:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.124648:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.127518:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.140207:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.254218:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.261076:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.270827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.270862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.270924:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.273538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.300812:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.300845:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.300869:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.300927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.300943:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866895360 00000100:00100000:0.0:1746142896.300946:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866895360 00010000:00010000:0.0:1746142896.300960:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7600/0x2fa243e067cca07f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88b76 expref: 12 pid: 9580 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746142896.300978:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5764 00000100:00100000:0.0:1746142896.300983:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962866895488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142896.300990:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142896.300997:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130ab4600/0x2fa243e067cc9e5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a7a expref: 33 pid: 12211 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.301595:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130ab4600/0x2fa243e067cc9e5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a7a expref: 33 pid: 12211 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.301618:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130ab4600/0x2fa243e067cc9e5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88a7a expref: 33 pid: 12211 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.301651:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.301653:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.301656:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebe000/0x2fa243e067cca15f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c09 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.301662:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebe000/0x2fa243e067cca15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c09 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.301680:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091ebe000/0x2fa243e067cca15f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c09 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142896.301688:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867633408:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142896.301709:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.303799:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.304953:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.309757:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.318280:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.318789:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.322853:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.325173:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.332824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.333881:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.337114:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.338229:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.339230:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.341249:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.342008:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.342719:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.346086:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.347689:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.348449:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.349238:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1746142896.353614:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746142895 -> 1746142896 00002000:00010000:0.0:1746142896.353621:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746142895 -> 1746142896 00002000:00010000:0.0:1746142896.353623:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746142895 -> 1746142896 00000100:00100000:0.0:1746142896.353651:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a5b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867634560:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142896.353680:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927d6c00/0x2fa243e067cca189 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c25 expref: 25 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.353692:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d6c00/0x2fa243e067cca189 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c25 expref: 25 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.353719:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6c00, rc 0) 00000100:00100000:0.0:1746142896.353755:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962866898432:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6916us (7674us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142896.353763:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13130 00000100:00100000:0.0:1746142896.358011:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.362859:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.362897:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.364358:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.366786:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867635200:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142896.366810:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d2000/0x2fa243e067cca1c1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c4f expref: 35 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.366821:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d2000/0x2fa243e067cca1c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c4f expref: 35 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.367132:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2000, rc 0) 00000100:00100000:0.0:1746142896.367446:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962866899328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4446us (4594us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142896.367452:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13135 00000100:00100000:0.0:1746142896.372557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.376716:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.382332:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.388404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.388441:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.388471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.388483:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.388612:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962866900096:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5983us (6286us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142896.388621:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3794 00002000:00100000:0.0:1746142896.388639:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009ceb0380 x1830962866900096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:47/0 lens 488/440 e 0 to 0 dl 1746142907 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.388648:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0380 with x1830962866900096 ext(0->1048575) 00002000:00010000:0.0:1746142896.388652:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb0380 00000100:00100000:0.0:1746142896.388676:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866900608 00000100:00100000:0.0:1746142896.388682:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866900608 00002000:00100000:0.0:1746142896.388709:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1798143) req@ffff88009ceb1c00 x1830962866900608/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.388714:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1c00 with x1830962866900608 ext(1048576->1798143) 00002000:00010000:0.0:1746142896.388717:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1c00 00000100:00100000:0.0:1746142896.388728:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866900864 00000100:00100000:0.0:1746142896.388730:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866900864 00002000:00100000:0.0:1746142896.388738:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009ceb3800 x1830962866900864/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.388744:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb3800 with x1830962866900864 ext(0->1048575) 00002000:00010000:0.0:1746142896.388746:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb3800 00000100:00100000:0.0:1746142896.388753:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866900992 00000100:00100000:0.0:1746142896.388755:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866900992 00002000:00100000:0.0:1746142896.388763:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1470464->2097151) req@ffff88009ceb1f80 x1830962866900992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.388769:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1f80 with x1830962866900992 ext(1470464->2097151) 00002000:00010000:0.0:1746142896.388771:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb1f80 00000100:00100000:0.0:1746142896.388779:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866900480 00000100:00100000:0.0:1746142896.388781:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866900480 00002000:00100000:0.0:1746142896.388789:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1089536->2097151) req@ffff88009ceb1880 x1830962866900480/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.388795:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1880 with x1830962866900480 ext(1089536->2097151) 00002000:00010000:0.0:1746142896.388798:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1880 00000100:00100000:0.0:1746142896.388806:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3795 00000100:00100000:0.0:1746142896.388812:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962866900608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.402863:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.412596:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.419205:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.419284:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.422533:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.427230:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.441944:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.446754:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.450225:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866902656 00000100:00100000:0.0:1746142896.450227:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866902656 00000100:00100000:0.0:1746142896.450253:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13142 00000100:00100000:0.0:1746142896.450258:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962866902784:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142896.450262:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142896.450282:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4200/0x2fa243e067cca1f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88c87 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142896.450304:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867636352:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142896.450383:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.456863:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.457246:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.462891:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.462970:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.463693:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3801 00000100:00100000:0.0:1746142896.463701:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962866903424:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.474556:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.480281:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.486721:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.511493:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.512609:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.526204:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.534329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.534372:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.536511:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.537369:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.547500:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962866905600:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9679us (10123us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142896.547510:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3805 00002000:00100000:0.0:1746142896.547519:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a35b100 x1830962866905600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/440 e 0 to 0 dl 1746142907 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.547528:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35b100 with x1830962866905600 ext(3145728->4194303) 00002000:00010000:0.0:1746142896.547533:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35b100 00000100:00100000:0.0:1746142896.557093:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.557131:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.572483:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.582779:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.583488:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866906752 00000100:00100000:0.0:1746142896.583491:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866906752 00010000:00010000:0.0:1746142896.583502:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067cca127 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bf4 expref: 24 pid: 7231 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746142896.583580:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5780 00000100:00100000:0.0:1746142896.583586:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962866906752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142896.583591:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142896.583595:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067cca127 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bf4 expref: 24 pid: 7231 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.583603:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067cca127 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bf4 expref: 24 pid: 7231 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.583613:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067cca127 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88bf4 expref: 24 pid: 7231 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.583624:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142896.583637:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732200/0x2fa243e067cca22a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142896.583643:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732200/0x2fa243e067cca22a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142896.583649:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732200/0x2fa243e067cca22a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142896.583664:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142896.583680:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962866906752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142896.583686:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5780 00000100:00100000:0.0:1746142896.585767:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.591543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.591586:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.597312:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866907520 00000100:00100000:0.0:1746142896.597319:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866907520 00002000:00100000:0.0:1746142896.597355:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880097a58e00 x1830962866907520/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.597364:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a58e00 with x1830962866907520 ext(4194304->5033983) 00002000:00010000:0.0:1746142896.597368:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a58e00 00000100:00100000:0.0:1746142896.597394:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3808 00000100:00100000:0.0:1746142896.597400:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962866907520:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.600303:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866907776 00000100:00100000:0.0:1746142896.600309:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866907776 00002000:00100000:0.0:1746142896.600339:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880097a59c00 x1830962866907776/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.600347:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a59c00 with x1830962866907776 ext(4194304->5033983) 00002000:00010000:0.0:1746142896.600351:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a59c00 00000100:00100000:0.0:1746142896.600375:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3809 00000100:00100000:0.0:1746142896.600381:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962866907776:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.605485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.616290:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.616422:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.620582:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.624812:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.633598:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866908800 00000100:00100000:0.0:1746142896.633606:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866908800 00010000:00010000:0.0:1746142896.633646:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092733000/0x2fa243e067cca21c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ca3 expref: 26 pid: 11943 timeout: 770 lvb_type: 1 00000100:00100000:0.0:1746142896.633677:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866908672 00000100:00100000:0.0:1746142896.633680:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866908672 00010000:00010000:0.0:1746142896.633689:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067cca200 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c8e expref: 38 pid: 9578 timeout: 770 lvb_type: 0 00000100:00100000:0.0:1746142896.633712:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5783 00000100:00100000:0.0:1746142896.633718:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962866908800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142896.633729:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142896.633746:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092733000/0x2fa243e067cca21c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ca3 expref: 26 pid: 11943 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746142896.633755:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092733000/0x2fa243e067cca21c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ca3 expref: 26 pid: 11943 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746142896.633772:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092733000/0x2fa243e067cca21c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ca3 expref: 26 pid: 11943 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746142896.633788:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142896.633820:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962866908800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 102us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142896.633825:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5783 00000100:00100000:0.0:1746142896.633837:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5784 00000100:00100000:0.0:1746142896.633842:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962866908672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142896.633847:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142896.633854:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067cca200 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c8e expref: 38 pid: 9578 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.633862:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067cca200 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c8e expref: 38 pid: 9578 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.633873:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067cca200 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88c8e expref: 38 pid: 9578 timeout: 770 lvb_type: 0 00010000:00010000:0.0:1746142896.633881:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.633883:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.633888:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067cca262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3248127) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cd4 expref: 37 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.633894:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067cca262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3248127) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cd4 expref: 37 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.633932:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067cca262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3248127) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cd4 expref: 37 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142896.633943:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867638528:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142896.633991:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.640672:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.660394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.663812:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.663850:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.665696:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.668303:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.668334:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.668390:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.668835:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13155 00000100:00100000:0.0:1746142896.668840:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962866910080:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142896.668846:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142896.668851:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed5800/0x2fa243e067cca293 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88cf0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.668859:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.668860:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.668865:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed5800/0x2fa243e067cca293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cf0 expref: 17 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.668873:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed5800/0x2fa243e067cca293 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cf0 expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.668879:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed5800, rc 0) 00000100:00100000:0.0:1746142896.668891:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962866910080:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 51us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142896.668896:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13155 00000100:00100000:0.0:1746142896.668942:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866910208 00000100:00100000:0.0:1746142896.668945:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866910208 00000100:00100000:0.0:1746142896.668964:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13156 00000100:00100000:0.0:1746142896.668969:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962866910208:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142896.668977:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142896.668983:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed4c00/0x2fa243e067cca29a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88cf7 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.668992:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.668993:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.668997:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed4c00/0x2fa243e067cca29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cf7 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.669006:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed4c00/0x2fa243e067cca29a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88cf7 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142896.669012:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed4c00, rc 0) 00000100:00100000:0.0:1746142896.669027:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866910208:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 58us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142896.669031:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13156 00000100:00100000:0.0:1746142896.669414:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13158 00000100:00100000:0.0:1746142896.669419:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962866910464:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142896.669425:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142896.669432:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed5000/0x2fa243e067cca2a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88d05 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142896.669452:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867639040:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142896.669473:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.673112:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.679406:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.681766:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.684561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.718657:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.722540:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.733508:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.734981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.739510:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.744189:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.751493:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.751523:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.751548:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.751588:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866912512 00000100:00100000:0.0:1746142896.751595:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866912512 00002000:00100000:0.0:1746142896.751684:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809fb80 x1830962866912512/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.751690:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809fb80 with x1830962866912512 ext(1048576->2097151) 00002000:00010000:0.0:1746142896.751693:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809fb80 00000100:00100000:0.0:1746142896.751710:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3814 00000100:00100000:0.0:1746142896.751714:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962866912512:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.760726:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.765201:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962866912512:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13485us (13715us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142896.765208:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3814 00002000:00100000:0.0:1746142896.765216:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809fb80 x1830962866912512/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/440 e 0 to 0 dl 1746142907 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.765224:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809fb80 with x1830962866912512 ext(1048576->2097151) 00002000:00010000:0.0:1746142896.765227:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809fb80 00000100:00100000:0.0:1746142896.767083:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.768759:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.769070:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.771131:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.774613:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.781018:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.803689:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.823361:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.827498:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.830472:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.830542:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.840996:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.861357:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866915584 00000100:00100000:0.0:1746142896.861365:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866915584 00002000:00100000:0.0:1746142896.861398:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88011e13e300 x1830962866915584/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.861407:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13e300 with x1830962866915584 ext(2097152->4194303) 00002000:00010000:0.0:1746142896.861411:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13e300 00000100:00100000:0.0:1746142896.861433:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866915840 00000100:00100000:0.0:1746142896.861435:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866915840 00002000:00100000:0.0:1746142896.861443:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88011e13dc00 x1830962866915840/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.861449:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13dc00 with x1830962866915840 ext(3145728->4194303) 00002000:00010000:0.0:1746142896.861451:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13dc00 00000100:00100000:0.0:1746142896.861460:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3817 00000100:00100000:0.0:1746142896.861465:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2003:x1830962866915584:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.866008:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.891564:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.900175:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.902608:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.903012:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866917248 00000100:00100000:0.0:1746142896.903016:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866917248 00002000:00100000:0.0:1746142896.903030:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88011e13fb80 x1830962866917248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:47/0 lens 488/0 e 0 to 0 dl 1746142907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142896.903037:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13fb80 with x1830962866917248 ext(3145728->4194303) 00002000:00010000:0.0:1746142896.903040:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13fb80 00000100:00100000:0.0:1746142896.903058:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3822 00000100:00100000:0.0:1746142896.903063:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962866917248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142896.910207:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.925012:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.941018:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.941061:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.952313:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.974087:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.974123:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.976938:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.976964:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.977141:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5795 00000100:00100000:0.0:1746142896.977149:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962866918912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142896.977159:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142896.977167:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2800/0x2fa243e067cca318 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d52 expref: 29 pid: 12211 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746142896.977176:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2800/0x2fa243e067cca318 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d52 expref: 29 pid: 12211 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746142896.977223:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2800/0x2fa243e067cca318 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d52 expref: 28 pid: 12211 timeout: 770 lvb_type: 1 00010000:00010000:0.0:1746142896.977302:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.977304:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142896.977310:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067cca350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d7c expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.977317:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067cca350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d7c expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142896.977339:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067cca350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2232319) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d7c expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142896.977349:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867641856:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142896.977389:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142896.978804:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.979966:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.988132:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.994322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142896.998770:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867642112:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142896.998789:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142896.999113:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962866919808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4460us (4798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142896.999121:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5797 00000100:00100000:0.0:1746142897.003964:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.007259:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.013400:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.013446:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.013476:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866920576 00000100:00100000:0.0:1746142897.013481:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866920576 00010000:00010000:0.0:1746142897.013506:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067cca326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d60 expref: 20 pid: 12211 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.013536:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866920448 00000100:00100000:0.0:1746142897.013539:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866920448 00010000:00010000:0.0:1746142897.013552:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2a00/0x2fa243e067cca311 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d4b expref: 48 pid: 12211 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.013564:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5798 00000100:00100000:0.0:1746142897.013569:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962866920576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.013579:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.013594:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067cca326 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d60 expref: 19 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.013602:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067cca326 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d60 expref: 19 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.014545:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067cca326 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d60 expref: 19 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.014573:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.014574:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.014580:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067cca373 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3055615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d9f expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.014587:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067cca373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3055615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d9f expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.014613:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067cca373 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3055615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d9f expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.014631:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867642624:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142897.025693:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.025740:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.027080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.039481:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.049436:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866921856 00000100:00100000:0.0:1746142897.049444:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866921856 00002000:00100000:0.0:1746142897.049476:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012dc63800 x1830962866921856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:48/0 lens 488/0 e 0 to 0 dl 1746142908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.049485:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63800 with x1830962866921856 ext(2097152->3145727) 00002000:00010000:0.0:1746142897.049490:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc63800 00000100:00100000:0.0:1746142897.049520:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3829 00000100:00100000:0.0:1746142897.049527:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962866921856:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142897.063990:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.069076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.081976:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962866922112:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 11536us (12899us total) trans 17179873746 rc 0/0 00000100:00100000:0.0:1746142897.081987:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1199 00002000:00100000:0.0:1746142897.081996:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2277376->3055615) req@ffff88012b1a0a80 x1830962866922112/t17179873746(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/448 e 0 to 0 dl 1746142908 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.082005:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0a80 with x1830962866922112 ext(2277376->3055615) 00010000:00010000:0.0:1746142897.082014:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067cca373 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d9f expref: 20 pid: 1852 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.082026:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067cca373 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->3055615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d9f expref: 20 pid: 1852 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746142897.082032:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1a0a80 00000100:00100000:0.0:1746142897.085957:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.091252:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867643008:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142897.091271:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142897.091319:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962866922240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5236us (5368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.091328:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5800 00000100:00100000:0.0:1746142897.095787:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.103782:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.123153:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.131858:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.131925:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142897.132724:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142897.133422:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.135643:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.136816:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.152245:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.152278:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.152311:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142897.152433:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746142897.152435:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142897.162490:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.162517:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.162539:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866924672 00000100:00100000:0.0:1746142897.162545:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866924672 00010000:00010000:0.0:1746142897.162573:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1800/0x2fa243e067cca3a4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88dbb expref: 16 pid: 7230 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.162596:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5803 00000100:00100000:0.0:1746142897.162602:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962866924672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.162612:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.162628:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1800/0x2fa243e067cca3a4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88dbb expref: 16 pid: 7230 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.162638:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1800/0x2fa243e067cca3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88dbb expref: 16 pid: 7230 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.162654:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142897.162658:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cca3c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142897.162667:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cca3c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142897.162673:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cca3c7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142897.162685:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142897.162715:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962866924672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 113us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.162721:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5803 00000100:00100000:0.0:1746142897.187610:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.193365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.198566:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.236989:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.246609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.246675:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.259600:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.261035:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.263971:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.268458:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.269729:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.274226:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.274246:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866927232 00000100:00100000:0.0:1746142897.274252:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866927232 00002000:00100000:0.0:1746142897.274282:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1142784->1146879) req@ffff8800979b0e00 x1830962866927232/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/0 e 0 to 0 dl 1746142908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.274291:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0e00 with x1830962866927232 ext(1142784->1146879) 00002000:00010000:0.0:1746142897.274295:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0e00 00000100:00100000:0.0:1746142897.274318:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3833 00000100:00100000:0.0:1746142897.274324:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962866927232:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142897.274414:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962866927232:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 90us (193us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142897.274420:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3833 00002000:00100000:0.0:1746142897.274425:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1142784->1146879) req@ffff8800979b0e00 x1830962866927232/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/4536 e 0 to 0 dl 1746142908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.274431:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0e00 with x1830962866927232 ext(1142784->1146879) 00002000:00010000:0.0:1746142897.274433:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0e00 00000100:00100000:0.0:1746142897.274510:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867644544:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142897.274522:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142897.274538:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962866926976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4094us (4810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.274544:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5807 00000100:00100000:0.0:1746142897.276749:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962866926592:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 12584us (12775us total) trans 21474841013 rc 0/0 00000100:00100000:0.0:1746142897.276757:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1200 00002000:00100000:0.0:1746142897.276763:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1327104->2097151) req@ffff880097349880 x1830962866926592/t21474841013(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:48/0 lens 488/448 e 0 to 0 dl 1746142908 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.276770:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349880 with x1830962866926592 ext(1327104->2097151) 00010000:00010000:0.0:1746142897.276777:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f800/0x2fa243e067cca342 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d6e expref: 43 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.276792:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f800/0x2fa243e067cca342 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88d6e expref: 43 pid: 12211 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746142897.276799:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097349880 00000100:00100000:0.0:1746142897.279113:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.282853:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.284225:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.287019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.302151:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.302192:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.326446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.380046:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.380095:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.389382:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.394320:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.411332:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.425236:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.425286:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.480290:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.483356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.485877:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.488214:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.492420:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.497690:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.549105:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.553759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.553789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.553850:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.553930:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867645696:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142897.553942:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867645824:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142897.557055:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.559835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.560007:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.562388:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.562414:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.568378:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.572576:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.574596:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.577318:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.582340:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.584366:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.584952:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.601956:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962866933504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16361us (16503us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142897.601965:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3844 00002000:00100000:0.0:1746142897.601972:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092407800 x1830962866933504/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/440 e 0 to 0 dl 1746142908 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.601980:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407800 with x1830962866933504 ext(0->1048575) 00002000:00010000:0.0:1746142897.601983:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407800 00000100:00100000:0.0:1746142897.636781:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.637198:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.644983:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.655371:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.677849:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.679786:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.686497:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.696678:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.697730:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.698661:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.698693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.705012:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.710989:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.712968:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962866936576:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7683us (7958us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746142897.712976:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3852 00002000:00100000:0.0:1746142897.712983:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092405f80 x1830962866936576/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/440 e 0 to 0 dl 1746142908 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.712991:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405f80 with x1830962866936576 ext(4194304->5033983) 00002000:00010000:0.0:1746142897.712995:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405f80 00000100:00100000:0.0:1746142897.723634:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.731282:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.731331:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.733310:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866937344 00000100:00100000:0.0:1746142897.733314:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866937344 00000100:00100000:0.0:1746142897.756428:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.759348:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.776404:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866937984 00000100:00100000:0.0:1746142897.776413:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866937984 00010000:00010000:0.0:1746142897.776447:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067cca48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2596863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e55 expref: 8 pid: 1853 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.776615:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5821 00000100:00100000:0.0:1746142897.776625:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2004:x1830962866937984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.776640:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.776659:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067cca48b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2596863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e55 expref: 8 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.776671:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067cca48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2596863) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e55 expref: 8 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.776690:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067cca48b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2596863) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e55 expref: 8 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.777300:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.777304:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.777312:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067cca4d8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea2 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.777320:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067cca4d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea2 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.777355:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067cca4d8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea2 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.777367:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867647872:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142897.778197:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.783384:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867647872:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142897.783401:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142897.783443:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962866937984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6818us (7271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.783454:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5821 00000100:00100000:0.0:1746142897.793662:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.799775:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.799824:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.801190:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5823 00000100:00100000:0.0:1746142897.801195:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2003:x1830962866938496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.801201:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.801208:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067cca44c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e24 expref: 26 pid: 1852 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.801217:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067cca44c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e24 expref: 26 pid: 1852 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.801794:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067cca44c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e24 expref: 26 pid: 1852 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.801816:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.801819:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.801824:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3a00/0x2fa243e067cca4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea9 expref: 6 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.801831:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3a00/0x2fa243e067cca4df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea9 expref: 6 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.808216:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.808253:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.808276:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866939264 00000100:00100000:0.0:1746142897.808279:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866939264 00002000:00100000:0.0:1746142897.808329:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880130123480 x1830962866939264/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:48/0 lens 488/0 e 0 to 0 dl 1746142908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.808334:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123480 with x1830962866939264 ext(3145728->4194303) 00002000:00010000:0.0:1746142897.808337:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130123480 00000100:00100000:0.0:1746142897.808353:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3857 00000100:00100000:0.0:1746142897.808357:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962866939264:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142897.811159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.827295:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.829484:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.845746:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.846400:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.847145:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.847201:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867649408:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142897.847212:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142897.847239:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962866940672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5746us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.847246:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5828 00000100:00100000:0.0:1746142897.847260:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5830 00000100:00100000:0.0:1746142897.847266:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2003:x1830962866941184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.847273:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.847277:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cca45a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e2b expref: 31 pid: 10924 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.847291:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cca45a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e2b expref: 31 pid: 10924 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.847303:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067cca45a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e2b expref: 31 pid: 10924 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.847315:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142897.847318:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37c00/0x2fa243e067cca510 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.847324:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37c00/0x2fa243e067cca510 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.847331:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37c00/0x2fa243e067cca510 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.847344:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142897.847359:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962866941184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.847364:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5830 00002000:00010000:0.0:1746142897.847391:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142896 -> 1746142898 00002000:00010000:0.0:1746142897.847393:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142896 -> 1746142898 00002000:00010000:0.0:1746142897.847395:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142896 -> 1746142898 00000100:00100000:0.0:1746142897.847408:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867649536:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142897.847423:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75200/0x2fa243e067cca517 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ecc expref: 28 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.847432:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75200/0x2fa243e067cca517 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ecc expref: 28 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.847441:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75200, rc 0) 00000100:00100000:0.0:1746142897.847479:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962866940544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5660us (5876us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.847485:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13212 00000100:00100000:0.0:1746142897.852174:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.852225:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.853446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.853486:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.853500:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866942208 00000100:00100000:0.0:1746142897.853503:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866942208 00000100:00100000:0.0:1746142897.853519:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866942464 00000100:00100000:0.0:1746142897.853521:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866942464 00000100:00100000:0.0:1746142897.853532:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13217 00000100:00100000:0.0:1746142897.853538:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866942208:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142897.853545:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.853551:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009337b200/0x2fa243e067cca53a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88ef6 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.853576:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867650048:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142897.853599:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.853634:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.853687:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.853702:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.853722:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.856094:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.856540:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.856642:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867650048:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142897.856658:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009337b200/0x2fa243e067cca53a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ef6 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.856665:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009337b200/0x2fa243e067cca53a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ef6 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.856672:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337b200, rc 0) 00000100:00100000:0.0:1746142897.856688:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962866942208:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3151us (3244us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.856693:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13217 00000100:00100000:0.0:1746142897.858569:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.861079:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866943488 00000100:00100000:0.0:1746142897.861085:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866943488 00000100:00100000:0.0:1746142897.861119:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866943744 00000100:00100000:0.0:1746142897.861121:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866943744 00000100:00100000:0.0:1746142897.861139:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13225 00000100:00100000:0.0:1746142897.861143:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962866943744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142897.861149:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.861159:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067cca564 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88f27 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.861179:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067cca564 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f27 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.861187:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067cca564 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f27 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.861199:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75800, rc 0) 00000100:00100000:0.0:1746142897.861319:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962866943744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 174us (256us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.861324:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13225 00000100:00100000:0.0:1746142897.861335:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866943872 00000100:00100000:0.0:1746142897.861338:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866943872 00000100:00100000:0.0:1746142897.861356:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13226 00000100:00100000:0.0:1746142897.861361:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fcfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962866943872:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142897.861367:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.861372:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cca579 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88f2e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.861382:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.861384:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.861390:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cca579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f2e expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.861401:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cca579 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f2e expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.861408:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74e00, rc 0) 00000100:00100000:0.0:1746142897.861426:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fcfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962866943872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 65us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.861430:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13226 00000100:00100000:0.0:1746142897.863609:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.870591:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.870627:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.870647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.870663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.870678:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.870693:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866944640 00000100:00100000:0.0:1746142897.870699:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866944640 00000100:00100000:0.0:1746142897.870721:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866944512 00000100:00100000:0.0:1746142897.870722:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866944512 00000100:00100000:0.0:1746142897.870730:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866944768 00000100:00100000:0.0:1746142897.870732:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866944768 00000100:00100000:0.0:1746142897.870743:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13227 00000100:00100000:0.0:1746142897.870749:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962866944640:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142897.870763:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.870775:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74200/0x2fa243e067cca58e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88f43 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.870814:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867650816:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142897.870874:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.870893:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5832 00000100:00100000:0.0:1746142897.870914:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962866944384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.870922:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.870938:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3a00/0x2fa243e067cca4df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea9 expref: 9 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.870946:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc3a00/0x2fa243e067cca4df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea9 expref: 9 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.870959:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3a00/0x2fa243e067cca4df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ea9 expref: 9 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.870968:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.870969:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.870973:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067cca533 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ee8 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.870980:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067cca533 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ee8 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.870997:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067cca533 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ee8 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.871005:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867650944:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142897.871034:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.874942:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.878994:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a28c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867650816:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142897.879016:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74200/0x2fa243e067cca58e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f43 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.879027:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74200/0x2fa243e067cca58e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f43 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.879040:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74200, rc 0) 00000100:00100000:0.0:1746142897.879064:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962866944640:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8313us (8414us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.879069:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13227 00000100:00100000:0.0:1746142897.882855:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.886775:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096072300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867651328:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142897.886793:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ebd400/0x2fa243e067cca5b1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f58 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.886803:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebd400/0x2fa243e067cca5b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f58 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.886811:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebd400, rc 0) 00000100:00100000:0.0:1746142897.886836:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962866945280:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7247us (7381us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.886843:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13231 00000100:00100000:0.0:1746142897.886922:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866946176 00000100:00100000:0.0:1746142897.886927:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866946176 00000100:00100000:0.0:1746142897.886950:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13235 00000100:00100000:0.0:1746142897.886957:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962866946176:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142897.886966:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.886977:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74600/0x2fa243e067cca5cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88f74 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.887017:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867651712:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142897.887055:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.887927:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13237 00000100:00100000:0.0:1746142897.887933:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2005:x1830962866946432:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142897.887939:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.887948:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cca5d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88f82 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.888213:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cca5d4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f82 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.888221:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cca5d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f82 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.888228:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75e00, rc 0) 00000100:00100000:0.0:1746142897.888244:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962866946432:12345-192.168.204.50@tcp:101:cat.0 Request processed in 312us (814us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.888639:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13237 00000100:00100000:0.0:1746142897.888694:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962866945792:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7919us (8305us total) trans 17179873750 rc 0/0 00000100:00100000:0.0:1746142897.888702:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1206 00002000:00100000:0.0:1746142897.888709:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2060288->2097151) req@ffff88012dc60000 x1830962866945792/t17179873750(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:48/0 lens 488/448 e 0 to 0 dl 1746142908 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.888717:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60000 with x1830962866945792 ext(2060288->2097151) 00010000:00010000:0.0:1746142897.888723:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca4ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb7 expref: 30 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.888733:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca4ed lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb7 expref: 30 pid: 12211 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746142897.888738:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc60000 00000100:00100000:0.0:1746142897.891550:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a28ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867651712:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142897.891577:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74600/0x2fa243e067cca5cd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f74 expref: 29 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.891587:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74600/0x2fa243e067cca5cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f74 expref: 29 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.891594:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74600, rc 0) 00000100:00100000:0.0:1746142897.891635:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962866946176:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4678us (5277us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142897.891641:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13235 00000100:00100000:0.0:1746142897.893230:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866946688 00000100:00100000:0.0:1746142897.893236:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866946688 00000100:00100000:0.0:1746142897.893263:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14201 00000100:00100000:0.0:1746142897.893269:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:31845:x1830962866946688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142897.893283:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.893286:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746142897.893302:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067cca587 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f35 expref: 20 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.893314:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142897.893317:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142897.893324:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067cca5e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88f89 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.893397:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067cca5e9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.893408:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067cca5e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.893416:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067cca5e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142897.893425:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142897.893498:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067cca5e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f89 expref: 22 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.894183:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067cca5e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f89 expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.894189:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142897.894191:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142897.894193:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75a00, rc 0) 00000100:00100000:0.0:1746142897.895664:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866946816 00000100:00100000:0.0:1746142897.895670:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866946816 00010000:00010000:0.0:1746142897.895691:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca4ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb7 expref: 28 pid: 12211 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.895720:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5833 00000100:00100000:0.0:1746142897.895726:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962866946816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142897.895737:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142897.895751:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca4ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb7 expref: 28 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.895760:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb7 expref: 28 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.895785:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca4ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb7 expref: 28 pid: 12211 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.895796:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.895797:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.895802:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009711b600/0x2fa243e067cca5aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f51 expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.895809:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009711b600/0x2fa243e067cca5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f51 expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.895838:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009711b600/0x2fa243e067cca5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f51 expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.895848:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867651968:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142897.895912:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.899304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.899326:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866947072 00000100:00100000:0.0:1746142897.899332:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866947072 00002000:00100000:0.0:1746142897.899367:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009a28e300 x1830962866947072/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/0 e 0 to 0 dl 1746142908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.899377:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28e300 with x1830962866947072 ext(1048576->2097151) 00002000:00010000:0.0:1746142897.899381:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28e300 00000100:00100000:0.0:1746142897.899608:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3863 00000100:00100000:0.0:1746142897.899616:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962866947072:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142897.902646:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.902812:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.903127:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.903257:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.903769:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.903799:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.903842:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866947328 00000100:00100000:0.0:1746142897.903845:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866947328 00000100:00100000:0.0:1746142897.903863:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866947584 00000100:00100000:0.0:1746142897.903865:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866947584 00000100:00100000:0.0:1746142897.903872:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866947840 00000100:00100000:0.0:1746142897.903874:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866947840 00000100:00100000:0.0:1746142897.903881:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13240 00000100:00100000:0.0:1746142897.903886:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866947712:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142897.903917:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067cca605 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.903926:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cca492 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2449408->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e5c expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.903932:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471e800/0x2fa243e067cca499 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e63 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.903938:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3200/0x2fa243e067cca4e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb0 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.903943:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746142897.903945:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746142897.903947:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067cca605 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.903960:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc3200/0x2fa243e067cca4e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb0 expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.903966:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3200/0x2fa243e067cca4e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88eb0 expref: 22 pid: 1853 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.903973:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867652608:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142897.904011:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009471e800/0x2fa243e067cca499 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e63 expref: 9 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.904017:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009471e800/0x2fa243e067cca499 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e63 expref: 9 pid: 1853 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.904024:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867652736:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142897.904042:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cca492 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2449408->2818047) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e5c expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.904049:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cca492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2449408->2818047) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e5c expref: 22 pid: 1853 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.904055:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867652864:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142897.904068:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.904080:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13241 00000100:00100000:0.0:1746142897.904084:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962866947328:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142897.904097:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.904107:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009711b600/0x2fa243e067cca5aa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f51 expref: 10 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.904112:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.904113:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.904115:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.904129:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009711b600/0x2fa243e067cca5aa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f51 expref: 10 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.904135:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009711b600/0x2fa243e067cca5aa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f51 expref: 10 pid: 1397 timeout: 771 lvb_type: 0 00000100:00100000:0.0:1746142897.904142:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867652992:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142897.904157:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.909869:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867652608:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142897.909876:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867652736:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142897.910274:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867652992:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142897.910283:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.911003:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866947968 00000100:00100000:0.0:1746142897.911009:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866947968 00002000:00100000:0.0:1746142897.911039:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1200127) req@ffff88009ceb1500 x1830962866947968/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:48/0 lens 488/0 e 0 to 0 dl 1746142908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.911046:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1500 with x1830962866947968 ext(1048576->1200127) 00010000:00010000:0.0:1746142897.911053:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067cca533 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ee8 expref: 27 pid: 11421 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.911061:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067cca533 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1200127) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ee8 expref: 27 pid: 11421 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746142897.911066:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ceb1500 00000100:00100000:0.0:1746142897.912008:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1207 00000100:00100000:0.0:1746142897.912014:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962866947968:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142897.915424:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915639:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915669:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915679:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915687:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.915704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142897.918089:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918102:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918116:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918122:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918128:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918133:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009337bc00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142897.918136:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918142:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918151:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.918157:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009337bc00/0x2fa243e067cca60c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.918882:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962866947328:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 14796us (15624us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.918890:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13241 00000100:00100000:0.0:1746142897.920170:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.925508:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.926354:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962866949248:12345-192.168.204.50@tcp:4:cat.0 Request processed in 9540us (10647us total) trans 21474841016 rc 0/0 00000100:00100000:0.0:1746142897.926361:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1208 00002000:00100000:0.0:1746142897.926369:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2449408->2818047) req@ffff88012e518a80 x1830962866949248/t21474841016(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:48/0 lens 488/448 e 0 to 0 dl 1746142908 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.926378:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e518a80 with x1830962866949248 ext(2449408->2818047) 00010000:00010000:0.0:1746142897.926384:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cca492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2449408->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e5c expref: 23 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.926394:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067cca492 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2449408->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88e5c expref: 23 pid: 1853 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746142897.926400:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e518a80 00000100:00100000:0.0:1746142897.927838:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962866949376:12345-192.168.204.50@tcp:4:cat.0 Request processed in 9411us (9556us total) trans 21474841017 rc 0/0 00000100:00100000:0.0:1746142897.927845:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1209 00002000:00100000:0.0:1746142897.927851:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1409023) req@ffff880096072680 x1830962866949376/t21474841017(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:48/0 lens 488/448 e 0 to 0 dl 1746142908 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142897.927859:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072680 with x1830962866949376 ext(1048576->1409023) 00010000:00010000:0.0:1746142897.927865:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cca4f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ebe expref: 10 pid: 1853 timeout: 771 lvb_type: 0 00010000:00010000:0.0:1746142897.927878:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a37e00/0x2fa243e067cca4f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1409023) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ebe expref: 10 pid: 1853 timeout: 771 lvb_type: 0 00002000:00010000:0.0:1746142897.927883:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096072680 00000100:00100000:0.0:1746142897.929265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.929939:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.929994:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142897.932257:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932264:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932277:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932284:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932289:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932294:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009711a200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142897.932297:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932307:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932317:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.932322:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711a200/0x2fa243e067cca613 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.932377:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+6:2006:x1830962866947584:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 28159us (28608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.932389:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13242 00000100:00100000:0.0:1746142897.935847:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939205:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939322:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939719:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939739:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939776:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.939795:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.941463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.941828:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142897.942727:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009711be00/0x2fa243e067cca628 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.942734:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711be00/0x2fa243e067cca628 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00000040:00080000:0.0:1746142897.942947:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].528, 88 off54168 00000004:00080000:0.0:1746142897.942953:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671942053059ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.942972:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].587, 88 off59456 00000004:00080000:0.0:1746142897.942976:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671942075979ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.942999:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].588, 88 off59544 00000004:00080000:0.0:1746142897.943002:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671942102025ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.943010:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].529, 88 off54256 00000004:00080000:0.0:1746142897.943012:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671942112250ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.943018:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].530, 88 off54344 00000004:00080000:0.0:1746142897.943021:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671942120866ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.943028:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].589, 88 off59632 00000004:00080000:0.0:1746142897.943030:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671942130070ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944055:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].590, 88 off59720 00000004:00080000:0.0:1746142897.944062:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671943162136ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944084:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].531, 88 off54432 00000004:00080000:0.0:1746142897.944086:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671943186550ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.944109:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].591, 88 off59808 00000004:00080000:0.0:1746142897.944113:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671943212620ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944124:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].532, 88 off54520 00000004:00080000:0.0:1746142897.944127:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671943226956ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.944143:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].592, 88 off59896 00000004:00080000:0.0:1746142897.944146:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671943246109ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944152:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].533, 88 off54608 00000004:00080000:0.0:1746142897.944155:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671943254875ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.944178:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].593, 88 off59984 00000004:00080000:0.0:1746142897.944181:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671943280825ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944190:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].534, 88 off54696 00000004:00080000:0.0:1746142897.944192:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671943292501ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142897.944200:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].594, 88 off60072 00000004:00080000:0.0:1746142897.944203:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671943302748ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944210:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].595, 88 off60160 00000004:00080000:0.0:1746142897.944212:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 671943312275ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142897.944220:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].535, 88 off54784 00000004:00080000:0.0:1746142897.944223:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 671943322815ns, next at 629431245375ns, rc = 0 00000100:00100000:0.0:1746142897.946661:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867654656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.946707:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.946740:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867654912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.946758:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.946771:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746142897.946775:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867654784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.946787:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:0.0:1746142897.946820:0:10924:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012e51bb80 reply state ffff880088fdc400 transno 8589936294 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711be00/0x2fa243e067cca628 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.946829:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711be00/0x2fa243e067cca628 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142897.946835:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142897.946837:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142897.946841:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cca636 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f9e expref: 7 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.946849:0:10924:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cca636 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f9e expref: 7 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.946859:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cca636 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f9e expref: 7 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142897.946877:0:10924:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cca636 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f9e expref: 7 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142897.946884:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867655040:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142897.946938:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142897.946949:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13247 00000100:00100000:0.0:1746142897.946954:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3762:x1830962867654528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947322:0:3763:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873733 gen 2 00000004:00080000:0.0:1746142897.947327:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f4000, transno 17179873683 00000004:00080000:0.0:1746142897.947330:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0000, transno 17179873684 00000004:00080000:0.0:1746142897.947331:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097433800, transno 17179873685 00000004:00080000:0.0:1746142897.947333:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f7b80, transno 17179873686 00000004:00080000:0.0:1746142897.947335:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0380, transno 17179873687 00000004:00080000:0.0:1746142897.947337:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cce00, transno 17179873688 00000004:00080000:0.0:1746142897.947339:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e89c00, transno 17179873689 00000004:00080000:0.0:1746142897.947341:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097430e00, transno 17179873690 00000004:00080000:0.0:1746142897.947343:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d1180, transno 17179873691 00000004:00080000:0.0:1746142897.947345:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d3b80, transno 17179873693 00000004:00080000:0.0:1746142897.947346:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d2680, transno 17179873694 00000004:00080000:0.0:1746142897.947348:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d2a00, transno 17179873695 00000004:00080000:0.0:1746142897.947350:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d1880, transno 17179873696 00000004:00080000:0.0:1746142897.947352:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d3480, transno 17179873697 00000004:00080000:0.0:1746142897.947353:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0e00, transno 17179873698 00000004:00080000:0.0:1746142897.947355:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096143b80, transno 17179873699 00000004:00080000:0.0:1746142897.947357:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d3800, transno 17179873700 00000004:00080000:0.0:1746142897.947359:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d1f80, transno 17179873701 00000004:00080000:0.0:1746142897.947361:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130377800, transno 17179873702 00000004:00080000:0.0:1746142897.947363:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130377480, transno 17179873703 00000004:00080000:0.0:1746142897.947365:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c4380, transno 17179873704 00000004:00080000:0.0:1746142897.947367:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130374380, transno 17179873705 00000004:00080000:0.0:1746142897.947369:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130377100, transno 17179873706 00000004:00080000:0.0:1746142897.947371:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c6d80, transno 17179873707 00000004:00080000:0.0:1746142897.947373:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c4700, transno 17179873708 00000004:00080000:0.0:1746142897.947375:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c5f80, transno 17179873709 00000004:00080000:0.0:1746142897.947377:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c6300, transno 17179873710 00000004:00080000:0.0:1746142897.947379:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d1500, transno 17179873715 00000004:00080000:0.0:1746142897.947381:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098191180, transno 17179873716 00000004:00080000:0.0:1746142897.947382:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d1180, transno 17179873717 00000004:00080000:0.0:1746142897.947384:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098190380, transno 17179873718 00000004:00080000:0.0:1746142897.947386:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098190e00, transno 17179873719 00000004:00080000:0.0:1746142897.947388:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098193800, transno 17179873720 00000004:00080000:0.0:1746142897.947390:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d1c00, transno 17179873721 00000004:00080000:0.0:1746142897.947392:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d2d80, transno 17179873722 00000004:00080000:0.0:1746142897.947394:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938d2300, transno 17179873723 00000004:00080000:0.0:1746142897.947396:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c2a00, transno 17179873725 00000004:00080000:0.0:1746142897.947398:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092432680, transno 17179873726 00000004:00080000:0.0:1746142897.947399:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d71500, transno 17179873727 00000004:00080000:0.0:1746142897.947401:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d73800, transno 17179873728 00000004:00080000:0.0:1746142897.947403:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c1500, transno 17179873729 00000004:00080000:0.0:1746142897.947405:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d70700, transno 17179873730 00000004:00080000:0.0:1746142897.947407:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092430700, transno 17179873731 00000004:00080000:0.0:1746142897.947409:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d71880, transno 17179873732 00000004:00080000:0.0:1746142897.947411:0:3763:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d5f80, transno 17179873733 00000100:00100000:0.0:1746142897.947416:0:3763:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009ceb0000 x1830962867654656/t17179873752(17179873752) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142913 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746142897.947424:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0000/2, rc 0, transno 17179873752 00000100:00100000:0.0:1746142897.947428:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867654656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947435:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947454:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947467:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947479:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947489:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867656320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947502:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947511:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746142897.947515:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947527:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947535:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947546:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947553:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867656192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947565:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947577:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867655552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947590:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947597:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867656064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947623:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142897.947635:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2a00/2, rc 0, transno 17179873753 00000100:00100000:0.0:1746142897.947639:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867654784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947646:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474840999 gen 2 00000004:00080000:0.0:1746142897.947648:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b75b100, transno 21474840955 00000004:00080000:0.0:1746142897.947653:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b75bb80, transno 21474840956 00000004:00080000:0.0:1746142897.947655:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d4700, transno 21474840957 00000004:00080000:0.0:1746142897.947657:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b75b800, transno 21474840958 00000004:00080000:0.0:1746142897.947659:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b75b480, transno 21474840959 00000004:00080000:0.0:1746142897.947661:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d4380, transno 21474840960 00000004:00080000:0.0:1746142897.947663:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b75ad80, transno 21474840961 00000004:00080000:0.0:1746142897.947665:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d4000, transno 21474840962 00000004:00080000:0.0:1746142897.947667:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d5500, transno 21474840964 00000004:00080000:0.0:1746142897.947669:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d7800, transno 21474840965 00000004:00080000:0.0:1746142897.947671:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d6680, transno 21474840966 00000004:00080000:0.0:1746142897.947672:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d7100, transno 21474840967 00000004:00080000:0.0:1746142897.947674:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d6d80, transno 21474840968 00000004:00080000:0.0:1746142897.947676:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d6300, transno 21474840969 00000004:00080000:0.0:1746142897.947678:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d5180, transno 21474840970 00000004:00080000:0.0:1746142897.947680:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d6a00, transno 21474840971 00000004:00080000:0.0:1746142897.947681:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096141f80, transno 21474840972 00000004:00080000:0.0:1746142897.947683:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096141c00, transno 21474840973 00000004:00080000:0.0:1746142897.947685:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096140e00, transno 21474840974 00000004:00080000:0.0:1746142897.947687:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096142d80, transno 21474840975 00000004:00080000:0.0:1746142897.947688:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096142300, transno 21474840976 00000004:00080000:0.0:1746142897.947690:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096141880, transno 21474840977 00000004:00080000:0.0:1746142897.947691:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096142a00, transno 21474840978 00000004:00080000:0.0:1746142897.947693:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096143100, transno 21474840979 00000004:00080000:0.0:1746142897.947695:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132407800, transno 21474840983 00000004:00080000:0.0:1746142897.947697:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d7c700, transno 21474840984 00000004:00080000:0.0:1746142897.947698:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132404000, transno 21474840985 00000004:00080000:0.0:1746142897.947700:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132405500, transno 21474840986 00000004:00080000:0.0:1746142897.947702:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132404a80, transno 21474840987 00000004:00080000:0.0:1746142897.947704:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132406a00, transno 21474840988 00000004:00080000:0.0:1746142897.947706:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132404380, transno 21474840989 00000004:00080000:0.0:1746142897.947708:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880132405f80, transno 21474840990 00000004:00080000:0.0:1746142897.947710:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d62680, transno 21474840992 00000004:00080000:0.0:1746142897.947712:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60700, transno 21474840993 00000004:00080000:0.0:1746142897.947713:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61500, transno 21474840994 00000004:00080000:0.0:1746142897.947715:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60000, transno 21474840995 00000004:00080000:0.0:1746142897.947717:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d63100, transno 21474840996 00000004:00080000:0.0:1746142897.947718:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60a80, transno 21474840997 00000004:00080000:0.0:1746142897.947720:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d63b80, transno 21474840998 00000004:00080000:0.0:1746142897.947722:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60e00, transno 21474840999 00000100:00100000:0.0:1746142897.947725:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880096070a80 x1830962867654912/t21474841018(21474841018) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142913 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746142897.947730:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096070a80/2, rc 0, transno 21474841018 00000100:00100000:0.0:1746142897.947733:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867654912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947739:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867656576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947752:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142897.947772:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096072300/2, rc 0, transno 21474841023 00000100:00100000:0.0:1746142897.947775:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142897.947782:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096073100/2, rc 0, transno 21474841020 00000100:00100000:0.0:1746142897.947784:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142897.947789:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a5b100/2, rc 0, transno 21474841021 00000100:00100000:0.0:1746142897.947791:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142897.947797:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800979b0700/2, rc 0, transno 21474841022 00000100:00100000:0.0:1746142897.947799:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867656320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142897.947802:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142897.947807:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092406d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867656704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.947820:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142897.947885:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3762:x1830962867654528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 930us (1162us total) trans 17179873754 rc 0/0 00000100:00100000:0.0:1746142897.948274:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13247 00000004:00080000:0.0:1746142897.948296:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096073b80/2, rc 0, transno 21474841024 00000100:00100000:0.0:1746142897.948299:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096073b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867655680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142897.948305:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0a80/2, rc 0, transno 17179873755 00000100:00100000:0.0:1746142897.948307:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867656192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142897.948318:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2300/2, rc 0, transno 17179873756 00000100:00100000:0.0:1746142897.948320:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867655552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142897.948326:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a5b480/2, rc 0, transno 21474841025 00000100:00100000:0.0:1746142897.948328:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867656064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142897.948509:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092406a00/2, rc 0, transno 17179873760 00000100:00100000:0.0:1746142897.948513:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867656576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142897.949770:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.950684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.954349:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.954411:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.958812:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866952448 00000100:00100000:0.0:1746142897.958817:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866952448 00000100:00100000:0.0:1746142897.958848:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13264 00000100:00100000:0.0:1746142897.958853:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962866952448:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142897.958860:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142897.958871:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb88fb3 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142897.958883:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406b2, atime: 0x681406b0, ctime: 0x681406b2, blocks: 0x7f0 00010000:00010000:0.0:1746142897.958891:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.958892:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142897.958896:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fb3 expref: 7 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.958922:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fb3 expref: 7 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142897.958929:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2a00, rc 0) 00000100:00100000:0.0:1746142897.959755:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962866952448:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 901us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.959762:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13264 00000100:00100000:0.0:1746142897.968347:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.969035:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.969057:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.969075:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.969086:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.969106:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.969117:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866953600 00000100:00100000:0.0:1746142897.969120:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866953600 00000100:00100000:0.0:1746142897.969257:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866953216 00000100:00100000:0.0:1746142897.969260:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866953216 00000100:00100000:0.0:1746142897.969270:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866953472 00000100:00100000:0.0:1746142897.969272:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866953472 00000100:00100000:0.0:1746142897.969279:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866953728 00000100:00100000:0.0:1746142897.969280:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866953728 00000100:00100000:0.0:1746142897.969288:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13269 00000100:00100000:0.0:1746142897.969293:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962866953344:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142897.969432:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962866953344:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 138us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.969438:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13269 00000100:00100000:0.0:1746142897.969448:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13273 00000100:00100000:0.0:1746142897.969452:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866953472:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142897.969479:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866953472:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.969484:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13273 00000100:00100000:0.0:1746142897.969493:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13274 00000100:00100000:0.0:1746142897.969497:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962866953728:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142897.969521:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962866953728:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.969525:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13274 00000100:00100000:0.0:1746142897.972694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.974036:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.974062:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.974120:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.976070:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866954496 00000100:00100000:0.0:1746142897.976074:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866954496 00000100:00100000:0.0:1746142897.976178:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866955008 00000100:00100000:0.0:1746142897.976181:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866955008 00000100:00100000:0.0:1746142897.976191:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866954624 00000100:00100000:0.0:1746142897.976193:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866954624 00000100:00100000:0.0:1746142897.976207:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13280 00000100:00100000:0.0:1746142897.976211:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866955008:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142897.976264:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962866955008:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 51us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.976269:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13280 00000100:00100000:0.0:1746142897.976278:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13282 00000100:00100000:0.0:1746142897.976281:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962866954624:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142897.976409:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962866954624:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.976413:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13282 00000100:00100000:0.0:1746142897.976460:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866954880 00000100:00100000:0.0:1746142897.976463:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866954880 00000100:00100000:0.0:1746142897.976476:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13283 00000100:00100000:0.0:1746142897.976480:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866954880:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142897.976518:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962866954880:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 37us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142897.976523:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13283 00000100:00100000:0.0:1746142897.976586:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.982538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.986246:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.986294:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142897.989723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.001870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.010086:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866957056 00000100:00100000:0.0:1746142898.010089:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866957056 00000100:00100000:0.0:1746142898.010107:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3869 00000100:00100000:0.0:1746142898.010111:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866956928:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142898.010123:0:29473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009337ac00/0x2fa243e067cca6c2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.010133:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.010134:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.010138:0:29473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009337ac00/0x2fa243e067cca6c2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.010149:0:29473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009337ac00/0x2fa243e067cca6c2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.011773:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866957952 00000100:00100000:0.0:1746142898.011778:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866957952 00000100:00100000:0.0:1746142898.011804:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866957312 00000100:00100000:0.0:1746142898.011806:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866957312 00000100:00100000:0.0:1746142898.011818:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3871 00000100:00100000:0.0:1746142898.011824:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962866957952:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142898.011840:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009337a400/0x2fa243e067cca6d0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.011847:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.011849:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.011851:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009337a400/0x2fa243e067cca6d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.011858:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009337a400/0x2fa243e067cca6d0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.012450:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3873 00000100:00100000:0.0:1746142898.012455:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962866957440:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142898.012466:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067cca6de lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.012471:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.012472:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.012474:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067cca6de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.012480:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067cca6de lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.013492:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.018519:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866958336 00000100:00100000:0.0:1746142898.018525:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866958336 00000100:00100000:0.0:1746142898.018556:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3875 00000100:00100000:0.0:1746142898.018561:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+19:2005:x1830962866958336:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142898.018581:0:9583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.018592:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.018594:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.018598:0:9583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.018619:0:9583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.026472:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.050975:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142898.082797:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.082808:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.082815:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.082821:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142898.082824:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.083017:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.083032:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.083038:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067cca6ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.083100:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962866958336:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 64534us (64684us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142898.083108:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3875 00000100:00100000:0.0:1746142898.084714:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.086306:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.086338:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.087758:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.087773:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866959616 00000100:00100000:0.0:1746142898.087777:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866959616 00000100:00100000:0.0:1746142898.087798:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14209 00000100:00100000:0.0:1746142898.087804:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+6:31845:x1830962866959616:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:0.0:1746142898.088565:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142898.088574:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142898.088580:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142898.088590:0:10924:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142898.088613:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142898.089675:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.091575:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867657472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142898.091595:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.091619:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867657984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142898.091632:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.091644:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867658496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142898.091657:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.091666:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867659008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142898.091676:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.091687:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746142898.091691:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867658368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142898.091703:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.091712:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867658880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142898.091723:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.091739:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867659008 00000100:00100000:0.0:1746142898.091741:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867659008 00000100:00100000:0.0:1746142898.091751:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658368 00000100:00100000:0.0:1746142898.091753:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658368 00000100:00100000:0.0:1746142898.091760:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13291 00000100:00100000:0.0:1746142898.091764:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3765:x1830962867658496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142898.091805:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142898.091806:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142898 -> 1746142898 00002000:00010000:0.0:1746142898.091808:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142898 -> 1746142898 00002000:00010000:0.0:1746142898.091810:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142898 -> 1746142898 00002000:00010000:0.0:1746142898.091811:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142898.091826:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3765:x1830962867658496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (169us total) trans 17179873762 rc 0/0 00000100:00100000:0.0:1746142898.091831:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13291 00000004:00080000:0.0:1746142898.091868:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a58a80/2, rc 0, transno 21474841028 00000100:00100000:0.0:1746142898.091872:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867657472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142898.091878:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2680/2, rc 0, transno 21474841030 00000100:00100000:0.0:1746142898.091880:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867657984:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142898.091887:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734f800/2, rc 0, transno 17179873762 00000100:00100000:0.0:1746142898.091892:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867658496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142898.091911:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088f19180/2, rc 0, transno 17179873763 00000100:00100000:0.0:1746142898.091914:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867659008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142898.091923:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734c700/2, rc 0, transno 17179873764 00000100:00100000:0.0:1746142898.091925:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867658368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142898.091931:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734ed80/2, rc 0, transno 17179873765 00000100:00100000:0.0:1746142898.091934:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867658880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142898.091971:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867657856 00000100:00100000:0.0:1746142898.091973:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867657856 00000100:00100000:0.0:1746142898.091985:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658112 00000100:00100000:0.0:1746142898.091986:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658112 00000100:00100000:0.0:1746142898.091995:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13296 00000100:00100000:0.0:1746142898.091999:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867657856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142898.092047:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867657856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (89us total) trans 21474841032 rc 0/0 00000100:00100000:0.0:1746142898.092052:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13296 00000100:00100000:0.0:1746142898.092060:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13298 00000100:00100000:0.0:1746142898.092063:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3762:x1830962867658624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142898.092096:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142898.092098:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142898.092100:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142898.092101:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142898.092103:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142898.092116:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867658624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (113us total) trans 17179873766 rc 0/0 00000100:00100000:0.0:1746142898.092121:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13298 00000100:00100000:0.0:1746142898.092129:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867659264 00000100:00100000:0.0:1746142898.092131:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867659264 00000100:00100000:0.0:1746142898.092144:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13301 00000100:00100000:0.0:1746142898.092148:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3762:x1830962867658752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142898.092179:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746142898.092181:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142898.092182:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142898.092184:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142898.092185:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:0.0:1746142898.092198:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3762:x1830962867658752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (122us total) trans 17179873768 rc 0/0 00000100:00100000:0.0:1746142898.092202:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13301 00010000:00010000:0.0:1746142898.092739:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142898.092746:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00010000:0.0:1746142898.092813:0:10924:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009734df80 reply state ffff88012e753000 transno 8589936298 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142898.092822:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142898.092827:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142898.092829:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746142898.092831:0:10924:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746142898.092873:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:31845:x1830962866959616:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 5069us (5116us total) trans 8589936298 rc 0/0 00000100:00100000:0.0:1746142898.092879:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14209 00000100:00100000:0.0:1746142898.094836:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.094868:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.126308:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.127029:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.127976:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3877 00000100:00100000:0.0:1746142898.127985:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962866960384:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.128541:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962866960384:12345-192.168.204.50@tcp:3:cat.0 Request processed in 555us (1509us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142898.128548:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3877 00002000:00100000:0.0:1746142898.128554:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff880088f18380 x1830962866960384/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.128561:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18380 with x1830962866960384 ext(5029888->5033983) 00002000:00010000:0.0:1746142898.128565:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18380 00000100:00100000:0.0:1746142898.133356:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.133388:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.133697:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.133743:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.133771:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866961280 00000100:00100000:0.0:1746142898.133775:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866961280 00000100:00100000:0.0:1746142898.133800:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5113 00000100:00100000:0.0:1746142898.133806:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d7f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:31848:x1830962866961280:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142898.133965:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d7f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:31848:x1830962866961280:12345-192.168.204.50@tcp:35:cat.0 Request processed in 158us (221us total) trans 8589936299 rc 0/0 00000100:00100000:0.0:1746142898.133972:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5113 00000100:00100000:0.0:1746142898.134009:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13307 00000100:00100000:0.0:1746142898.134014:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962866960896:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:0.0:1746142898.134067:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:0.0:1746142898.134070:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142898 -> 1746142898 00002000:00010000:0.0:1746142898.134072:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142898 -> 1746142898 00002000:00010000:0.0:1746142898.134074:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142898 -> 1746142898 00002000:00010000:0.0:1746142898.134075:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142898.134090:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962866960896:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 76us (394us total) trans 21474841036 rc 0/0 00000100:00100000:0.0:1746142898.134095:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13307 00000100:00100000:0.0:1746142898.139329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.146096:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.146343:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.148813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.148875:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.149218:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.149237:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866961920 00000100:00100000:0.0:1746142898.149241:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866961920 00002000:00100000:0.0:1746142898.149262:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3948544->3952639) req@ffff880088f18000 x1830962866961920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.149375:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18000 with x1830962866961920 ext(3948544->3952639) 00002000:00010000:0.0:1746142898.149546:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18000 00000100:00100000:0.0:1746142898.149749:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3878 00000100:00100000:0.0:1746142898.152008:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866961920:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142898.153053:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962866961920:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1055us (3834us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142898.153200:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3878 00002000:00100000:0.0:1746142898.153208:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3948544->3952639) req@ffff880088f18000 x1830962866961920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.153333:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18000 with x1830962866961920 ext(3948544->3952639) 00002000:00010000:0.0:1746142898.153337:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18000 00000100:00100000:0.0:1746142898.155452:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.161749:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.162400:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.162831:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.163101:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.163116:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.163476:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.163718:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.171071:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.171153:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.171174:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866963712 00000100:00100000:0.0:1746142898.171181:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866963712 00000100:00100000:0.0:1746142898.171213:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5115 00000100:00100000:0.0:1746142898.171220:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:31845:x1830962866963712:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1746142898.171376:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:31845:x1830962866963712:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 155us (221us total) trans 8589936302 rc 0/0 00000100:00100000:0.0:1746142898.171382:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5115 00000100:00100000:0.0:1746142898.184071:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.184087:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.184112:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.184144:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866963840 00000100:00100000:0.0:1746142898.184151:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866963840 00010000:00010000:0.0:1746142898.184182:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca691 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ff2 expref: 12 pid: 9579 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746142898.184202:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866964096 00000100:00100000:0.0:1746142898.184203:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866964096 00010000:00010000:0.0:1746142898.184211:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36000/0x2fa243e067cca667 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fd6 expref: 16 pid: 9579 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746142898.184221:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866963968 00000100:00100000:0.0:1746142898.184223:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866963968 00010000:00010000:0.0:1746142898.184230:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7c00/0x2fa243e067cca77f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8905b expref: 30 pid: 11421 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746142898.184242:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5857 00000100:00100000:0.0:1746142898.184249:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962866963840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142898.184260:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142898.184282:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca691 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ff2 expref: 12 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.184292:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36e00/0x2fa243e067cca691 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88ff2 expref: 12 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.184311:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142898.184357:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962866963840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142898.184363:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5857 00000100:00100000:0.0:1746142898.184376:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5858 00000100:00100000:0.0:1746142898.184381:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962866964096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142898.184387:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142898.184393:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36000/0x2fa243e067cca667 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fd6 expref: 16 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.184400:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36000/0x2fa243e067cca667 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fd6 expref: 16 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.184410:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142898.184423:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962866964096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 42us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142898.184428:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5858 00000100:00100000:0.0:1746142898.184436:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5859 00000100:00100000:0.0:1746142898.184441:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962866963968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142898.184446:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142898.184451:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7c00/0x2fa243e067cca77f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8905b expref: 30 pid: 11421 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.184459:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7c00/0x2fa243e067cca77f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8905b expref: 30 pid: 11421 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.184469:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.184471:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.184477:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cca79b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89031 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.184484:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cca79b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89031 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.184509:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cca79b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3612671) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89031 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.184519:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867660416:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142898.184568:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142898.189723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.198369:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.219790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.238303:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.262039:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.262472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.262498:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.268338:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.268569:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.277273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.282365:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.285289:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.286087:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962866966784:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 8649us (8820us total) trans 21474841038 rc 0/0 00000100:00100000:0.0:1746142898.286095:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1211 00002000:00100000:0.0:1746142898.286103:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3948544->4194303) req@ffff8800981cca80 x1830962866966784/t21474841038(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/448 e 0 to 0 dl 1746142909 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.286112:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cca80 with x1830962866966784 ext(3948544->4194303) 00010000:00010000:0.0:1746142898.286119:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cca739 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3948544->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8901c expref: 14 pid: 1853 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746142898.286132:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cca739 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3948544->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8901c expref: 14 pid: 1853 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746142898.286137:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800981cca80 00000100:00100000:0.0:1746142898.291816:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.291860:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.294653:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.302459:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.302491:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.303552:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.306643:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3887 00000100:00100000:0.0:1746142898.306649:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962866968320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.306726:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962866968320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 77us (3175us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142898.306731:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3887 00002000:00100000:0.0:1746142898.306737:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3276800->3280895) req@ffff8800924f4000 x1830962866968320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.306743:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f4000 with x1830962866968320 ext(3276800->3280895) 00002000:00010000:0.0:1746142898.306746:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f4000 00000100:00100000:0.0:1746142898.310304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.310897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.311576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.319709:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.319730:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866969344 00000100:00100000:0.0:1746142898.319740:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866969344 00002000:00100000:0.0:1746142898.319772:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800924f4e00 x1830962866969344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.319782:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f4e00 with x1830962866969344 ext(1048576->2097151) 00002000:00010000:0.0:1746142898.319787:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f4e00 00000100:00100000:0.0:1746142898.319810:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3891 00000100:00100000:0.0:1746142898.319817:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962866969344:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.330865:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.335975:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.336043:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.338629:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867661696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746142898.338667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142898.340499:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867661696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746142898.360966:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.361458:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.362339:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.363511:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.366840:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.366886:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.380358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.383564:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.385769:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.389027:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.389819:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.390610:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13332 00000100:00100000:0.0:1746142898.390617:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962866971776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142898.390625:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142898.390633:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b1800/0x2fa243e067cca827 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb890cb expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142898.390656:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867662592:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142898.390684:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4eb40 going to sleep for 11 seconds 00002000:00010000:0.0:1746142898.392786:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142898 -> 1746142899 00000100:00100000:0.0:1746142898.392795:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867662592:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142898.392817:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1800/0x2fa243e067cca827 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890cb expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.392825:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1800/0x2fa243e067cca827 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890cb expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.393486:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1800, rc 0) 00000100:00100000:0.0:1746142898.393509:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962866971776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2892us (3690us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142898.393515:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13332 00000100:00100000:0.0:1746142898.394854:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962866971520:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8910us (9082us total) trans 17179873775 rc 0/0 00000100:00100000:0.0:1746142898.394863:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1212 00002000:00100000:0.0:1746142898.394870:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2469888->3145727) req@ffff88009cfee300 x1830962866971520/t17179873775(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/448 e 0 to 0 dl 1746142909 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.394879:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee300 with x1830962866971520 ext(2469888->3145727) 00010000:00010000:0.0:1746142898.394886:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b05fa00/0x2fa243e067cca7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89062 expref: 32 pid: 1852 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746142898.395113:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b05fa00/0x2fa243e067cca7a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2469888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89062 expref: 32 pid: 1852 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746142898.395122:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cfee300 00000100:00100000:0.0:1746142898.399977:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.400027:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.405856:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.417050:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.422726:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962866972672:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2144us (2394us total) trans 21474841039 rc 0/0 00000100:00100000:0.0:1746142898.422735:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1213 00002000:00100000:0.0:1746142898.422744:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3280895) req@ffff88012c0e0a80 x1830962866972672/t21474841039(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/448 e 0 to 0 dl 1746142909 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.422753:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0a80 with x1830962866972672 ext(3145728->3280895) 00010000:00010000:0.0:1746142898.422760:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067cca7e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89085 expref: 28 pid: 1852 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746142898.422772:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067cca7e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3280895) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89085 expref: 28 pid: 1852 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746142898.422778:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0e0a80 00000100:00100000:0.0:1746142898.428081:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.435161:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.435203:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.435374:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866973312 00000100:00100000:1.0:1746142898.435376:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866973312 00002000:00100000:1.0:1746142898.435383:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009b4fd180 x1830962866973312/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.435387:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fd180 with x1830962866973312 ext(3145728->4194303) 00002000:00010000:1.0:1746142898.435389:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4fd180 00000100:00100000:1.0:1746142898.435395:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3897 00000100:00100000:1.0:1746142898.435399:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962866973056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.444970:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.445281:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962866973056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9879us (10125us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142898.445289:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3897 00002000:00100000:0.0:1746142898.445298:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009b4fce00 x1830962866973056/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/440 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.445306:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fce00 with x1830962866973056 ext(3145728->4194303) 00002000:00010000:0.0:1746142898.445310:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fce00 00000100:00100000:0.0:1746142898.453085:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.453170:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.456527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.475622:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.475676:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866974592 00000100:00100000:0.0:1746142898.475683:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866974592 00000100:00100000:0.0:1746142898.475720:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5119 00000100:00100000:0.0:1746142898.475726:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:31865:x1830962866974592:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142898.475888:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:31865:x1830962866974592:12345-192.168.204.50@tcp:35:cat.0 Request processed in 161us (272us total) trans 8589936309 rc 0/0 00000100:00100000:0.0:1746142898.475894:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5119 00000100:00100000:0.0:1746142898.526852:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.536026:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.536062:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.536130:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.545145:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.545318:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866975360 00000100:00100000:1.0:1746142898.545326:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866975360 00000100:00100000:1.0:1746142898.545453:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13336 00000100:00100000:1.0:1746142898.545461:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:31871:x1830962866975360:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142898.545477:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142898.545490:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb890fc expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.545513:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6a00/0x2fa243e067cca621 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f90 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.545520:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cca78d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89046 expref: 33 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142898.545527:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fea000/0x2fa243e067cca66e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fc1 expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142898.545537:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142898.545539:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142898.545542:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1150976->1785855] (req 1150976->1785855) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890fc expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.545566:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fea000/0x2fa243e067cca66e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fc1 expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142898.545576:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fea000/0x2fa243e067cca66e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fc1 expref: 14 pid: 12211 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746142898.545586:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867663360:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142898.546097:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cca78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89046 expref: 33 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142898.546106:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cca78d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89046 expref: 33 pid: 11421 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746142898.546115:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867663488:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142898.547047:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927d6a00/0x2fa243e067cca621 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f90 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.547058:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927d6a00/0x2fa243e067cca621 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f90 expref: 11 pid: 1852 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746142898.547072:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867663616:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142898.547116:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746142898.548724:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867663360:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142898.553432:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.553511:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142898.554314:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cca78d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89046 expref: 33 pid: 11421 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746142898.554329:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867663488:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142898.554337:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6a00/0x2fa243e067cca621 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88f90 expref: 12 pid: 1852 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746142898.554344:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867663616:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142898.554365:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890fc expref: 32 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.554374:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714e00, rc 0) 00000100:00100000:1.0:1746142898.554393:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:31871:x1830962866975360:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8933us (9255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.554398:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13336 00000100:00100000:1.0:1746142898.555920:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3900 00000100:00100000:1.0:1746142898.555927:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962866976000:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142898.561065:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.561087:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866976512 00000100:00100000:1.0:1746142898.561094:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866976512 00002000:00100000:1.0:1746142898.561122:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1150976->1155071) req@ffff880130121c00 x1830962866976512/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.561130:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121c00 with x1830962866976512 ext(1150976->1155071) 00002000:00010000:1.0:1746142898.561134:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130121c00 00000100:00100000:1.0:1746142898.561156:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3902 00000100:00100000:1.0:1746142898.561162:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962866976512:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.561163:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.561234:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962866976512:12345-192.168.204.50@tcp:3:cat.0 Request processed in 71us (171us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142898.561239:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3902 00002000:00100000:1.0:1746142898.561244:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1150976->1155071) req@ffff880130121c00 x1830962866976512/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.561250:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121c00 with x1830962866976512 ext(1150976->1155071) 00002000:00010000:1.0:1746142898.561253:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130121c00 00000100:00100000:0.0:1746142898.569060:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.571161:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962866976000:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15233us (16146us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142898.571167:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3900 00002000:00100000:0.0:1746142898.571172:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012e51a300 x1830962866976000/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/440 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.571179:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e51a300 with x1830962866976000 ext(2097152->4194303) 00010000:00010000:0.0:1746142898.571185:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cca897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890f5 expref: 32 pid: 12211 timeout: 772 lvb_type: 1 00010000:00010000:0.0:1746142898.571197:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0200/0x2fa243e067cca897 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890f5 expref: 32 pid: 12211 timeout: 772 lvb_type: 1 00002000:00010000:0.0:1746142898.571202:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e51a300 00000100:00100000:0.0:1746142898.574855:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.574919:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.574950:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866977024 00000100:00100000:1.0:1746142898.574958:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866977024 00002000:00100000:1.0:1746142898.575001:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1781760->1785855) req@ffff880098191880 x1830962866977024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.575010:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191880 with x1830962866977024 ext(1781760->1785855) 00002000:00010000:1.0:1746142898.575019:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098191880 00000100:00100000:1.0:1746142898.575034:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866977280 00000100:00100000:1.0:1746142898.575036:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866977280 00002000:00100000:1.0:1746142898.575051:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880098191c00 x1830962866977280/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.575057:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191c00 with x1830962866977280 ext(4194304->5033983) 00002000:00010000:1.0:1746142898.575061:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191c00 00000100:00100000:1.0:1746142898.576626:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3903 00000100:00100000:1.0:1746142898.576636:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962866977024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.576695:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3904 00000100:00100000:0.0:1746142898.576704:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962866977280:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142898.576758:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962866977024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 123us (1909us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142898.576765:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3903 00002000:00100000:1.0:1746142898.576771:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1781760->1785855) req@ffff880098191880 x1830962866977024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.576779:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191880 with x1830962866977024 ext(1781760->1785855) 00002000:00010000:1.0:1746142898.576782:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098191880 00000100:00100000:1.0:1746142898.576832:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.576939:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866977408 00000100:00100000:1.0:1746142898.576943:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866977408 00000100:00100000:1.0:1746142898.577197:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13338 00000100:00100000:1.0:1746142898.577203:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:31875:x1830962866977408:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142898.577212:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142898.577226:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8910a expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.577242:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142898.577247:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1800/0x2fa243e067cca8a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [4177920->4194303] (req 4177920->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89103 expref: 10 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.577253:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142898.577256:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8910a expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.577286:0:1397:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1800/0x2fa243e067cca8a5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [4177920->4194303] (req 4177920->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89103 expref: 10 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.577296:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8910a expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.577304:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950000, rc 0) 00000100:00100000:1.0:1746142898.577323:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:31875:x1830962866977408:12345-192.168.204.50@tcp:101:cat.0 Request processed in 120us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142898.577325:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.577329:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13338 00000100:00100000:0.0:1746142898.580699:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.580889:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962866977280:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4186us (5987us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746142898.580896:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3904 00002000:00100000:0.0:1746142898.580926:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880098191c00 x1830962866977280/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/440 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.580934:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191c00 with x1830962866977280 ext(4194304->5033983) 00002000:00010000:0.0:1746142898.580937:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191c00 00000100:00100000:1.0:1746142898.582014:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866977792 00000100:00100000:1.0:1746142898.582021:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866977792 00000100:00100000:1.0:1746142898.582048:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5120 00000100:00100000:1.0:1746142898.582055:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:31871:x1830962866977792:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142898.583280:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:31871:x1830962866977792:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 181us (1543us total) trans 8589936311 rc 0/0 00000100:00100000:1.0:1746142898.583288:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5120 00000100:00100000:0.0:1746142898.583929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.588143:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.592743:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.595608:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.596348:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.597944:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.604858:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.613098:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.618689:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.620395:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.621429:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.624657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.624976:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.625000:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866980096 00000100:00100000:0.0:1746142898.625004:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.625006:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866980096 00000100:00100000:1.0:1746142898.625032:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866980224 00000100:00100000:1.0:1746142898.625034:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866980224 00000100:00100000:0.0:1746142898.625098:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13343 00000100:00100000:0.0:1746142898.625103:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962866980352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142898.625109:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142898.625121:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067cca8eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8913b expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.625138:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.625139:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.625145:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067cca8eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8913b expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.625158:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067cca8eb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8913b expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.625166:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3920c00, rc 0) 00000100:00100000:0.0:1746142898.625194:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962866980352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142898.625199:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13343 00000100:00100000:1.0:1746142898.625864:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13344 00000100:00100000:1.0:1746142898.625870:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962866980224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142898.625879:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142898.625887:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131322200/0x2fa243e067cca8f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89134 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142898.625928:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867665280:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142898.626079:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142898.628401:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962866979968:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6531us (6965us total) trans 21474841040 rc 0/0 00000100:00100000:0.0:1746142898.628410:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1216 00002000:00100000:0.0:1746142898.628418:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4935679) req@ffff880130120a80 x1830962866979968/t21474841040(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/448 e 0 to 0 dl 1746142909 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.628426:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120a80 with x1830962866979968 ext(4194304->4935679) 00010000:00010000:0.0:1746142898.628433:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cc600/0x2fa243e067cca8b3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89111 expref: 19 pid: 1854 timeout: 772 lvb_type: 0 00010000:00010000:0.0:1746142898.628444:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cc600/0x2fa243e067cca8b3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4935679) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89111 expref: 19 pid: 1854 timeout: 772 lvb_type: 0 00002000:00010000:0.0:1746142898.628449:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130120a80 00000100:00100000:1.0:1746142898.628924:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867665280:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142898.628939:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131322200/0x2fa243e067cca8f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89134 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142898.628946:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131322200/0x2fa243e067cca8f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89134 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142898.628953:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322200, rc 0) 00000100:00100000:1.0:1746142898.628978:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962866980224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3109us (4003us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142898.628984:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13344 00000100:00100000:0.0:1746142898.633795:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.633837:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.642076:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.642148:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.642172:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866980736 00000100:00100000:1.0:1746142898.642177:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866980736 00002000:00100000:1.0:1746142898.642210:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1150976->1785855) req@ffff880088d7f480 x1830962866980736/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.642219:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7f480 with x1830962866980736 ext(1150976->1785855) 00010000:00010000:1.0:1746142898.642225:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890fc expref: 32 pid: 1397 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.642239:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890fc expref: 32 pid: 1397 timeout: 772 lvb_type: 0 00002000:00010000:1.0:1746142898.642246:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088d7f480 00000100:00100000:1.0:1746142898.642271:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1217 00000100:00100000:1.0:1746142898.642278:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962866980736:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142898.650145:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962866980736:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7860us (8065us total) trans 17179873777 rc 0/0 00000100:00100000:1.0:1746142898.650155:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1217 00002000:00100000:1.0:1746142898.650163:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1150976->1785855) req@ffff880088d7f480 x1830962866980736/t17179873777(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/448 e 0 to 0 dl 1746142909 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.650172:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7f480 with x1830962866980736 ext(1150976->1785855) 00010000:00010000:1.0:1746142898.650181:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890fc expref: 34 pid: 1397 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.650195:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067cca89e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1150976->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890fc expref: 34 pid: 1397 timeout: 772 lvb_type: 0 00002000:00010000:1.0:1746142898.650202:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088d7f480 00000100:00100000:0.0:1746142898.651240:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.653697:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.661103:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.661177:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.661215:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866981632 00000100:00100000:1.0:1746142898.661222:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866981632 00002000:00100000:1.0:1746142898.661255:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088d7f800 x1830962866981632/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.661263:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7f800 with x1830962866981632 ext(1048576->2097151) 00002000:00010000:1.0:1746142898.661273:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7f800 00000100:00100000:1.0:1746142898.661302:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3908 00000100:00100000:1.0:1746142898.661309:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962866981632:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142898.667019:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.667755:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866981888 00000100:00100000:1.0:1746142898.667763:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866981888 00000100:00100000:1.0:1746142898.667797:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5121 00000100:00100000:1.0:1746142898.667804:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:31875:x1830962866981888:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142898.668007:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:31875:x1830962866981888:12345-192.168.204.50@tcp:35:cat.0 Request processed in 203us (995us total) trans 8589936313 rc 0/0 00000100:00100000:1.0:1746142898.668013:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5121 00000100:00100000:1.0:1746142898.670088:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962866981632:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8775us (8906us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142898.670096:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3908 00002000:00100000:1.0:1746142898.670105:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088d7f800 x1830962866981632/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/440 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.670114:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7f800 with x1830962866981632 ext(1048576->2097151) 00002000:00010000:1.0:1746142898.670119:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7f800 00000100:00100000:0.0:1746142898.684409:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.684513:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866982144 00000100:00100000:1.0:1746142898.684521:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866982144 00002000:00100000:1.0:1746142898.684557:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880088d7ed80 x1830962866982144/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.684566:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ed80 with x1830962866982144 ext(2097152->3145727) 00002000:00010000:1.0:1746142898.684571:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7ed80 00000100:00100000:1.0:1746142898.684607:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3909 00000100:00100000:1.0:1746142898.684613:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962866982144:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142898.689758:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962866982144:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5138us (5350us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142898.689767:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3909 00002000:00100000:1.0:1746142898.689777:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880088d7ed80 x1830962866982144/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:49/0 lens 488/440 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142898.689785:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ed80 with x1830962866982144 ext(2097152->3145727) 00002000:00010000:1.0:1746142898.689790:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7ed80 00000100:00100000:0.0:1746142898.692676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.696816:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.696861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.713266:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.727810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.727925:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866983296 00000100:00100000:1.0:1746142898.727933:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866983296 00000100:00100000:1.0:1746142898.727967:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5122 00000100:00100000:1.0:1746142898.727974:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:31881:x1830962866983296:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142898.728208:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:31881:x1830962866983296:12345-192.168.204.50@tcp:35:cat.0 Request processed in 233us (403us total) trans 8589936314 rc 0/0 00000100:00100000:1.0:1746142898.728215:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5122 00000100:00100000:0.0:1746142898.735394:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.738997:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.739637:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.787998:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.792313:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.793330:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.793494:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.794241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.794312:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866984576 00000100:00100000:1.0:1746142898.794316:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866984576 00010000:00010000:1.0:1746142898.794329:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0800/0x2fa243e067cca7b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89077 expref: 27 pid: 1852 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746142898.794352:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5879 00000100:00100000:1.0:1746142898.794357:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962866984576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142898.794363:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142898.794371:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0800/0x2fa243e067cca7b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89077 expref: 27 pid: 1852 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.794379:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0800/0x2fa243e067cca7b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89077 expref: 27 pid: 1852 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.794390:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0800/0x2fa243e067cca7b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89077 expref: 27 pid: 1852 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.794405:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142898.794407:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142898.794412:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067cca93f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89165 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.794419:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067cca93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89165 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.794616:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067cca93f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2887680->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89165 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142898.794627:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867666432:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142898.794689:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746142898.796029:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867666432:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142898.796041:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142898.796072:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2003:x1830962866984576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1715us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.796078:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5879 00000100:00100000:0.0:1746142898.796853:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.803060:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.805844:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.810168:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.810252:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.810310:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866985472 00000100:00100000:1.0:1746142898.810314:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866985472 00010000:00010000:1.0:1746142898.810334:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8910a expref: 34 pid: 1397 timeout: 772 lvb_type: 0 00000100:00100000:1.0:1746142898.810359:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5881 00000100:00100000:1.0:1746142898.810364:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962866985472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142898.810370:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142898.810388:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8910a expref: 34 pid: 1397 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.810402:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8910a expref: 34 pid: 1397 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.810424:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d950000/0x2fa243e067cca8ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8910a expref: 34 pid: 1397 timeout: 772 lvb_type: 0 00010000:00010000:1.0:1746142898.810446:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142898.810461:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962866985472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.810466:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5881 00000100:00100000:0.0:1746142898.813060:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.816666:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846394:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846457:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846512:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846562:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846599:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846624:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846661:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.846691:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866986752 00000100:00100000:0.0:1746142898.846699:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866986752 00000100:00100000:0.0:1746142898.846741:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866986624 00000100:00100000:0.0:1746142898.846744:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866986624 00000100:00100000:0.0:1746142898.846777:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 541 00000100:00100000:0.0:1746142898.846786:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962866986752:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142898.846852:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962866986752:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.847279:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 864 00000100:00100000:1.0:1746142898.847289:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962866986112:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1746142898.847326:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962866986112:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 38us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.847332:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 864 00000100:00100000:1.0:1746142898.847347:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 865 00000100:00100000:1.0:1746142898.847354:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962866986368:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1746142898.847391:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962866986368:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 36us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.847396:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 865 00000100:00100000:0.0:1746142898.847620:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 541 00000100:00100000:0.0:1746142898.850517:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.856488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.866133:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.866182:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.894409:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.895624:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.904942:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.905003:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866988288 00000100:00100000:1.0:1746142898.905010:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866988288 00000100:00100000:1.0:1746142898.905054:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 727 00000100:00100000:1.0:1746142898.905060:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962866988288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142898.905074:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142898.905092:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093379600/0x2fa243e067cca9a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89181 expref: 37 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142898.905208:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142898.905214:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142898.905249:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962866988288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 186us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.905255:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 727 00000100:00100000:0.0:1746142898.906301:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.906368:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.912633:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.912732:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866988800 00000100:00100000:1.0:1746142898.912741:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866988800 00000100:00100000:1.0:1746142898.912786:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5124 00000100:00100000:1.0:1746142898.912796:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:31891:x1830962866988800:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142898.912981:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:31891:x1830962866988800:12345-192.168.204.50@tcp:35:cat.0 Request processed in 185us (352us total) trans 8589936320 rc 0/0 00000100:00100000:1.0:1746142898.912988:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5124 00000100:00100000:0.0:1746142898.921285:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.936940:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.937360:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.944182:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.946760:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.953805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.955459:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.958110:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.959045:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.959064:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866990080 00000100:00100000:1.0:1746142898.959068:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866990080 00010000:00010000:1.0:1746142898.959081:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fb3 expref: 12 pid: 9580 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746142898.959106:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5884 00000100:00100000:1.0:1746142898.959111:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962866990080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142898.959118:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142898.959126:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fb3 expref: 12 pid: 9580 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.959133:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fb3 expref: 12 pid: 9580 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.959144:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cca659 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fb3 expref: 12 pid: 9580 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.959159:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142898.959177:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962866990080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.959182:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5884 00000100:00100000:0.0:1746142898.959666:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.961036:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.961543:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.961601:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866990720 00000100:00100000:0.0:1746142898.961605:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866990720 00002000:00100000:0.0:1746142898.961623:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (913408->917503) req@ffff880130122300 x1830962866990720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/0 e 0 to 0 dl 1746142909 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.961631:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130122300 with x1830962866990720 ext(913408->917503) 00002000:00010000:0.0:1746142898.961634:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130122300 00000100:00100000:0.0:1746142898.961657:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3920 00000100:00100000:0.0:1746142898.961662:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962866990720:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142898.961729:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962866990720:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 67us (186us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142898.961735:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3920 00002000:00100000:0.0:1746142898.961739:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (913408->917503) req@ffff880130122300 x1830962866990720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:49/0 lens 488/4536 e 0 to 0 dl 1746142909 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142898.961745:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130122300 with x1830962866990720 ext(913408->917503) 00002000:00010000:0.0:1746142898.961748:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130122300 00000100:00100000:0.0:1746142898.967499:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866990848 00000100:00100000:0.0:1746142898.967508:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866990848 00000100:00100000:0.0:1746142898.967620:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13357 00000100:00100000:0.0:1746142898.967628:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:31887:x1830962866990848:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142898.967642:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142898.967656:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067cca9e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb891b2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.967679:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.967691:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009495c400/0x2fa243e067cca771 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8903f expref: 34 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.967698:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.967703:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.967705:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142898.967707:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067cca9e0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1839103] (req 1048576->1839103) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b2 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142898.967729:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.967738:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 13 pid: 9579 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746142898.967746:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867668224:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142898.967824:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009495c400/0x2fa243e067cca771 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8903f expref: 34 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.967831:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009495c400/0x2fa243e067cca771 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8903f expref: 34 pid: 11421 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746142898.967839:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867668352:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142898.967865:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142898.967873:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 13 pid: 1854 timeout: 772 lvb_type: 1 00000100:00100000:0.0:1746142898.967879:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867668480:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142898.967891:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd3a540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142898.972024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.972053:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.972091:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866991104 00000100:00100000:1.0:1746142898.972097:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866991104 00010000:00010000:1.0:1746142898.972119:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 14 pid: 1854 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746142898.972136:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866990976 00000100:00100000:1.0:1746142898.972139:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866990976 00010000:00010000:1.0:1746142898.972146:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 14 pid: 9579 timeout: 772 lvb_type: 1 00000100:00100000:1.0:1746142898.972174:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5886 00000100:00100000:1.0:1746142898.972180:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962866991104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142898.972193:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142898.972210:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 14 pid: 1854 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.972219:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 14 pid: 1854 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.972235:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067cca652 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fba expref: 14 pid: 1854 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.972258:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142898.972279:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962866991104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.972285:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5886 00000100:00100000:1.0:1746142898.972318:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5887 00000100:00100000:1.0:1746142898.972323:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962866990976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142898.972329:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142898.972335:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 14 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.972347:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 14 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.972357:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067cca683 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb88fe4 expref: 14 pid: 9579 timeout: 772 lvb_type: 1 00010000:00010000:1.0:1746142898.972364:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142898.972378:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962866990976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 55us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142898.972383:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5887 00000100:00100000:0.0:1746142898.972999:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.975280:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.979163:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.984415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.986846:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142898.991592:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142898.991647:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866992128 00000100:00100000:1.0:1746142898.991654:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866992128 00000100:00100000:1.0:1746142898.991691:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5125 00000100:00100000:1.0:1746142898.991697:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:31887:x1830962866992128:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142898.991852:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d7e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:31887:x1830962866992128:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 154us (274us total) trans 8589936321 rc 0/0 00000100:00100000:1.0:1746142898.991858:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5125 00000100:00100000:0.0:1746142899.000964:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.001560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.001745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.001798:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866992768 00000100:00100000:0.0:1746142899.001801:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866992768 00002000:00100000:0.0:1746142899.001816:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800938d1500 x1830962866992768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.001822:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d1500 with x1830962866992768 ext(3145728->4194303) 00002000:00010000:0.0:1746142899.001825:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d1500 00000100:00100000:0.0:1746142899.001849:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3923 00000100:00100000:0.0:1746142899.001854:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962866992768:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142899.004196:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.009128:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.009545:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962866992768:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7691us (7799us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142899.009556:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3923 00002000:00100000:0.0:1746142899.009563:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800938d1500 x1830962866992768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.009570:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d1500 with x1830962866992768 ext(3145728->4194303) 00002000:00010000:0.0:1746142899.009574:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d1500 00000100:00100000:1.0:1746142899.023178:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.023209:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.023222:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.023535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.024470:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.029023:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.031265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142899.034092:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.034100:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142899.034114:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142899.034207:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800987ffe00/0x2fa243e067ccaa2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891ea expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.034233:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891ea expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.034239:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142899.034242:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142899.034244:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800987fe200, rc 0) 00000100:00100000:0.0:1746142899.034267:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:31896:x1830962866994048:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4997us (5250us total) trans 8589936323 rc 0/0 00000100:00100000:0.0:1746142899.034274:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14224 00000100:00100000:0.0:1746142899.034322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.038167:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866994816 00000100:00100000:0.0:1746142899.038175:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866994816 00000100:00100000:0.0:1746142899.038237:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14225 00000100:00100000:0.0:1746142899.038244:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:31901:x1830962866994816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142899.038263:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.038278:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067ccaa42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb891f8 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.038344:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038359:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038368:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038383:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038388:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038393:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038486:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3600/0x2fa243e067ccaa57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038495:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3600/0x2fa243e067ccaa57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038501:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3600/0x2fa243e067ccaa57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142899.038509:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142899.038594:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038599:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038603:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038608:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038612:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc3200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142899.038614:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038618:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038625:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142899.038626:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142899.038628:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038631:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccaa49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038637:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038640:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038646:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038648:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc3a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142899.038649:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038652:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038654:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4600) 00010000:00010000:0.0:1746142899.038655:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142899.038656:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038659:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccaa50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.038681:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067ccaa42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891f8 expref: 25 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.038687:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3600/0x2fa243e067ccaa57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891f8 expref: 24 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.038696:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142899.038697:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142899.038698:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3600, rc 0) 00000100:00100000:0.0:1746142899.038731:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:31901:x1830962866994816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 489us (1352us total) trans 8589936324 rc 0/0 00000100:00100000:0.0:1746142899.038735:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14225 00000100:00100000:0.0:1746142899.038788:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.038921:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866994560 00000100:00100000:1.0:1746142899.038925:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866994560 00000100:00100000:1.0:1746142899.038956:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14226 00000100:00100000:1.0:1746142899.038962:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:31896:x1830962866994560:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142899.038987:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142899.038995:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccaa65 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb891f1 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.039033:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142899.039042:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891ea expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.039048:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142899.039070:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891ea expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.039078:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891ea expref: 14 pid: 7230 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.039088:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867669504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142899.039456:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00010000:00010000:1.0:1746142899.044671:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe200/0x2fa243e067ccaa34 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891ea expref: 14 pid: 7230 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.044692:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867669504:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142899.044705:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142899.044712:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142899.044716:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:1.0:1746142899.044754:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142899.044758:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142899.044770:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142899.044793:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccaa65 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891f1 expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.044804:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fc00/0x2fa243e067ccaa6c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891f1 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.044810:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142899.044812:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142899.044814:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471fc00, rc 0) 00000100:00100000:1.0:1746142899.044836:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:31896:x1830962866994560:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5874us (6047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.044842:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14226 00000100:00100000:1.0:1746142899.045980:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.046094:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.046101:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866995840 00000100:00100000:0.0:1746142899.046105:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866995840 00000100:00100000:1.0:1746142899.046117:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.046128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.046128:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14227 00000100:00100000:0.0:1746142899.046136:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:31902:x1830962866995840:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:1.0:1746142899.046155:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.046457:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866995456 00000100:00100000:0.0:1746142899.046461:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866995456 00000100:00100000:1.0:1746142899.046464:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866995584 00000100:00100000:1.0:1746142899.046467:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866995584 00000100:00100000:1.0:1746142899.046796:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13365 00000100:00100000:1.0:1746142899.046805:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962866995328:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142899.046813:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142899.046814:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13366 00000100:00100000:0.0:1746142899.046821:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962866995584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142899.046822:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccaa7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89206 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.046828:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.046835:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc3800/0x2fa243e067ccaa81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89214 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.046846:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.046848:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.046854:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3800/0x2fa243e067ccaa81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89214 expref: 17 pid: 12211 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142899.046861:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867669760:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142899.046865:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3800/0x2fa243e067ccaa81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89214 expref: 17 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.046872:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3800, rc 0) 00000100:00100000:1.0:1746142899.046882:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.046889:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962866995584:12345-192.168.204.50@tcp:101:cat.0 Request processed in 69us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.046895:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13366 00000100:00100000:1.0:1746142899.046924:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13367 00010000:00010000:0.0:1746142899.046937:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142899.046944:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962866995456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142899.046945:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3e00/0x2fa243e067ccaa88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8921b expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.046950:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142899.046956:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471fe00/0x2fa243e067ccaa8f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8920d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.046966:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.046967:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.046971:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471fe00/0x2fa243e067ccaa8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8920d expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.046980:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471fe00/0x2fa243e067ccaa8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8920d expref: 19 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.046990:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471fe00, rc 0) 00000100:00100000:1.0:1746142899.047006:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962866995456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 76us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.047011:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13367 00000100:00100000:1.0:1746142899.047092:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.047120:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142899.047879:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.047889:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048015:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048029:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048035:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048041:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048471:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048480:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048486:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142899.048493:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142899.048765:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048771:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048779:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048784:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048789:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc2000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142899.048792:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048798:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048806:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142899.048809:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142899.048811:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048815:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2000/0x2fa243e067ccaaa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048823:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048827:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048831:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048834:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc2800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142899.048836:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048844:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142899.048849:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4f00) 00010000:00010000:0.0:1746142899.048851:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142899.048853:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00000100:00100000:1.0:1746142899.048855:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867669760:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142899.048857:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2800/0x2fa243e067ccaaab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142899.048873:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccaa7a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89206 expref: 16 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.048881:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccaa7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89206 expref: 16 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.048884:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3e00/0x2fa243e067ccaa88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8921b expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.048888:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ec00, rc 0) 00010000:00010000:0.0:1746142899.048894:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8921b expref: 25 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.048914:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142899.048917:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142899.048918:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2a00, rc 0) 00000100:00100000:1.0:1746142899.048923:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962866995328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2119us (2804us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142899.048930:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13365 00000100:00100000:0.0:1746142899.049082:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:31902:x1830962866995840:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2946us (3087us total) trans 8589936325 rc 0/0 00000100:00100000:0.0:1746142899.049088:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14227 00000100:00100000:1.0:1746142899.049170:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.049191:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866996352 00000100:00100000:0.0:1746142899.049195:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866996352 00000100:00080000:1.0:1746142899.049214:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142899.049220:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5127 00000100:00100000:0.0:1746142899.049226:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:31894:x1830962866996352:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142899.049294:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:31894:x1830962866996352:12345-192.168.204.50@tcp:35:cat.0 Request processed in 67us (124us total) trans 8589936326 rc 0/0 00000100:00100000:0.0:1746142899.049300:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5127 00000100:00100000:0.0:1746142899.054119:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.054854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.057345:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.059055:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.066321:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.072854:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.091961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.098048:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.107211:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962866997760:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8858us (9162us total) trans 17179873779 rc 0/0 00000100:00100000:0.0:1746142899.107220:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1221 00002000:00100000:0.0:1746142899.107228:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1839103) req@ffff880093bcd500 x1830962866997760/t17179873779(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/448 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.107237:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd500 with x1830962866997760 ext(1048576->1839103) 00010000:00010000:0.0:1746142899.107245:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067cca9e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b2 expref: 36 pid: 1854 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.107256:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067cca9e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1839103) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b2 expref: 36 pid: 1854 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746142899.107262:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bcd500 00000100:00100000:0.0:1746142899.110645:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.115615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:1.0:1746142899.120627:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142899.126717:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.129656:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.131244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.132324:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.139173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.139218:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.139300:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866999040 00000100:00100000:1.0:1746142899.139307:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866999040 00002000:00100000:1.0:1746142899.139686:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800968ea680 x1830962866999040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.139694:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea680 with x1830962866999040 ext(2097152->4194303) 00002000:00010000:1.0:1746142899.139699:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea680 00000100:00100000:1.0:1746142899.139712:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3928 00000100:00100000:1.0:1746142899.139717:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962866999040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.153372:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962866999040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13645us (14197us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142899.153382:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3928 00002000:00100000:1.0:1746142899.153392:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800968ea680 x1830962866999040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.153400:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea680 with x1830962866999040 ext(2097152->4194303) 00002000:00010000:1.0:1746142899.153405:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea680 00000100:00100000:0.0:1746142899.158466:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.162795:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.162829:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.162862:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.162934:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962866999680 00000100:00100000:1.0:1746142899.162937:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962866999680 00010000:00010000:1.0:1746142899.162949:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cca9d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891a4 expref: 27 pid: 1854 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746142899.162987:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5900 00000100:00100000:0.0:1746142899.162992:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962866999552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.162998:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.163005:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccaa1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891dc expref: 11 pid: 1854 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.163044:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccaa1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891dc expref: 11 pid: 1854 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.163173:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccaa1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891dc expref: 11 pid: 1854 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.163240:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.163242:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.163248:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccaae3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8924c expref: 17 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.163255:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccaae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8924c expref: 17 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.163287:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccaae3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8924c expref: 17 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.163298:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867671680:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142899.163341:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142899.163343:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.167607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.167658:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867000064 00000100:00100000:1.0:1746142899.167666:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867000064 00002000:00100000:1.0:1746142899.167698:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2154496->2158591) req@ffff8800968e9880 x1830962867000064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.167709:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9880 with x1830962867000064 ext(2154496->2158591) 00002000:00010000:1.0:1746142899.167713:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968e9880 00000100:00100000:1.0:1746142899.167743:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3929 00000100:00100000:1.0:1746142899.167750:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867000064:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.167863:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867000064:12345-192.168.204.50@tcp:3:cat.0 Request processed in 114us (262us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142899.167869:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3929 00002000:00100000:1.0:1746142899.167874:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2154496->2158591) req@ffff8800968e9880 x1830962867000064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.167881:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9880 with x1830962867000064 ext(2154496->2158591) 00002000:00010000:1.0:1746142899.167883:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968e9880 00000100:00100000:0.0:1746142899.169975:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.170001:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867000320 00000100:00100000:1.0:1746142899.170007:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867000320 00000100:00100000:1.0:1746142899.170134:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5129 00000100:00100000:1.0:1746142899.170140:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:31902:x1830962867000320:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142899.170301:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:31902:x1830962867000320:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 161us (329us total) trans 8589936328 rc 0/0 00000100:00100000:1.0:1746142899.170308:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5129 00000100:00100000:0.0:1746142899.171138:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.171311:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.180077:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.180864:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.180941:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.180977:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.181099:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13377 00000100:00100000:0.0:1746142899.181106:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867001344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142899.181113:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.181120:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009397b600/0x2fa243e067ccab22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89276 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.181155:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867671936:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142899.181198:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.184081:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.187824:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.187890:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.188000:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867001856 00000100:00100000:1.0:1746142899.188010:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867001856 00002000:00100000:1.0:1746142899.188042:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800968ea300 x1830962867001856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.188270:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea300 with x1830962867001856 ext(0->1048575) 00002000:00010000:1.0:1746142899.188274:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea300 00000100:00100000:1.0:1746142899.188288:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3932 00000100:00100000:1.0:1746142899.188294:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867001856:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.203268:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867001856:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14965us (15447us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142899.203279:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3932 00002000:00100000:1.0:1746142899.203289:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800968ea300 x1830962867001856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.203298:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea300 with x1830962867001856 ext(0->1048575) 00002000:00010000:1.0:1746142899.203303:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea300 00000100:00100000:0.0:1746142899.213211:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.220249:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.220273:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867002624 00000100:00100000:1.0:1746142899.220280:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867002624 00002000:00100000:1.0:1746142899.220317:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1400832->2097151) req@ffff88009809ce00 x1830962867002624/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.220326:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ce00 with x1830962867002624 ext(1400832->2097151) 00010000:00010000:1.0:1746142899.220334:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800987ffe00/0x2fa243e067ccaadc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89245 expref: 18 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.220347:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800987ffe00/0x2fa243e067ccaadc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89245 expref: 18 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.220353:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809ce00 00000100:00100000:1.0:1746142899.220372:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1222 00000100:00100000:1.0:1746142899.220379:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867002624:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142899.224994:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.226996:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5902 00000100:00100000:0.0:1746142899.227003:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867002880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.227010:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.227014:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8921b expref: 27 pid: 7230 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.227021:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8921b expref: 27 pid: 7230 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.227033:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccaab2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8921b expref: 27 pid: 7230 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.227045:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142899.227048:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccab3e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142899.227054:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccab3e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142899.227058:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142899.227073:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867002880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.227117:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5902 00000100:00100000:1.0:1746142899.229036:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867002624:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8652us (8790us total) trans 21474841043 rc 0/0 00000100:00100000:1.0:1746142899.229045:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1222 00002000:00100000:1.0:1746142899.229053:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1400832->2097151) req@ffff88009809ce00 x1830962867002624/t21474841043(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/448 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.229061:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ce00 with x1830962867002624 ext(1400832->2097151) 00010000:00010000:1.0:1746142899.229069:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800987ffe00/0x2fa243e067ccaadc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89245 expref: 20 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.229080:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800987ffe00/0x2fa243e067ccaadc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89245 expref: 20 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.229086:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809ce00 00000100:00100000:0.0:1746142899.233082:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.237558:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.237609:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867003392 00000100:00100000:1.0:1746142899.237615:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867003392 00002000:00100000:1.0:1746142899.237643:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dbf6300 x1830962867003392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.237651:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6300 with x1830962867003392 ext(1048576->2097151) 00002000:00010000:1.0:1746142899.237655:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf6300 00000100:00100000:1.0:1746142899.237682:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3933 00000100:00100000:1.0:1746142899.237688:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867003392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.246698:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.248626:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.253893:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.258093:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.259104:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.263481:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.263973:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.265324:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.271455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.271988:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.272240:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3937 00000100:00100000:1.0:1746142899.272248:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867005184:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.276110:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867005184:12345-192.168.204.50@tcp:3:cat.0 Request processed in 3855us (4114us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142899.276119:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3937 00002000:00100000:1.0:1746142899.276138:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012dbf4a80 x1830962867005184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.276147:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4a80 with x1830962867005184 ext(4194304->5033983) 00002000:00010000:1.0:1746142899.276152:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4a80 00000100:00100000:0.0:1746142899.280506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.281024:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867005440 00000100:00100000:1.0:1746142899.281033:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867005440 00000100:00100000:1.0:1746142899.281133:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5131 00000100:00100000:1.0:1746142899.281140:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d7e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:31908:x1830962867005440:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142899.281612:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d7e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:31908:x1830962867005440:12345-192.168.204.50@tcp:35:cat.0 Request processed in 471us (1111us total) trans 8589936332 rc 0/0 00000100:00100000:1.0:1746142899.281618:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5131 00000100:00100000:0.0:1746142899.288692:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.292725:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.299542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.306784:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.306819:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.306840:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.306873:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.306918:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867006336 00000100:00100000:0.0:1746142899.306925:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867006336 00000100:00100000:0.0:1746142899.306951:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867006464 00000100:00100000:0.0:1746142899.306953:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867006464 00000100:00100000:0.0:1746142899.306962:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867006592 00000100:00100000:0.0:1746142899.306963:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867006592 00000100:00100000:0.0:1746142899.306973:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13382 00000100:00100000:0.0:1746142899.306979:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867006336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142899.306991:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.307003:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74800/0x2fa243e067ccaba0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb892a7 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.307037:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867673472:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142899.307088:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.312135:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.313824:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.313865:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867006848 00000100:00100000:1.0:1746142899.313869:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867006848 00002000:00100000:1.0:1746142899.313894:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (466944->942079) req@ffff880088fd9880 x1830962867006848/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.313939:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9880 with x1830962867006848 ext(466944->942079) 00010000:00010000:1.0:1746142899.313945:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccab53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 466944->942079) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89292 expref: 29 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.313955:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccab53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 466944->942079) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89292 expref: 29 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.313960:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd9880 00000100:00100000:1.0:1746142899.313976:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1224 00000100:00100000:1.0:1746142899.313982:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867006848:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142899.318092:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867006848:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4103us (4261us total) trans 21474841045 rc 0/0 00000100:00100000:1.0:1746142899.318273:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1224 00002000:00100000:1.0:1746142899.318283:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (466944->942079) req@ffff880088fd9880 x1830962867006848/t21474841045(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/448 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.318297:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9880 with x1830962867006848 ext(466944->942079) 00010000:00010000:1.0:1746142899.318307:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccab53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 466944->942079) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89292 expref: 31 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.318319:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccab53 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 466944->942079) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89292 expref: 31 pid: 1853 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.318325:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd9880 00000100:00100000:0.0:1746142899.321600:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.329879:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.329968:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.330020:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867007360 00000100:00100000:1.0:1746142899.330027:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867007360 00002000:00100000:1.0:1746142899.330061:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088fdbb80 x1830962867007360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.330070:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdbb80 with x1830962867007360 ext(1048576->2097151) 00002000:00010000:1.0:1746142899.330074:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdbb80 00000100:00100000:1.0:1746142899.330105:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3938 00000100:00100000:1.0:1746142899.330111:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867007360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.344071:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867007360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13959us (14195us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142899.344078:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3938 00002000:00100000:0.0:1746142899.344084:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088fdbb80 x1830962867007360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.344091:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdbb80 with x1830962867007360 ext(1048576->2097151) 00002000:00010000:0.0:1746142899.344095:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdbb80 00000100:00100000:0.0:1746142899.364862:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.378949:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.381158:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.381397:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867008128 00000100:00100000:1.0:1746142899.381401:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867008128 00000100:00100000:1.0:1746142899.381436:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5132 00000100:00100000:1.0:1746142899.381443:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:27292:x1830962867008128:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142899.381597:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:27292:x1830962867008128:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 153us (439us total) trans 8589936335 rc 0/0 00000100:00100000:1.0:1746142899.381603:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5132 00000100:00100000:0.0:1746142899.383448:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.390664:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.393809:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.393835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.393853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.393887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.393920:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13386 00000100:00100000:0.0:1746142899.393928:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867008640:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142899.393938:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.393952:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb892ca expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.393980:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.393982:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.393991:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ca expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.394005:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ca expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.394013:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092131600, rc 0) 00000100:00100000:0.0:1746142899.394041:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867008640:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 113us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.394046:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13386 00000100:00100000:0.0:1746142899.394058:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13388 00000100:00100000:0.0:1746142899.394063:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867008896:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142899.394068:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.394074:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092130600/0x2fa243e067ccabe6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb892d8 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.394084:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.394085:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.394089:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092130600/0x2fa243e067ccabe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d8 expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.394095:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092130600/0x2fa243e067ccabe6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d8 expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.394105:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092130600, rc 0) 00000100:00100000:0.0:1746142899.394119:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867008896:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.394124:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13388 00000100:00100000:0.0:1746142899.399661:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.399707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.399828:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14235 00000100:00100000:0.0:1746142899.399835:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:31920:x1830962867009536:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142899.399844:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.399852:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092131200/0x2fa243e067ccabfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb892ed expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.399934:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccac09 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142899.399944:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fea000/0x2fa243e067ccabd1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892c3 expref: 15 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.399951:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccac09 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142899.399971:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091fea000/0x2fa243e067ccabd1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892c3 expref: 15 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.399980:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fea000/0x2fa243e067ccabd1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892c3 expref: 15 pid: 7230 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746142899.399994:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867674112:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142899.400171:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.403212:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.404342:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867009920 00000100:00100000:1.0:1746142899.404347:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867009920 00000100:00100000:1.0:1746142899.404369:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13390 00000100:00100000:1.0:1746142899.404375:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867009920:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142899.404386:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142899.404397:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a969a00/0x2fa243e067ccac2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb892f4 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.404412:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.404414:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.404421:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a969a00/0x2fa243e067ccac2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892f4 expref: 31 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.404433:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a969a00/0x2fa243e067ccac2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892f4 expref: 31 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.404441:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a969a00, rc 0) 00000100:00100000:1.0:1746142899.404460:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867009920:12345-192.168.204.50@tcp:101:cat.0 Request processed in 86us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.404465:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13390 00000100:00100000:0.0:1746142899.408202:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3763:1830962867674240:0@lo:400:kworker.0 00000100:00100000:0.0:1746142899.408252:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142899.408545:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3763:1830962867674240:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409214:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3763:1830962867674752:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409242:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142899.409257:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867675264:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409274:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142899.409288:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746142899.409292:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867674624:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409305:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142899.409316:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3763:1830962867675136:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409329:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142899.409357:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867675264 00000100:00100000:1.0:1746142899.409361:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867675264 00000100:00100000:1.0:1746142899.409385:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867674624 00000100:00100000:1.0:1746142899.409387:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867674624 00000100:00100000:0.0:1746142899.409733:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1746142899.409740:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830962867675008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409786:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1746142899.409791:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3763:x1830962867674624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409814:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3763:x1830962867674624:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.409818:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00080000:1.0:1746142899.409830:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746142899.409935:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746142899.409938:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746142899.409940:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746142899.409960:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867674624:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409967:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3763:1830962867675136:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409973:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3763:1830962867674752:0@lo:400:kworker.0 00000100:00100000:1.0:1746142899.409980:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867675264:0@lo:400:kworker.0 00000100:00100000:0.0:1746142899.410336:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830962867675008:12345-0@lo:400:kworker.0 Request processed in 597us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.410342:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1746142899.410455:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.410493:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.410517:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867010432 00000100:00100000:1.0:1746142899.410520:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867010432 00000100:00100000:1.0:1746142899.411028:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5133 00000100:00100000:1.0:1746142899.411034:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+28:31919:x1830962867010432:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142899.411435:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:31919:x1830962867010432:12345-192.168.204.50@tcp:35:cat.0 Request processed in 400us (941us total) trans 8589936338 rc 0/0 00000100:00100000:1.0:1746142899.411497:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5133 00000100:00100000:1.0:1746142899.414204:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.414250:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.432846:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.439248:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.439287:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.441103:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.441118:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867011456 00000100:00100000:0.0:1746142899.441120:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867011456 00010000:00010000:0.0:1746142899.441134:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccabae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892b5 expref: 23 pid: 1853 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746142899.441159:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5912 00000100:00100000:0.0:1746142899.441163:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867011456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.441170:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.441178:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccabae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892b5 expref: 23 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.441185:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccabae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892b5 expref: 23 pid: 1853 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.441196:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccabae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892b5 expref: 23 pid: 1853 timeout: 773 lvb_type: 1 00000100:00100000:1.0:1746142899.441357:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.441378:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867011584 00000100:00100000:1.0:1746142899.441381:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867011584 00010000:00010000:1.0:1746142899.441391:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccab4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8928b expref: 32 pid: 1853 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.441414:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5913 00000100:00100000:1.0:1746142899.441419:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867011584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.441426:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.441432:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccab4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8928b expref: 32 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.441440:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccab4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8928b expref: 32 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.441451:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccab4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8928b expref: 32 pid: 1853 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.441462:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.441463:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.441468:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.441475:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.441493:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.441503:0:7219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 22 pid: 11943 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.441512:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867676160:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142899.441555:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03480 going to sleep for 11 seconds 00010000:00010000:0.0:1746142899.441600:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142899.441616:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867011456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 452us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.441621:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5912 00000100:00100000:1.0:1746142899.445824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.456678:0:9266:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867676288 00000100:00100000:0.0:1746142899.456685:0:9266:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867676288 00000100:00100000:0.0:1746142899.456717:0:9266:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1746142899.456723:0:9266:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867676288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746142899.456746:0:9266:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445654528 avail 1316192256 00000100:00100000:1.0:1746142899.459075:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.459632:0:9266:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867676288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2906us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.459640:0:9266:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1746142899.465352:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.465827:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.465930:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867012608 00000100:00100000:1.0:1746142899.465934:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867012608 00002000:00100000:1.0:1746142899.465960:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2117632->3088383) req@ffff880088fdad80 x1830962867012608/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.465968:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdad80 with x1830962867012608 ext(2117632->3088383) 00010000:00010000:1.0:1746142899.465975:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 22 pid: 11943 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.465986:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 22 pid: 11943 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.465991:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fdad80 00000100:00100000:1.0:1746142899.466004:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1227 00000100:00100000:1.0:1746142899.466008:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867012608:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142899.476681:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867012608:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 10662us (10844us total) trans 21474841046 rc 0/0 00000100:00100000:1.0:1746142899.476693:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1227 00002000:00100000:1.0:1746142899.476704:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2117632->3088383) req@ffff880088fdad80 x1830962867012608/t21474841046(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/448 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.476712:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdad80 with x1830962867012608 ext(2117632->3088383) 00010000:00010000:1.0:1746142899.476721:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 24 pid: 11943 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.476735:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccac41 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2117632->3088383) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89302 expref: 24 pid: 11943 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.476742:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fdad80 00000100:00100000:0.0:1746142899.480432:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.495738:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.495951:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867012992 00000100:00100000:1.0:1746142899.495960:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867012992 00002000:00100000:1.0:1746142899.495997:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880088fd9180 x1830962867012992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.496006:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9180 with x1830962867012992 ext(2097152->4194303) 00002000:00010000:1.0:1746142899.496011:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd9180 00000100:00100000:1.0:1746142899.496045:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3943 00000100:00100000:1.0:1746142899.496052:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867012992:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.507697:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.516845:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867012992:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20786us (21107us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142899.516855:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3943 00002000:00100000:1.0:1746142899.516865:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880088fd9180 x1830962867012992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.516874:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9180 with x1830962867012992 ext(2097152->4194303) 00002000:00010000:1.0:1746142899.516879:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd9180 00000100:00100000:0.0:1746142899.528589:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.528663:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867013504 00000100:00100000:1.0:1746142899.528669:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867013504 00002000:00100000:1.0:1746142899.528705:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092137800 x1830962867013504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.528715:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137800 with x1830962867013504 ext(4194304->5033983) 00002000:00010000:1.0:1746142899.528719:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137800 00000100:00100000:1.0:1746142899.528750:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3944 00000100:00100000:1.0:1746142899.528757:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2003:x1830962867013504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.535388:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2003:x1830962867013504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6623us (6811us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142899.535398:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3944 00002000:00100000:1.0:1746142899.535407:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092137800 x1830962867013504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.535416:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137800 with x1830962867013504 ext(4194304->5033983) 00002000:00010000:1.0:1746142899.535420:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137800 00000100:00100000:0.0:1746142899.536704:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.546025:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.551310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.573734:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.574289:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867014400 00000100:00100000:1.0:1746142899.574297:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867014400 00002000:00100000:1.0:1746142899.574331:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880092134700 x1830962867014400/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.574341:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134700 with x1830962867014400 ext(2097152->4194303) 00002000:00010000:1.0:1746142899.574346:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092134700 00000100:00100000:1.0:1746142899.574378:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3945 00000100:00100000:1.0:1746142899.574386:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867014400:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.591467:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.596711:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867014400:12345-192.168.204.50@tcp:3:cat.0 Request processed in 22322us (22980us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142899.596722:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3945 00002000:00100000:0.0:1746142899.597658:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880092134700 x1830962867014400/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.597669:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134700 with x1830962867014400 ext(2097152->4194303) 00002000:00010000:0.0:1746142899.597674:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092134700 00000100:00100000:0.0:1746142899.606648:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.606799:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.608138:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.608150:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867015168 00000100:00100000:0.0:1746142899.608153:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867015168 00010000:00010000:0.0:1746142899.608166:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccac64 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89310 expref: 46 pid: 10924 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746142899.608180:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5916 00000100:00100000:0.0:1746142899.608185:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867015168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.608192:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.608195:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccac64 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89310 expref: 46 pid: 10924 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.608325:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccac64 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89310 expref: 46 pid: 10924 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.608340:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142899.608344:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccaca3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142899.608351:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccaca3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142899.608357:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccaca3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142899.608373:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142899.608404:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867015168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 216us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.608411:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5916 00000100:00100000:1.0:1746142899.608580:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867015040 00000100:00100000:1.0:1746142899.608585:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867015040 00002000:00100000:1.0:1746142899.608611:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092136a00 x1830962867015040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.608620:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136a00 with x1830962867015040 ext(4194304->5033983) 00002000:00010000:1.0:1746142899.608624:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092136a00 00000100:00100000:1.0:1746142899.608637:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3946 00000100:00100000:1.0:1746142899.608642:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867015040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.624590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.667448:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.673428:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.673469:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.673508:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.673521:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867015680 00000100:00100000:0.0:1746142899.673524:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867015680 00010000:00010000:0.0:1746142899.673534:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ca expref: 12 pid: 1397 timeout: 773 lvb_type: 1 00000100:00100000:1.0:1746142899.674236:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5918 00000100:00100000:1.0:1746142899.674243:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867015680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.674248:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.674261:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ca expref: 12 pid: 1397 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.674268:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ca expref: 12 pid: 1397 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746142899.674293:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5919 00000100:00100000:0.0:1746142899.674298:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867015936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.674304:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.674311:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6e6000/0x2fa243e067ccabb5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892bc expref: 24 pid: 1852 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.674318:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6e6000/0x2fa243e067ccabb5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892bc expref: 24 pid: 1852 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.674329:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6e6000/0x2fa243e067ccabb5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892bc expref: 24 pid: 1852 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.674345:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142899.674359:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867015936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 60us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.674363:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5919 00010000:00010000:1.0:1746142899.674408:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092131600/0x2fa243e067ccabd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ca expref: 12 pid: 1397 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.674432:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.674434:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.674440:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 30 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.674448:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 30 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.674474:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 30 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142899.674483:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867677440:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142899.674530:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.676937:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.677015:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867677440:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142899.677028:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.677055:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867015680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2813us (3585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.677062:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5918 00000100:00100000:0.0:1746142899.692556:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.693225:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867016448 00000100:00100000:1.0:1746142899.693230:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867016448 00010000:00010000:1.0:1746142899.693254:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067ccabdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d1 expref: 16 pid: 1852 timeout: 773 lvb_type: 1 00000100:00100000:1.0:1746142899.693383:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5920 00000100:00100000:1.0:1746142899.693389:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867016448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.693399:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.693417:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067ccabdf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d1 expref: 16 pid: 1852 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.693431:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067ccabdf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d1 expref: 16 pid: 1852 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.693447:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067ccabdf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d1 expref: 16 pid: 1852 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.693463:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.693603:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867016448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 212us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.693608:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5920 00000100:00100000:1.0:1746142899.694584:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5922 00000100:00100000:1.0:1746142899.694589:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867016576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.694595:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.694601:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea40000/0x2fa243e067ccab1b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89268 expref: 37 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.694608:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea40000/0x2fa243e067ccab1b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89268 expref: 37 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.694618:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea40000/0x2fa243e067ccab1b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89268 expref: 37 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.694625:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.694626:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.694631:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29c00/0x2fa243e067ccacb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89333 expref: 36 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.694637:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29c00/0x2fa243e067ccacb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89333 expref: 36 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.694658:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc29c00/0x2fa243e067ccacb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89333 expref: 36 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142899.694667:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867677952:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142899.694714:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142899.702017:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867677952:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142899.702034:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.702089:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962867016576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7497us (7668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.702097:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5922 00000100:00100000:0.0:1746142899.702403:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.706683:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.739020:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.739050:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.739078:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.739093:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867017472 00000100:00100000:0.0:1746142899.739096:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867017472 00000100:00100000:1.0:1746142899.739110:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867017728 00000100:00100000:1.0:1746142899.739114:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867017728 00010000:00010000:0.0:1746142899.739120:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d3c00/0x2fa243e067ccaa26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891e3 expref: 15 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.739128:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d2c00/0x2fa243e067cca9e7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b9 expref: 36 pid: 1854 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746142899.739141:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5923 00000100:00100000:1.0:1746142899.739144:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5924 00000100:00100000:0.0:1746142899.739146:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867017472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142899.739149:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867017728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.739155:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.739156:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.739169:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971d2c00/0x2fa243e067cca9e7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b9 expref: 36 pid: 1854 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.739169:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971d3c00/0x2fa243e067ccaa26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891e3 expref: 15 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.739179:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971d3c00/0x2fa243e067ccaa26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891e3 expref: 15 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.739292:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971d2c00/0x2fa243e067cca9e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b9 expref: 36 pid: 1854 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.739306:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d2c00/0x2fa243e067cca9e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891b9 expref: 36 pid: 1854 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.739321:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.739350:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2003:x1830962867017728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.739355:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5924 00000100:00100000:1.0:1746142899.739396:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142899.739426:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d3c00/0x2fa243e067ccaa26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb891e3 expref: 15 pid: 9578 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.739444:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142899.739463:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867017472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 317us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.739470:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5923 00000100:00100000:0.0:1746142899.741477:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.741523:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.742348:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867018112 00000100:00100000:1.0:1746142899.742351:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867018112 00002000:00100000:1.0:1746142899.742374:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2551808->2555903) req@ffff8800979b0a80 x1830962867018112/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.742383:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0a80 with x1830962867018112 ext(2551808->2555903) 00002000:00010000:1.0:1746142899.742387:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0a80 00000100:00100000:1.0:1746142899.742398:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3949 00000100:00100000:1.0:1746142899.742403:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867018112:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142899.742480:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867018112:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 77us (1003us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142899.742485:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3949 00002000:00100000:1.0:1746142899.742489:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2551808->2555903) req@ffff8800979b0a80 x1830962867018112/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.742501:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0a80 with x1830962867018112 ext(2551808->2555903) 00002000:00010000:1.0:1746142899.742503:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0a80 00000100:00100000:0.0:1746142899.749110:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867018368 00000100:00100000:0.0:1746142899.749119:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867018368 00000100:00100000:0.0:1746142899.749150:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867018496 00000100:00100000:0.0:1746142899.749152:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867018496 00000100:00100000:0.0:1746142899.749164:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13397 00000100:00100000:0.0:1746142899.749170:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867018368:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142899.749185:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.749199:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b000/0x2fa243e067ccace2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89348 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.749240:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867678720:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142899.749294:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142899.749616:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867018752 00000100:00100000:1.0:1746142899.749621:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867018752 00000100:00100000:1.0:1746142899.749640:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867018624 00000100:00100000:1.0:1746142899.749642:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867018624 00000100:00100000:1.0:1746142899.749653:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13398 00000100:00100000:1.0:1746142899.749658:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867018496:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142899.749665:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142899.749673:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092733000/0x2fa243e067ccace9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8934f expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142899.749697:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867678848:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142899.749723:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.753977:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1746142899.754036:0:9579:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746142899 -> 1746142900 00002000:00010000:0.0:1746142899.754039:0:9579:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746142899 -> 1746142900 00002000:00010000:0.0:1746142899.754041:0:9579:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746142899 -> 1746142900 00000100:00100000:0.0:1746142899.754057:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867678720:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142899.754083:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b000/0x2fa243e067ccace2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89348 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.754095:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b000/0x2fa243e067ccace2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89348 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.754107:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b000, rc 0) 00000100:00100000:0.0:1746142899.754138:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867018368:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 4968us (6528us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142899.754144:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13397 00002000:00010000:0.0:1746142899.754223:0:11943:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142899 -> 1746142900 00002000:00010000:0.0:1746142899.754225:0:11943:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142899 -> 1746142900 00002000:00010000:0.0:1746142899.754227:0:11943:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142899 -> 1746142900 00000100:00100000:0.0:1746142899.754236:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867678848:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142899.754249:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092733000/0x2fa243e067ccace9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8934f expref: 17 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.754258:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092733000/0x2fa243e067ccace9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8934f expref: 17 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142899.754265:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733000, rc 0) 00000100:00100000:0.0:1746142899.754280:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867018496:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 4621us (6643us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142899.754286:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13398 00000100:00100000:0.0:1746142899.758677:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867679104:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142899.758687:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067ccacf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89356 expref: 11 pid: 1854 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746142899.758696:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867679232:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142899.765456:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.765511:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867019392 00000100:00100000:1.0:1746142899.765518:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867019392 00000100:00100000:0.0:1746142899.765542:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867679360:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142899.765545:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccac95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8931e expref: 25 pid: 9579 timeout: 773 lvb_type: 1 00010000:00010000:0.0:1746142899.765578:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3338239] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 25 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142899.765585:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5928 00000100:00100000:1.0:1746142899.765591:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867019392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.765591:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131200, rc 0) 00010000:00010000:1.0:1746142899.765601:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.765618:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccac95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8931e expref: 25 pid: 9579 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746142899.765627:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+25:31934:x1830962867018880:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 11533us (11657us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142899.765632:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccac95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8931e expref: 25 pid: 9579 timeout: 773 lvb_type: 1 00000100:00100000:0.0:1746142899.765634:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13401 00010000:00010000:1.0:1746142899.765649:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccac95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8931e expref: 24 pid: 9579 timeout: 773 lvb_type: 1 00010000:00010000:1.0:1746142899.765669:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.765801:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867019392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 209us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.765806:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5928 00000100:00100000:0.0:1746142899.770957:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.774640:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867019776 00000100:00100000:1.0:1746142899.774650:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867019776 00010000:00010000:1.0:1746142899.774682:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccac48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89309 expref: 31 pid: 11943 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.774722:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5929 00000100:00100000:1.0:1746142899.774728:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867019776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.774738:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.774755:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccac48 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89309 expref: 31 pid: 11943 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.774765:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccac48 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89309 expref: 31 pid: 11943 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.774784:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccac48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89309 expref: 31 pid: 11943 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.774797:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.774799:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.774804:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 22 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.774810:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 22 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.774836:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 22 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142899.774846:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867679744:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142899.774954:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.777703:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.783616:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.783631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.783658:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.783961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.783971:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867020672 00000100:00100000:1.0:1746142899.783974:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867020672 00010000:00010000:1.0:1746142899.783986:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7600/0x2fa243e067ccad1a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8936b expref: 35 pid: 10924 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.784000:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5931 00000100:00100000:1.0:1746142899.784005:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+35:2004:x1830962867020672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.784011:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.784015:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7600/0x2fa243e067ccad1a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8936b expref: 35 pid: 10924 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746142899.784054:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13403 00000100:00100000:0.0:1746142899.784060:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867020544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142899.784067:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.784074:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2a200/0x2fa243e067ccad60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8938e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.784096:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867680000:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142899.784118:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00010000:00010000:1.0:1746142899.784244:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7600/0x2fa243e067ccad1a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8936b expref: 35 pid: 10924 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.784256:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7600/0x2fa243e067ccad1a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8936b expref: 35 pid: 10924 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.784268:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142899.784272:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccad2f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.784279:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccad2f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.784286:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccad2f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.784306:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.784322:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867020672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 317us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.784328:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5931 00000100:00100000:1.0:1746142899.784359:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.784386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.784396:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867021056 00000100:00100000:1.0:1746142899.784399:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867021056 00000100:00100000:1.0:1746142899.784415:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 732 00000100:00100000:1.0:1746142899.784419:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867021056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.784425:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.784435:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067ccad4b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89379 expref: 48 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.785069:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142899.785073:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142899.785091:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867021056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 671us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.785097:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 732 00000100:00100000:1.0:1746142899.785117:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867020928 00000100:00100000:1.0:1746142899.785120:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867020928 00002000:00100000:1.0:1746142899.785142:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3334144->3338239) req@ffff88013644e680 x1830962867020928/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.785151:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e680 with x1830962867020928 ext(3334144->3338239) 00002000:00010000:1.0:1746142899.785156:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644e680 00000100:00100000:1.0:1746142899.785293:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3950 00000100:00100000:1.0:1746142899.785299:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867020928:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142899.785482:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867020928:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 182us (1121us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142899.785488:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3950 00002000:00100000:1.0:1746142899.785493:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3334144->3338239) req@ffff88013644e680 x1830962867020928/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.785500:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e680 with x1830962867020928 ext(3334144->3338239) 00002000:00010000:1.0:1746142899.785502:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644e680 00000100:00100000:0.0:1746142899.786934:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867021312 00000100:00100000:0.0:1746142899.786939:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867021312 00000100:00100000:0.0:1746142899.786968:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13406 00000100:00100000:0.0:1746142899.786977:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867021312:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142899.786986:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.786997:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067ccad7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8939c expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.787028:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867680384:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142899.787085:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.787421:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867021568 00000100:00100000:0.0:1746142899.787425:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867021568 00000100:00100000:0.0:1746142899.787449:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14244 00000100:00100000:0.0:1746142899.787454:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:31938:x1830962867021568:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142899.787467:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142899.787469:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746142899.787484:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccad2f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89372 expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.787509:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142899.787513:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142899.787520:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b600/0x2fa243e067ccad83 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb893a3 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.789975:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.789995:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790003:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790013:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790018:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790022:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790028:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092733c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142899.790030:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790035:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790043:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142899.790045:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142899.790048:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790052:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccad8a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142899.790215:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b600/0x2fa243e067ccad83 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893a3 expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.790227:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b600/0x2fa243e067ccad83 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893a3 expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.790234:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b600, rc 0) 00000100:00100000:1.0:1746142899.790288:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:31938:x1830962867021568:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 2831us (3181us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142899.790295:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14244 00000100:00100000:1.0:1746142899.793108:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867680000:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142899.793125:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2a200/0x2fa243e067ccad60 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8938e expref: 24 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.793135:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a200/0x2fa243e067ccad60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8938e expref: 24 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.793142:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a200, rc 0) 00000100:00100000:1.0:1746142899.793165:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867020544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 9104us (9532us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142899.793170:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13403 00000100:00100000:0.0:1746142899.797229:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.801190:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.804713:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.810477:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.810501:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.810522:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.811200:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867022336 00000100:00100000:1.0:1746142899.811207:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867022336 00002000:00100000:1.0:1746142899.811239:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (524288->1048575) req@ffff88009a28c000 x1830962867022336/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.811248:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c000 with x1830962867022336 ext(524288->1048575) 00010000:00010000:1.0:1746142899.811254:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 30 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.811265:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 30 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.811271:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28c000 00000100:00100000:1.0:1746142899.811283:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867022592 00000100:00100000:1.0:1746142899.811285:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867022592 00002000:00100000:1.0:1746142899.811294:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->524287) req@ffff88009a28ea00 x1830962867022592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.811300:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ea00 with x1830962867022592 ext(0->524287) 00010000:00010000:1.0:1746142899.811303:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 31 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.811310:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 31 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.811315:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28ea00 00000100:00100000:1.0:1746142899.811797:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867022848 00000100:00100000:1.0:1746142899.811801:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867022848 00000100:00100000:0.0:1746142899.811802:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1228 00000100:00100000:0.0:1746142899.811809:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867022336:12345-192.168.204.50@tcp:4:cat.0 00002000:00100000:1.0:1746142899.811815:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1417216->2097151) req@ffff88009a28d180 x1830962867022848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.811821:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d180 with x1830962867022848 ext(1417216->2097151) 00002000:00010000:1.0:1746142899.811825:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28d180 00000100:00100000:1.0:1746142899.811843:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1229 00000100:00100000:1.0:1746142899.811849:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2003:x1830962867022592:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.819289:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867022592:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7429us (8776us total) trans 0 rc 524288/524288 00000100:00100000:1.0:1746142899.819301:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1229 00002000:00100000:1.0:1746142899.819311:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->524287) req@ffff88009a28ea00 x1830962867022592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 524288/524288 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.819320:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ea00 with x1830962867022592 ext(0->524287) 00010000:00010000:1.0:1746142899.819328:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.819340:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.819347:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28ea00 00000100:00100000:1.0:1746142899.823473:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867022336:12345-192.168.204.50@tcp:4:cat.0 Request processed in 11662us (13000us total) trans 21474841047 rc 0/0 00000100:00100000:1.0:1746142899.823479:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1228 00002000:00100000:1.0:1746142899.823484:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (524288->1048575) req@ffff88009a28c000 x1830962867022336/t21474841047(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/448 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.823490:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c000 with x1830962867022336 ext(524288->1048575) 00010000:00010000:1.0:1746142899.823496:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.823506:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:1.0:1746142899.823510:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28c000 00000100:00100000:0.0:1746142899.840999:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.841041:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867023232 00000100:00100000:1.0:1746142899.841048:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867023232 00010000:00010000:1.0:1746142899.841078:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.841638:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5932 00000100:00100000:1.0:1746142899.841645:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867023232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142899.841653:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142899.841667:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.841675:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.841688:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccacb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8932c expref: 32 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:1.0:1746142899.841711:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.841713:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.841719:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130a00/0x2fa243e067ccad91 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893aa expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.841726:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130a00/0x2fa243e067ccad91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893aa expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.841752:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096130a00/0x2fa243e067ccad91 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893aa expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142899.841763:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867680640:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142899.841820:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.848041:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.848131:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.848306:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867023360 00000100:00100000:1.0:1746142899.848314:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867023360 00000100:00100000:1.0:1746142899.848345:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867023488 00000100:00100000:1.0:1746142899.848347:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867023488 00000100:00100000:1.0:1746142899.848373:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13408 00000100:00100000:1.0:1746142899.848379:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867023360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142899.848394:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142899.848408:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccadbb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb893b8 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.848426:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.848427:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142899.848434:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccadbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893b8 expref: 34 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.848447:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccadbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893b8 expref: 34 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142899.848456:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2ae00, rc 0) 00000100:00100000:1.0:1746142899.848490:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867023360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 112us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142899.848496:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13408 00000100:00100000:1.0:1746142899.848509:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13409 00000100:00100000:1.0:1746142899.848513:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:31948:x1830962867023488:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142899.848519:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142899.848524:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb893bf expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.848537:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 23 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.848543:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142899.848544:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142899.848547:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3907584->4009983] (req 3907584->4009983) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.849217:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 23 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142899.849229:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 23 pid: 12211 timeout: 773 lvb_type: 0 00000100:00100000:1.0:1746142899.849450:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867680768:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142899.849648:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.851252:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867680640:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142899.852168:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142899.852197:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867023232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10552us (11235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142899.852206:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5932 00000100:00100000:1.0:1746142899.852801:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.855313:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.855364:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.855388:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867024128 00000100:00100000:0.0:1746142899.855393:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867024128 00002000:00100000:0.0:1746142899.855419:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3338239) req@ffff88013644ed80 x1830962867024128/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.855428:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ed80 with x1830962867024128 ext(3145728->3338239) 00010000:00010000:0.0:1746142899.855435:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.855447:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746142899.856836:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644ed80 00000100:00100000:0.0:1746142899.856860:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1230 00000100:00100000:0.0:1746142899.856867:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867024128:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142899.867842:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.868479:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867024128:12345-192.168.204.50@tcp:4:cat.0 Request processed in 11612us (13114us total) trans 21474841048 rc 0/0 00000100:00100000:0.0:1746142899.868485:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1230 00002000:00100000:0.0:1746142899.868492:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3338239) req@ffff88013644ed80 x1830962867024128/t21474841048(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/448 e 0 to 0 dl 1746142910 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.868499:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ed80 with x1830962867024128 ext(3145728->3338239) 00010000:00010000:0.0:1746142899.868504:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.868513:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746142899.868519:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644ed80 00000100:00100000:0.0:1746142899.875423:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867024384 00000100:00100000:0.0:1746142899.875430:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867024384 00010000:00010000:0.0:1746142899.875458:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00000100:00100000:0.0:1746142899.875488:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5933 00000100:00100000:0.0:1746142899.875495:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867024384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142899.875506:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142899.875521:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.875532:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.875551:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccacfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3338239) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89364 expref: 26 pid: 12211 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.875563:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.875591:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.875598:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.875604:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.875611:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.875612:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142899.875614:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccadd7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893d4 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.875619:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccadd7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893d4 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142899.875641:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccadd7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893d4 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.875655:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de12300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867681152:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142899.875727:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142899.875733:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de13100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867681280:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142899.875750:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142899.878703:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.880044:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867024640 00000100:00100000:0.0:1746142899.880052:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867024640 00002000:00100000:0.0:1746142899.880094:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3907584->3911679) req@ffff88012de10e00 x1830962867024640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.880103:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de10e00 with x1830962867024640 ext(3907584->3911679) 00002000:00010000:0.0:1746142899.880107:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de10e00 00000100:00100000:0.0:1746142899.880126:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3953 00000100:00100000:0.0:1746142899.880132:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867024640:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.880239:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867024640:12345-192.168.204.50@tcp:3:cat.0 Request processed in 106us (1541us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142899.880244:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3953 00002000:00100000:0.0:1746142899.880248:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3907584->3911679) req@ffff88012de10e00 x1830962867024640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/4536 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.880254:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de10e00 with x1830962867024640 ext(3907584->3911679) 00002000:00010000:0.0:1746142899.880257:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de10e00 00000100:00100000:0.0:1746142899.880432:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867024896 00000100:00100000:0.0:1746142899.880436:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867024896 00002000:00100000:0.0:1746142899.880450:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880088fd8700 x1830962867024896/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.880456:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8700 with x1830962867024896 ext(2097152->3145727) 00002000:00010000:0.0:1746142899.880459:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd8700 00000100:00100000:0.0:1746142899.880477:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3954 00000100:00100000:0.0:1746142899.880482:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867024896:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.885665:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.885715:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.891509:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.891861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.891883:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867025664 00000100:00100000:0.0:1746142899.891886:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867025664 00002000:00100000:0.0:1746142899.891928:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1417215) req@ffff88012de11500 x1830962867025664/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142899.891935:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de11500 with x1830962867025664 ext(1048576->1417215) 00010000:00010000:0.0:1746142899.891941:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29c00/0x2fa243e067ccacb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89333 expref: 35 pid: 9579 timeout: 773 lvb_type: 0 00010000:00010000:0.0:1746142899.891951:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bc29c00/0x2fa243e067ccacb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89333 expref: 35 pid: 9579 timeout: 773 lvb_type: 0 00002000:00010000:0.0:1746142899.891956:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de11500 00000100:00100000:0.0:1746142899.891968:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1231 00000100:00100000:0.0:1746142899.891973:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867025664:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142899.898432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.903432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.903522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.914284:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.916450:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867026304 00000100:00100000:1.0:1746142899.916456:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867026304 00002000:00100000:1.0:1746142899.916493:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097348380 x1830962867026304/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.916503:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348380 with x1830962867026304 ext(1048576->2097151) 00002000:00010000:1.0:1746142899.916507:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097348380 00000100:00100000:1.0:1746142899.916531:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3956 00000100:00100000:1.0:1746142899.916538:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867026304:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142899.928827:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867026304:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12281us (14547us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142899.928837:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3956 00002000:00100000:1.0:1746142899.928846:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097348380 x1830962867026304/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:50/0 lens 488/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.928854:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348380 with x1830962867026304 ext(1048576->2097151) 00002000:00010000:1.0:1746142899.928858:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097348380 00000100:00100000:0.0:1746142899.929443:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.938552:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.939590:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.943577:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.949385:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.950081:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867027200 00000100:00100000:1.0:1746142899.950093:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867027200 00002000:00100000:1.0:1746142899.950132:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880097349c00 x1830962867027200/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 504/0 e 0 to 0 dl 1746142910 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.950141:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349c00 with x1830962867027200 ext(3145728->4194303) 00002000:00010000:1.0:1746142899.950146:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097349c00 00000100:00100000:1.0:1746142899.950177:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3957 00000100:00100000:1.0:1746142899.950184:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867027200:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142899.951953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142899.956542:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142899.977832:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867027200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27640us (28446us total) trans 0 rc 946176/946176 00000100:00100000:1.0:1746142899.977841:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3957 00002000:00100000:1.0:1746142899.977850:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880097349c00 x1830962867027200/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:50/0 lens 504/440 e 0 to 0 dl 1746142910 ref 1 fl Complete:/200/0 rc 946176/946176 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142899.977857:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349c00 with x1830962867027200 ext(3145728->4194303) 00002000:00010000:1.0:1746142899.977863:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097349c00 00000100:00100000:0.0:1746142900.012601:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.012649:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.012722:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867028096 00000100:00100000:1.0:1746142900.012729:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867028096 00000100:00100000:1.0:1746142900.012763:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867027968 00000100:00100000:1.0:1746142900.012765:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867027968 00000100:00100000:1.0:1746142900.012789:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13418 00000100:00100000:1.0:1746142900.012796:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867028096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.012811:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.012824:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c881e00/0x2fa243e067ccae01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89405 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.012867:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867682048:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142900.012960:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.016586:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867682048:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142900.016614:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c881e00/0x2fa243e067ccae01 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89405 expref: 35 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.016627:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c881e00/0x2fa243e067ccae01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89405 expref: 35 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.016652:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881e00, rc 0) 00000100:00100000:1.0:1746142900.016689:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867028096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3893us (4095us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142900.016695:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13418 00000100:00100000:0.0:1746142900.017601:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.017663:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867028224 00000100:00100000:1.0:1746142900.017668:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867028224 00000100:00100000:1.0:1746142900.017695:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13420 00000100:00100000:1.0:1746142900.017700:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:31941:x1830962867028224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.017713:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.017723:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccae0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8940c expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.017743:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.017749:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.017750:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.017753:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccae0f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8940c expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.017773:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.017783:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 33 pid: 1397 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.017792:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867682176:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142900.017857:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.019217:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867682176:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142900.019234:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccae0f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8940c expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.019245:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881200, rc 0) 00000100:00100000:1.0:1746142900.019268:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:31941:x1830962867028224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1568us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.019275:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13420 00000100:00100000:0.0:1746142900.032651:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.034970:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5936 00000100:00100000:0.0:1746142900.034981:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962867028480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142900.034993:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142900.035012:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 36 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.035022:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 36 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.035042:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccadc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3907584->4009983) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893bf expref: 36 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.035068:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142900.035070:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142900.035077:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccae0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8940c expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.035084:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8940c expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.035112:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccae0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8940c expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142900.035122:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132406a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867682304:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142900.036862:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142900.037982:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.038181:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867028608 00000100:00100000:1.0:1746142900.038188:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867028608 00000100:00100000:1.0:1746142900.038229:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13421 00000100:00100000:1.0:1746142900.038236:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:31944:x1830962867028608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.038250:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.038263:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89413 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.038281:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.038283:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.038289:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89413 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.038305:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89413 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.038314:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881000, rc 0) 00000100:00100000:1.0:1746142900.038350:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:31944:x1830962867028608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 113us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.038356:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13421 00000100:00100000:1.0:1746142900.040559:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132406a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867682304:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142900.040588:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.040633:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962867028480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5654us (7987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.040641:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5936 00000100:00100000:0.0:1746142900.045242:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.045281:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.045319:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.047190:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3963 00000100:00100000:0.0:1746142900.047202:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867029376:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142900.056447:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867029632 00000100:00100000:0.0:1746142900.056455:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867029632 00000100:00100000:0.0:1746142900.056498:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14246 00000100:00100000:0.0:1746142900.056504:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+35:31951:x1830962867029632:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142900.056520:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142900.056534:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06800/0x2fa243e067ccae1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8941a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.056595:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056604:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056614:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056622:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056627:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056631:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056692:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056699:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056703:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142900.056709:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142900.056756:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056761:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056766:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056770:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056775:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc06a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142900.056778:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056783:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056790:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142900.056793:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142900.056795:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.056800:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccae24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058430:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058441:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058446:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058451:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc07000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142900.058454:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058460:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058471:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4c00) 00010000:00010000:0.0:1746142900.058473:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142900.058476:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058481:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccae2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142900.058527:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06800/0x2fa243e067ccae1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8941a expref: 38 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.058538:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8941a expref: 37 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.058544:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142900.058546:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142900.058548:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07a00, rc 0) 00000100:00100000:0.0:1746142900.058606:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+37:31951:x1830962867029632:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2101us (3861us total) trans 8589936354 rc 0/0 00000100:00100000:0.0:1746142900.058613:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14246 00000100:00100000:0.0:1746142900.069747:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.073295:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867030144 00000100:00100000:0.0:1746142900.073302:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867030144 00002000:00100000:0.0:1746142900.073340:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012d4c2a00 x1830962867030144/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.073349:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2a00 with x1830962867030144 ext(4194304->5033983) 00002000:00010000:0.0:1746142900.073354:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c2a00 00000100:00100000:0.0:1746142900.073372:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3964 00000100:00100000:0.0:1746142900.073378:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867030144:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142900.084531:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.087446:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.087479:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.087546:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867030400 00000100:00100000:1.0:1746142900.087551:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867030400 00010000:00010000:1.0:1746142900.087574:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccadfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f7 expref: 28 pid: 1397 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.087604:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5937 00000100:00100000:1.0:1746142900.087610:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867030400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.087618:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.087634:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccadfa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f7 expref: 28 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.087644:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccadfa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f7 expref: 28 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.087786:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccadfa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f7 expref: 28 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.087800:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.087830:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867030400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 219us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.088002:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5937 00000100:00100000:0.0:1746142900.090371:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.090446:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.090488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.090772:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867030656 00000100:00100000:1.0:1746142900.090776:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867030656 00010000:00010000:1.0:1746142900.090794:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89413 expref: 35 pid: 1852 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.090812:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5939 00000100:00100000:1.0:1746142900.090817:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2003:x1830962867030656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.090825:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.090837:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89413 expref: 35 pid: 1852 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.090852:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89413 expref: 35 pid: 1852 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.090868:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccae16 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89413 expref: 35 pid: 1852 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.090876:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.090878:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.090883:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098445800/0x2fa243e067ccae40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89421 expref: 26 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.090889:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098445800/0x2fa243e067ccae40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89421 expref: 26 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.090929:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098445800/0x2fa243e067ccae40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89421 expref: 26 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.090938:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867682944:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142900.090973:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.093586:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867682944:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142900.093605:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.093649:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867030656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2830us (3201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.093658:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5939 00000100:00100000:0.0:1746142900.094956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.101187:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.105180:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.105586:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.105646:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867031680 00000100:00100000:1.0:1746142900.105650:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867031680 00010000:00010000:1.0:1746142900.105664:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3f400/0x2fa243e067ccadf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f0 expref: 19 pid: 1852 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.105688:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5942 00000100:00100000:1.0:1746142900.105692:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867031680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.105699:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.105711:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3f400/0x2fa243e067ccadf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f0 expref: 19 pid: 1852 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.105718:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3f400/0x2fa243e067ccadf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f0 expref: 19 pid: 1852 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.105809:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3f400/0x2fa243e067ccadf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893f0 expref: 19 pid: 1852 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.105830:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.105832:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.105838:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e000/0x2fa243e067ccae47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89428 expref: 18 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.105845:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e000/0x2fa243e067ccae47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89428 expref: 18 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.105867:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e000/0x2fa243e067ccae47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2215935) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89428 expref: 18 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.105877:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867683328:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142900.105956:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.107297:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867683328:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142900.107310:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.107342:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867031680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1649us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.107349:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5942 00000100:00100000:0.0:1746142900.108016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.110611:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.111176:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.112391:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.112424:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.112444:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867032576 00000100:00100000:1.0:1746142900.112448:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867032576 00010000:00010000:1.0:1746142900.112465:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8941a expref: 39 pid: 7231 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.112492:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5943 00000100:00100000:1.0:1746142900.112498:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+39:2003:x1830962867032576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.112505:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.112510:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8941a expref: 39 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.112519:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8941a expref: 39 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.112533:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccae32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8941a expref: 39 pid: 7231 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.112543:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142900.112547:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ea00/0x2fa243e067ccae55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.112554:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ea00/0x2fa243e067ccae55 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.112558:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.112601:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+38:2003:x1830962867032576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.112607:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5943 00000100:00100000:0.0:1746142900.173009:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.178109:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.186279:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.189966:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.194240:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.200168:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.206969:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.215854:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.221870:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13427 00000100:00100000:1.0:1746142900.221877:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867034624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.221883:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.221890:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccae9b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89452 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.221931:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867684352:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142900.222021:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867034368 00000100:00100000:0.0:1746142900.222024:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867034368 00000100:00100000:0.0:1746142900.222044:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 733 00000100:00100000:0.0:1746142900.222049:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+40:2005:x1830962867034368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142900.222056:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142900.222073:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccae86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89444 expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.222089:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142900.222092:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.222513:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142900.222737:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+39:2005:x1830962867034368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 686us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142900.222743:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 733 00000100:00100000:1.0:1746142900.225647:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867684352:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142900.225666:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccae9b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89452 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.225674:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccae9b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89452 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.225696:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715e00, rc 0) 00000100:00100000:1.0:1746142900.225717:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867034624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3841us (4208us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142900.225723:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13427 00000100:00100000:0.0:1746142900.233264:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.233306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.233780:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13428 00000100:00100000:1.0:1746142900.233789:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867034752:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.233803:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.233815:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccaea2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89459 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.233852:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867684480:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142900.233933:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.235611:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867684480:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142900.235632:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccaea2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89459 expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.235641:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccaea2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89459 expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.235969:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715a00, rc 0) 00000100:00100000:1.0:1746142900.235986:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867034752:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2199us (2729us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142900.235991:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13428 00000100:00100000:0.0:1746142900.237834:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.237874:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867035008 00000100:00100000:1.0:1746142900.237879:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867035008 00000100:00100000:1.0:1746142900.237931:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13430 00000100:00100000:1.0:1746142900.237976:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:31959:x1830962867035008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.237989:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.238000:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094715e00/0x2fa243e067ccaeb0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89467 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.238018:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3fc00/0x2fa243e067ccae63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89436 expref: 34 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.238024:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.238026:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.238029:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094715e00/0x2fa243e067ccaeb0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89467 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.238050:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3fc00/0x2fa243e067ccae63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89436 expref: 34 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.238058:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3fc00/0x2fa243e067ccae63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89436 expref: 34 pid: 12211 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.238064:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867684736:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142900.238132:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.239029:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867684736:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142900.239046:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094715e00/0x2fa243e067ccaeb0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89467 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.239060:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715e00, rc 0) 00000100:00100000:1.0:1746142900.239096:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+28:31959:x1830962867035008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1157us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.239103:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13430 00000100:00100000:0.0:1746142900.239662:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.250536:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.253436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.261693:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.261940:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867035648 00000100:00100000:1.0:1746142900.261947:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867035648 00000100:00100000:1.0:1746142900.261992:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13431 00000100:00100000:1.0:1746142900.261999:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:31959:x1830962867035648:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.262015:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.262029:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccaeb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8946e expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.262053:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccae6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2494463) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8943d expref: 37 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.262060:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.262062:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.262065:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccaeb7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8946e expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.262090:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccae6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2494463) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8943d expref: 37 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.262100:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccae6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2494463) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8943d expref: 37 pid: 12211 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.262111:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867684992:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142900.262188:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03780 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.263313:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867684992:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142900.263332:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccaeb7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8946e expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.263343:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714e00, rc 0) 00000100:00100000:1.0:1746142900.263367:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:31959:x1830962867035648:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1368us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.263374:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13431 00000100:00100000:0.0:1746142900.264001:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.270163:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.279811:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.280056:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.280161:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3971 00000100:00100000:1.0:1746142900.280170:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867036288:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142900.291695:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.293237:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867036288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13067us (13179us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142900.293245:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3971 00002000:00100000:0.0:1746142900.293253:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009862fb80 x1830962867036288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/440 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.293261:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862fb80 with x1830962867036288 ext(2097152->4194303) 00002000:00010000:0.0:1746142900.293265:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862fb80 00000100:00100000:0.0:1746142900.294881:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.296482:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.296512:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.296548:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.296578:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867037312 00000100:00100000:0.0:1746142900.296584:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867037312 00002000:00100000:0.0:1746142900.296615:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009862df80 x1830962867037312/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.296624:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862df80 with x1830962867037312 ext(4194304->5033983) 00002000:00010000:0.0:1746142900.296628:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009862df80 00000100:00100000:0.0:1746142900.296657:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3972 00000100:00100000:0.0:1746142900.296663:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+28:2003:x1830962867037312:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142900.305597:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.305677:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.308375:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.320315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:1.0:1746142900.321224:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142900.322875:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.325173:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.326712:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.327718:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.329045:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.332806:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.333441:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.334441:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.335125:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867039360 00000100:00100000:1.0:1746142900.335132:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867039360 00000100:00100000:0.0:1746142900.336427:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.344952:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.347465:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.347499:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.350732:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.354357:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.355406:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.372157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.372312:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867041408 00000100:00100000:1.0:1746142900.372320:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867041408 00000100:00100000:1.0:1746142900.372367:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5148 00000100:00100000:1.0:1746142900.372376:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+53:31963:x1830962867041408:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142900.373208:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:31963:x1830962867041408:12345-192.168.204.50@tcp:35:cat.0 Request processed in 803us (1028us total) trans 8589936366 rc 0/0 00000100:00100000:1.0:1746142900.373216:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5148 00000100:00100000:0.0:1746142900.390199:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.392816:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.394061:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.394342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.396636:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.401975:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.405545:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.405701:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.405771:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867042432 00000100:00100000:1.0:1746142900.405777:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867042432 00010000:00010000:1.0:1746142900.405802:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092130600/0x2fa243e067ccabe6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892d8 expref: 13 pid: 1397 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.405833:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867042560 00000100:00100000:1.0:1746142900.405836:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867042560 00010000:00010000:1.0:1746142900.405844:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067ccaba7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ae expref: 30 pid: 9578 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.405856:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5956 00000100:00100000:1.0:1746142900.405861:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867042560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.405867:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.405883:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067ccaba7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ae expref: 30 pid: 9578 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.405891:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067ccaba7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ae expref: 30 pid: 9578 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.406008:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067ccaba7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb892ae expref: 30 pid: 9578 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.406024:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.406142:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867042560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 279us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.406147:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5956 00000100:00100000:0.0:1746142900.406153:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.406217:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867042688 00000100:00100000:1.0:1746142900.406220:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867042688 00010000:00010000:1.0:1746142900.406230:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea41c00/0x2fa243e067ccab30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8927d expref: 37 pid: 1853 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.406246:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5957 00000100:00100000:1.0:1746142900.406251:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867042688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.406257:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.406264:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea41c00/0x2fa243e067ccab30 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8927d expref: 37 pid: 1853 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.406272:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea41c00/0x2fa243e067ccab30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8927d expref: 37 pid: 1853 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.406283:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea41c00/0x2fa243e067ccab30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8927d expref: 37 pid: 1853 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.406291:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.406293:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.406299:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.406306:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.406329:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.406340:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867686528:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142900.406397:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.407695:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867686528:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142900.407708:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.407739:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867042688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1487us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.407746:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5957 00000100:00100000:0.0:1746142900.408865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.413849:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.414075:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867043200 00000100:00100000:1.0:1746142900.414082:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867043200 00000100:00100000:1.0:1746142900.414123:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5149 00000100:00100000:1.0:1746142900.414130:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+41:31967:x1830962867043200:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142900.414290:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+42:31967:x1830962867043200:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 160us (446us total) trans 8589936367 rc 0/0 00000100:00100000:1.0:1746142900.414297:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5149 00000100:00100000:0.0:1746142900.433403:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.440217:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.444351:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.444400:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.453023:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.453186:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867044096:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8616us (8840us total) trans 0 rc 667648/667648 00000100:00100000:0.0:1746142900.453192:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3980 00002000:00100000:0.0:1746142900.453197:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1716223) req@ffff880130376300 x1830962867044096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/440 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.453204:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376300 with x1830962867044096 ext(1048576->1716223) 00002000:00010000:0.0:1746142900.453207:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130376300 00000100:00100000:0.0:1746142900.456148:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.456771:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867044480 00000100:00100000:1.0:1746142900.456777:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867044480 00010000:00010000:1.0:1746142900.456803:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3ec00/0x2fa243e067ccaf0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89491 expref: 12 pid: 1397 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.456840:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5958 00000100:00100000:1.0:1746142900.456846:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867044480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142900.456856:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142900.456882:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3ec00/0x2fa243e067ccaf0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89491 expref: 12 pid: 1397 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.456891:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3ec00/0x2fa243e067ccaf0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89491 expref: 12 pid: 1397 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.456942:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3ec00/0x2fa243e067ccaf0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89491 expref: 12 pid: 1397 timeout: 774 lvb_type: 1 00010000:00010000:1.0:1746142900.456955:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142900.457103:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867044480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 256us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.457109:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5958 00000100:00100000:1.0:1746142900.457193:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.457445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.459865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.459933:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867044992 00000100:00100000:1.0:1746142900.459939:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867044992 00002000:00100000:1.0:1746142900.459972:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (49152->53247) req@ffff8800938de680 x1830962867044992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.459982:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830962867044992 ext(49152->53247) 00002000:00010000:1.0:1746142900.459986:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:1.0:1746142900.460016:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3982 00000100:00100000:1.0:1746142900.460023:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867044992:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142900.460152:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867044992:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 126us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142900.460158:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3982 00002000:00100000:1.0:1746142900.460164:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (49152->53247) req@ffff8800938de680 x1830962867044992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.460171:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830962867044992 ext(49152->53247) 00002000:00010000:1.0:1746142900.460173:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:0.0:1746142900.460400:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.463655:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.463703:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867045376 00000100:00100000:1.0:1746142900.463710:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867045376 00002000:00100000:1.0:1746142900.463737:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (315392->319487) req@ffff8800938dce00 x1830962867045376/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.463747:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dce00 with x1830962867045376 ext(315392->319487) 00002000:00010000:1.0:1746142900.463752:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dce00 00000100:00100000:1.0:1746142900.463772:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3983 00000100:00100000:1.0:1746142900.463778:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867045376:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142900.463876:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867045376:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 97us (222us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142900.463882:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3983 00002000:00100000:1.0:1746142900.463887:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (315392->319487) req@ffff8800938dce00 x1830962867045376/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.463893:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dce00 with x1830962867045376 ext(315392->319487) 00002000:00010000:1.0:1746142900.463896:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dce00 00000100:00100000:0.0:1746142900.465473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.466157:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867045760 00000100:00100000:1.0:1746142900.466160:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867045760 00000100:00100000:1.0:1746142900.466192:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5150 00000100:00100000:1.0:1746142900.466197:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:31976:x1830962867045760:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142900.466329:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:31976:x1830962867045760:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 132us (240us total) trans 8589936370 rc 0/0 00000100:00100000:1.0:1746142900.466336:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5150 00000100:00100000:0.0:1746142900.467952:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.473071:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.533645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.536727:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867046528 00000100:00100000:0.0:1746142900.536731:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867046528 00010000:00010000:0.0:1746142900.536756:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067ccafb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894d7 expref: 57 pid: 10924 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746142900.536776:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5961 00000100:00100000:0.0:1746142900.536783:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2005:x1830962867046528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142900.536791:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142900.536796:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067ccafb3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894d7 expref: 57 pid: 10924 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.536804:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067ccafb3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894d7 expref: 57 pid: 10924 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.536821:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067ccafb3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894d7 expref: 57 pid: 10924 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.536846:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142900.536851:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccafe4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142900.536858:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccafe4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142900.536867:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142900.536893:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867046528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142900.536910:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5961 00000100:00100000:0.0:1746142900.538978:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.581234:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.585243:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.585292:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867047040 00000100:00100000:0.0:1746142900.585299:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867047040 00000100:00100000:1.0:1746142900.585301:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.585347:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 735 00000100:00100000:0.0:1746142900.585354:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2006:x1830962867047040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142900.585365:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142900.585382:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccb007 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89501 expref: 58 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.585397:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142900.585400:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142900.585433:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2006:x1830962867047040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142900.585439:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 735 00000100:00100000:0.0:1746142900.589745:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.590969:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.590997:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.591019:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867047552 00000100:00100000:1.0:1746142900.591024:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867047552 00000100:00100000:1.0:1746142900.591052:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14258 00000100:00100000:1.0:1746142900.591057:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:31986:x1830962867047552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.591071:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.591083:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccb01c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8950f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.591132:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591141:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591149:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591160:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591164:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591169:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591250:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a000/0x2fa243e067ccb031 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591258:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a000/0x2fa243e067ccb031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591263:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a000/0x2fa243e067ccb031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142900.591273:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142900.591326:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591332:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591336:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591341:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591346:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.591349:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591353:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591361:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142900.591363:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.591366:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591370:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccb023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591394:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591399:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591407:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591418:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c3a600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.591421:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591425:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591431:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736d00) 00010000:00010000:1.0:1746142900.591433:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.591435:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591439:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a600/0x2fa243e067ccb02a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.591466:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccb01c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8950f expref: 60 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.591475:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a000/0x2fa243e067ccb031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8950f expref: 59 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.591480:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142900.591482:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142900.591484:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a000, rc 0) 00000100:00100000:1.0:1746142900.591521:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:31986:x1830962867047552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 463us (554us total) trans 8589936374 rc 0/0 00000100:00100000:1.0:1746142900.591526:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14258 00000100:00100000:0.0:1746142900.592747:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.596965:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867048064 00000100:00100000:1.0:1746142900.596969:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867048064 00002000:00100000:1.0:1746142900.596995:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3002368->3006463) req@ffff88012d4c0700 x1830962867048064/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.597004:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0700 with x1830962867048064 ext(3002368->3006463) 00002000:00010000:1.0:1746142900.597007:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c0700 00000100:00100000:1.0:1746142900.597021:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3984 00000100:00100000:1.0:1746142900.597026:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867048064:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142900.597129:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867048064:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 102us (498us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142900.597135:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3984 00002000:00100000:1.0:1746142900.597140:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3002368->3006463) req@ffff88012d4c0700 x1830962867048064/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.597147:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0700 with x1830962867048064 ext(3002368->3006463) 00002000:00010000:1.0:1746142900.597149:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c0700 00000100:00100000:0.0:1746142900.603220:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.608246:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.608389:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.608421:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.608438:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867048576 00000100:00100000:1.0:1746142900.608445:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867048576 00000100:00100000:1.0:1746142900.608476:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13445 00000100:00100000:1.0:1746142900.608482:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867048576:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.608497:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.608511:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067ccb03f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89516 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.608566:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867688320:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142900.608683:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867048832 00000100:00100000:0.0:1746142900.608688:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867048832 00000100:00100000:0.0:1746142900.609484:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5152 00000100:00100000:0.0:1746142900.609492:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:31983:x1830962867048832:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142900.609621:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142900.609646:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:31983:x1830962867048832:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 155us (1256us total) trans 8589936375 rc 0/0 00000100:00100000:0.0:1746142900.609652:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5152 00002000:00010000:1.0:1746142900.611832:0:12211:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142899 -> 1746142901 00002000:00010000:1.0:1746142900.611837:0:12211:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142899 -> 1746142901 00002000:00010000:1.0:1746142900.611839:0:12211:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142899 -> 1746142901 00000100:00100000:1.0:1746142900.611856:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867688320:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142900.611881:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067ccb03f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89516 expref: 40 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.611893:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067ccb03f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89516 expref: 40 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.611946:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3ae00, rc 0) 00000100:00100000:1.0:1746142900.611979:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867048576:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3497us (3739us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142900.611986:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13445 00000100:00100000:0.0:1746142900.616947:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.617338:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867049216 00000100:00100000:1.0:1746142900.617346:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867049216 00002000:00100000:1.0:1746142900.617381:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938dc000 x1830962867049216/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 504/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.617391:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc000 with x1830962867049216 ext(0->1048575) 00002000:00010000:1.0:1746142900.617396:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dc000 00000100:00100000:1.0:1746142900.617427:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3986 00000100:00100000:1.0:1746142900.617434:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867049216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142900.622056:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867049216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4613us (5107us total) trans 0 rc 778240/778240 00000100:00100000:1.0:1746142900.622067:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3986 00002000:00100000:1.0:1746142900.622077:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938dc000 x1830962867049216/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 504/440 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.622085:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc000 with x1830962867049216 ext(0->1048575) 00002000:00010000:1.0:1746142900.622090:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dc000 00000100:00100000:0.0:1746142900.631396:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.635404:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.635578:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867049472 00000100:00100000:1.0:1746142900.635584:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867049472 00002000:00100000:1.0:1746142900.635611:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->2097151) req@ffff88012dbf4700 x1830962867049472/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 504/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.635618:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4700 with x1830962867049472 ext(1171456->2097151) 00010000:00010000:1.0:1746142900.635624:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098444600/0x2fa243e067ccaf6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c2 expref: 19 pid: 9578 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.635635:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098444600/0x2fa243e067ccaf6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c2 expref: 19 pid: 9578 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746142900.635641:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbf4700 00000100:00100000:1.0:1746142900.635661:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1238 00000100:00100000:1.0:1746142900.635667:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867049472:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142900.644213:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867049472:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 8539us (8803us total) trans 17179873784 rc 0/0 00000100:00100000:1.0:1746142900.644222:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1238 00002000:00100000:1.0:1746142900.644230:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->2097151) req@ffff88012dbf4700 x1830962867049472/t17179873784(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 504/448 e 0 to 0 dl 1746142911 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.644237:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4700 with x1830962867049472 ext(1171456->2097151) 00010000:00010000:1.0:1746142900.644244:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098444600/0x2fa243e067ccaf6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c2 expref: 21 pid: 9578 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.644254:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098444600/0x2fa243e067ccaf6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1716224->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c2 expref: 21 pid: 9578 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746142900.644258:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbf4700 00000100:00100000:0.0:1746142900.646571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.655055:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.655183:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867049856 00000100:00100000:1.0:1746142900.655191:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867049856 00002000:00100000:1.0:1746142900.655228:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dbf4e00 x1830962867049856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.655236:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4e00 with x1830962867049856 ext(1048576->2097151) 00002000:00010000:1.0:1746142900.655240:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf4e00 00000100:00100000:1.0:1746142900.656196:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3987 00000100:00100000:1.0:1746142900.656205:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867049856:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142900.665380:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867049856:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9167us (10323us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142900.665391:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3987 00002000:00100000:1.0:1746142900.665399:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dbf4e00 x1830962867049856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/440 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.665407:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4e00 with x1830962867049856 ext(1048576->2097151) 00002000:00010000:1.0:1746142900.665412:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf4e00 00000100:00100000:0.0:1746142900.670995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.677958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.678040:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867050112 00000100:00100000:1.0:1746142900.678045:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867050112 00002000:00100000:1.0:1746142900.678073:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1216511) req@ffff88012dbf5f80 x1830962867050112/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.678080:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5f80 with x1830962867050112 ext(1048576->1216511) 00010000:00010000:1.0:1746142900.678086:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 27 pid: 9578 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.678096:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 27 pid: 9578 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746142900.678101:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf5f80 00000100:00100000:1.0:1746142900.678123:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1239 00000100:00100000:1.0:1746142900.678128:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867050112:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142900.685001:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867050112:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6865us (7037us total) trans 21474841052 rc 0/0 00000100:00100000:1.0:1746142900.685011:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1239 00002000:00100000:1.0:1746142900.685020:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1216511) req@ffff88012dbf5f80 x1830962867050112/t21474841052(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/448 e 0 to 0 dl 1746142911 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.685027:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5f80 with x1830962867050112 ext(1048576->1216511) 00010000:00010000:1.0:1746142900.685035:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 29 pid: 9578 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.685048:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccaf74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1216511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894c9 expref: 29 pid: 9578 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746142900.685058:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf5f80 00000100:00100000:0.0:1746142900.694333:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.694403:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.695017:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867050368 00000100:00100000:1.0:1746142900.695022:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867050368 00000100:00100000:1.0:1746142900.695055:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14259 00000100:00100000:1.0:1746142900.695061:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+46:31993:x1830962867050368:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.695076:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.695087:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3b400/0x2fa243e067ccb05b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89532 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.695137:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695146:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695154:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695163:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695168:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695172:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695251:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a400/0x2fa243e067ccb070 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695261:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a400/0x2fa243e067ccb070 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695267:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a400/0x2fa243e067ccb070 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142900.695274:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142900.695332:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695336:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695340:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695345:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695349:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c3ae00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.695352:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695357:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695364:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142900.695366:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.695369:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695373:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccb062 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695395:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695403:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695407:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695415:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c3bc00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.695416:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695420:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695425:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736800) 00010000:00010000:1.0:1746142900.695427:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.695429:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695433:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3bc00/0x2fa243e067ccb069 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.695462:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3b400/0x2fa243e067ccb05b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89532 expref: 49 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.695470:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3a400/0x2fa243e067ccb070 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89532 expref: 48 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.695475:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142900.695476:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142900.695478:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a400, rc 0) 00000100:00100000:1.0:1746142900.695504:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+48:31993:x1830962867050368:12345-192.168.204.50@tcp:101:cat.0 Request processed in 443us (1100us total) trans 8589936376 rc 0/0 00000100:00100000:1.0:1746142900.695510:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14259 00000100:00100000:0.0:1746142900.703751:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.703873:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.703912:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.704646:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.709466:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.709488:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.709585:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867051008 00000100:00100000:1.0:1746142900.709589:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867051008 00000100:00100000:1.0:1746142900.709612:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13450 00000100:00100000:1.0:1746142900.709617:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867051136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.709623:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.709631:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c3b600/0x2fa243e067ccb085 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89547 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.709643:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.709645:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.709653:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3b600/0x2fa243e067ccb085 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89547 expref: 31 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.709666:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c3b600/0x2fa243e067ccb085 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89547 expref: 31 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.709676:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3b600, rc 0) 00000100:00100000:1.0:1746142900.709697:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+31:2003:x1830962867051136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.709703:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13450 00000100:00100000:1.0:1746142900.709748:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.709915:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867051264 00000100:00100000:1.0:1746142900.709918:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867051264 00000100:00100000:1.0:1746142900.709937:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13452 00000100:00100000:1.0:1746142900.709942:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867051264:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.709949:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.709956:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3bc00/0x2fa243e067ccb0a8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8954e expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142900.709980:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689216:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142900.710014:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03480 going to sleep for 11 seconds 00002000:00010000:1.0:1746142900.718960:0:11943:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142900 -> 1746142901 00002000:00010000:1.0:1746142900.718964:0:11943:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142900 -> 1746142901 00002000:00010000:1.0:1746142900.718965:0:11943:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142900 -> 1746142901 00000100:00100000:1.0:1746142900.718976:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689216:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142900.718992:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3bc00/0x2fa243e067ccb0a8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8954e expref: 22 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.719001:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3bc00/0x2fa243e067ccb0a8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8954e expref: 22 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.719017:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3bc00, rc 0) 00000100:00100000:0.0:1746142900.719271:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.719299:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.719770:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867051264:12345-192.168.204.50@tcp:101:cat.0 Request processed in 9826us (10020us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142900.719776:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13452 00000100:00100000:0.0:1746142900.722547:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.722610:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867052160 00000100:00100000:1.0:1746142900.722617:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867052160 00000100:00100000:1.0:1746142900.722653:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13453 00000100:00100000:1.0:1746142900.722663:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:31993:x1830962867052160:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.722676:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.722689:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067ccb0bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8955c expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.722711:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1a00/0x2fa243e067ccafc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->319487) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894de expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.722717:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.722719:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142900.722722:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067ccb0bd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8955c expref: 30 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.722774:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1a00/0x2fa243e067ccafc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->319487) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894de expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.722784:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1a00/0x2fa243e067ccafc1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 49152->319487) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894de expref: 36 pid: 9578 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.722793:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867689344:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142900.722869:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142900.730361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.730454:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867689344:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142900.730477:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067ccb0bd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8955c expref: 30 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.730492:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cc200, rc 0) 00000100:00100000:1.0:1746142900.730538:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+30:31993:x1830962867052160:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7878us (7995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.730546:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13453 00000100:00100000:0.0:1746142900.738192:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.738240:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.750586:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.750617:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.750636:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867052928 00000100:00100000:0.0:1746142900.750642:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867052928 00002000:00100000:0.0:1746142900.750668:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009809c000 x1830962867052928/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.750680:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c000 with x1830962867052928 ext(0->1048575) 00002000:00010000:0.0:1746142900.750683:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809c000 00000100:00100000:0.0:1746142900.750692:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867053184 00000100:00100000:0.0:1746142900.750694:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867053184 00002000:00100000:0.0:1746142900.750701:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809f480 x1830962867053184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.750707:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f480 with x1830962867053184 ext(1048576->2097151) 00002000:00010000:0.0:1746142900.750709:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809f480 00000100:00100000:0.0:1746142900.750717:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3991 00000100:00100000:0.0:1746142900.750721:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867053184:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142900.751299:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.751312:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867053440 00000100:00100000:1.0:1746142900.751315:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867053440 00002000:00100000:1.0:1746142900.751329:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880135d71500 x1830962867053440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.751335:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d71500 with x1830962867053440 ext(1048576->2097151) 00002000:00010000:1.0:1746142900.751339:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d71500 00000100:00100000:1.0:1746142900.751352:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3992 00000100:00100000:1.0:1746142900.751357:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2003:x1830962867053440:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142900.762859:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.765591:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867053568 00000100:00100000:1.0:1746142900.765599:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867053568 00000100:00100000:1.0:1746142900.765627:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13454 00000100:00100000:1.0:1746142900.765633:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867053568:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.765647:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.765660:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccb0c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89563 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.765677:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.765679:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.765685:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccb0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89563 expref: 39 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.765698:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccb0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89563 expref: 39 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.765712:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cd200, rc 0) 00000100:00100000:1.0:1746142900.765734:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867053568:12345-192.168.204.50@tcp:101:cat.0 Request processed in 101us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142900.765738:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13454 00000100:00100000:1.0:1746142900.766217:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867053184:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15494us (15598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142900.766224:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3991 00002000:00100000:1.0:1746142900.766229:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809f480 x1830962867053184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/440 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.766236:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f480 with x1830962867053184 ext(1048576->2097151) 00002000:00010000:1.0:1746142900.766240:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809f480 00000100:00100000:0.0:1746142900.776938:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.783995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.785013:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.785111:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867053952 00000100:00100000:1.0:1746142900.785120:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867053952 00000100:00100000:1.0:1746142900.785150:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867054080 00000100:00100000:1.0:1746142900.785152:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867054080 00000100:00100000:1.0:1746142900.785181:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13455 00000100:00100000:1.0:1746142900.785188:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:31991:x1830962867053952:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142900.785204:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.785218:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb0cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8956a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.785240:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 24 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.785248:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.785255:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed4800/0x2fa243e067ccae08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893fe expref: 39 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.785259:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.785260:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142900.785262:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb0cb lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1335296->1892351] (req 1335296->1892351) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8956a expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.785273:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed4800/0x2fa243e067ccae08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893fe expref: 39 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.785283:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed4800/0x2fa243e067ccae08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893fe expref: 39 pid: 9579 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.785293:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689600:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142900.787298:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142900.787309:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 13 pid: 1397 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.787319:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689856:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142900.787361:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 24 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.787373:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 24 pid: 1397 timeout: 774 lvb_type: 0 00000100:00100000:1.0:1746142900.787380:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689984:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142900.787396:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880091c03480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.789208:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.789227:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867054208 00000100:00100000:1.0:1746142900.789233:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867054208 00002000:00100000:1.0:1746142900.789268:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3002368->3026943) req@ffff880135d70a80 x1830962867054208/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.789277:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d70a80 with x1830962867054208 ext(3002368->3026943) 00010000:00010000:1.0:1746142900.789285:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982c6800/0x2fa243e067ccb015 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89508 expref: 40 pid: 9578 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.789295:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982c6800/0x2fa243e067ccb015 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89508 expref: 40 pid: 9578 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746142900.789301:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d70a80 00000100:00100000:0.0:1746142900.789572:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689600:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142900.790265:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1241 00000100:00100000:1.0:1746142900.790273:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867054208:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142900.790946:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.791046:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689856:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142900.791087:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d71880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867689984:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142900.791106:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb0cb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1335296->1892351] (req 1335296->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8956a expref: 23 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.791117:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cd800, rc 0) 00000100:00100000:0.0:1746142900.791137:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:31991:x1830962867053952:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5950us (7152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142900.791142:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13455 00000100:00100000:0.0:1746142900.793463:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867054464 00000100:00100000:0.0:1746142900.793470:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867054464 00010000:00010000:0.0:1746142900.793491:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 14 pid: 1397 timeout: 774 lvb_type: 1 00000100:00100000:0.0:1746142900.793521:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5970 00000100:00100000:0.0:1746142900.793528:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867054464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142900.793536:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142900.793558:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 14 pid: 1397 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746142900.793568:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 14 pid: 1397 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746142900.793583:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccaf12 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89498 expref: 14 pid: 1397 timeout: 774 lvb_type: 1 00010000:00010000:0.0:1746142900.794623:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142900.794670:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867054464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1141us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142900.794678:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5970 00000100:00100000:0.0:1746142900.795158:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867054592 00000100:00100000:0.0:1746142900.795163:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867054592 00010000:00010000:0.0:1746142900.795180:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 23 pid: 1397 timeout: 774 lvb_type: 0 00000100:00100000:0.0:1746142900.795200:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5971 00000100:00100000:0.0:1746142900.795205:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867054592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142900.795213:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142900.795223:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 23 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.795232:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 23 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.795245:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07400/0x2fa243e067ccadde lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb893db expref: 23 pid: 1397 timeout: 774 lvb_type: 0 00010000:00010000:0.0:1746142900.795254:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142900.795255:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142900.795261:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb0cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8956a expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.795268:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb0cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1892351) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8956a expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142900.795291:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb0cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8956a expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142900.795301:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867690112:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142900.795358:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142900.798735:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867054208:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8455us (9524us total) trans 17179873785 rc 0/0 00000100:00100000:1.0:1746142900.798746:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1241 00002000:00100000:1.0:1746142900.798756:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3002368->3026943) req@ffff880135d70a80 x1830962867054208/t17179873785(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/448 e 0 to 0 dl 1746142911 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.798765:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d70a80 with x1830962867054208 ext(3002368->3026943) 00010000:00010000:1.0:1746142900.798774:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982c6800/0x2fa243e067ccb015 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89508 expref: 41 pid: 9578 timeout: 774 lvb_type: 0 00010000:00010000:1.0:1746142900.798786:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982c6800/0x2fa243e067ccb015 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3002368->3026943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89508 expref: 41 pid: 9578 timeout: 774 lvb_type: 0 00002000:00010000:1.0:1746142900.798792:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d70a80 00000100:00100000:0.0:1746142900.799007:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.799266:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867054848 00000100:00100000:1.0:1746142900.799271:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867054848 00002000:00100000:1.0:1746142900.799291:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1335296->1339391) req@ffff880099e88000 x1830962867054848/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.799297:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88000 with x1830962867054848 ext(1335296->1339391) 00002000:00010000:1.0:1746142900.799300:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e88000 00000100:00100000:1.0:1746142900.799310:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3993 00000100:00100000:1.0:1746142900.799315:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867054848:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142900.799387:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867054848:12345-192.168.204.50@tcp:3:cat.0 Request processed in 72us (381us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142900.799392:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 3993 00002000:00100000:1.0:1746142900.799395:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1335296->1339391) req@ffff880099e88000 x1830962867054848/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:51/0 lens 488/4536 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142900.799401:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88000 with x1830962867054848 ext(1335296->1339391) 00002000:00010000:1.0:1746142900.799403:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e88000 00000100:00100000:0.0:1746142900.808221:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.825379:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.850491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.858606:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.858633:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.880774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.886444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.886475:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.886820:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867056384 00000100:00100000:1.0:1746142900.886827:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867056384 00010000:00010000:1.0:1746142900.886854:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098445200/0x2fa243e067ccaf20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8949f expref: 11 pid: 1397 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.886974:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867056512 00000100:00100000:1.0:1746142900.886977:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867056512 00010000:00010000:1.0:1746142900.886989:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3fc00/0x2fa243e067ccaee1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8947c expref: 41 pid: 12211 timeout: 774 lvb_type: 1 00000100:00100000:1.0:1746142900.892585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.895061:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.904996:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.905042:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.905074:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867057408 00000100:00100000:0.0:1746142900.905081:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867057408 00000100:00100000:1.0:1746142900.905139:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14262 00000100:00100000:1.0:1746142900.905149:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+61:32001:x1830962867057408:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142900.905169:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.905184:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2200/0x2fa243e067ccb103 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89586 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.905241:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905251:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905260:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905270:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905275:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905280:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905349:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067ccb118 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905358:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067ccb118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905363:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067ccb118 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142900.905370:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142900.905420:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905425:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905430:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905435:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905440:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc3200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.905443:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905448:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905456:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142900.905459:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.905461:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905469:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067ccb10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905496:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905504:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905508:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905512:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc3a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.905515:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905519:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905525:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736a00) 00010000:00010000:1.0:1746142900.905527:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.905529:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905533:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3a00/0x2fa243e067ccb111 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.905572:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2200/0x2fa243e067ccb103 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89586 expref: 64 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.905581:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067ccb118 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89586 expref: 63 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.905591:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142900.905593:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142900.905595:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2e00, rc 0) 00000100:00100000:1.0:1746142900.905615:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+63:32001:x1830962867057408:12345-192.168.204.50@tcp:101:cat.0 Request processed in 468us (573us total) trans 8589936382 rc 0/0 00000100:00100000:1.0:1746142900.905620:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14262 00000100:00100000:0.0:1746142900.907679:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.907720:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.907896:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867057792 00000100:00100000:1.0:1746142900.907917:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867057792 00000100:00100000:1.0:1746142900.907943:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5156 00000100:00100000:1.0:1746142900.907947:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+64:31997:x1830962867057792:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142900.908059:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+64:31997:x1830962867057792:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 110us (338us total) trans 8589936383 rc 0/0 00000100:00100000:1.0:1746142900.908065:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5156 00000100:00100000:0.0:1746142900.910835:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.910884:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.920648:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.938590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.946140:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.961559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.961604:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867058816 00000100:00100000:1.0:1746142900.961611:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867058816 00000100:00100000:1.0:1746142900.961656:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14263 00000100:00100000:1.0:1746142900.961662:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+50:32004:x1830962867058816:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142900.961678:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142900.961693:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322200/0x2fa243e067ccb13b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895a2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.961747:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961757:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961768:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961778:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961782:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961786:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961853:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322400/0x2fa243e067ccb150 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961861:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131322400/0x2fa243e067ccb150 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961865:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322400/0x2fa243e067ccb150 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142900.961871:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142900.961952:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961958:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961962:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961967:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961981:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131322a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.961985:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961991:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.961999:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142900.962002:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.962005:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962009:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccb142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962023:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962027:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962031:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962034:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131322800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142900.962036:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962040:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962045:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736200) 00010000:00010000:1.0:1746142900.962047:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142900.962049:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962056:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131322800/0x2fa243e067ccb149 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142900.962083:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131322200/0x2fa243e067ccb13b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895a2 expref: 53 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.962092:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322400/0x2fa243e067ccb150 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895a2 expref: 52 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142900.962098:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142900.962099:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142900.962101:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322400, rc 0) 00000100:00100000:1.0:1746142900.962133:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+52:32004:x1830962867058816:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 471us (591us total) trans 8589936384 rc 0/0 00000100:00100000:1.0:1746142900.962139:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14263 00000100:00100000:0.0:1746142900.962582:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.966735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.966786:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867059328 00000100:00100000:1.0:1746142900.966792:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867059328 00000100:00100000:0.0:1746142900.967647:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.972507:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867059584 00000100:00100000:0.0:1746142900.972515:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867059584 00002000:00100000:0.0:1746142900.972554:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012d4c1500 x1830962867059584/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/0 e 0 to 0 dl 1746142911 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142900.972568:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c1500 with x1830962867059584 ext(1048576->2097151) 00002000:00010000:0.0:1746142900.972573:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c1500 00000100:00100000:0.0:1746142900.972598:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 3999 00000100:00100000:0.0:1746142900.972605:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867059584:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142900.996487:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142900.996542:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142900.998084:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4001 00000100:00100000:1.0:1746142900.998096:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867060096:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.014384:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867060096:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16284us (17833us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142901.014394:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4001 00002000:00100000:1.0:1746142901.014403:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096143100 x1830962867060096/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:51/0 lens 488/440 e 0 to 0 dl 1746142911 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.014411:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096143100 with x1830962867060096 ext(2097152->4194303) 00002000:00010000:1.0:1746142901.014417:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096143100 00000100:00100000:0.0:1746142901.023570:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.023627:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867060352 00000100:00100000:1.0:1746142901.023636:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867060352 00002000:00100000:1.0:1746142901.023697:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880096143b80 x1830962867060352/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.023707:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096143b80 with x1830962867060352 ext(4194304->5033983) 00002000:00010000:1.0:1746142901.023712:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096143b80 00000100:00100000:1.0:1746142901.024758:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4002 00000100:00100000:1.0:1746142901.024767:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867060352:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.037679:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.037715:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867060608 00000100:00100000:0.0:1746142901.037722:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867060608 00000100:00100000:0.0:1746142901.037783:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14264 00000100:00100000:0.0:1746142901.037790:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+63:32006:x1830962867060608:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142901.037809:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.037826:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb15e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895a9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.037982:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867060352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13215us (14416us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142901.037991:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4002 00002000:00100000:1.0:1746142901.037998:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880096143b80 x1830962867060352/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.038005:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096143b80 with x1830962867060352 ext(4194304->5033983) 00002000:00010000:1.0:1746142901.038009:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096143b80 00010000:00010000:1.0:1746142901.038582:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038593:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038607:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038618:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038624:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038630:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038708:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098291a00/0x2fa243e067ccb173 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038717:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098291a00/0x2fa243e067ccb173 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038723:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098291a00/0x2fa243e067ccb173 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142901.038730:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.038785:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038791:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038796:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038801:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038805:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098290400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.038808:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038813:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038823:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142901.038825:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.038829:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038833:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067ccb165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038958:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038964:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038968:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038971:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098290000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.038973:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038977:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038983:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736300) 00010000:00010000:1.0:1746142901.038984:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.038986:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.038990:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098290000/0x2fa243e067ccb16c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.039020:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb15e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895a9 expref: 66 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.039030:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098291a00/0x2fa243e067ccb173 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895a9 expref: 65 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.039036:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.039038:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142901.039040:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098291a00, rc 0) 00000100:00100000:1.0:1746142901.039067:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+65:32006:x1830962867060608:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1278us (1396us total) trans 8589936386 rc 0/0 00000100:00100000:1.0:1746142901.039073:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14264 00000100:00100000:0.0:1746142901.049890:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.051098:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.082196:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142901.083616:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142901.085626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:0.0:1746142901.086236:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142901.091235:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.091271:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867061504 00000100:00100000:1.0:1746142901.091278:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867061504 00000100:00100000:1.0:1746142901.091332:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14265 00000100:00100000:1.0:1746142901.091339:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+52:32010:x1830962867061504:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.091357:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.091370:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccb188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895b7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.091423:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091433:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091441:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091452:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091457:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091461:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091526:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccb19d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091534:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccb19d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091539:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccb19d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142901.091560:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.091617:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091623:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091628:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091633:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091638:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.091641:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091646:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091654:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142901.091657:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.091660:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091665:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccb18f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091688:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091692:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091697:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091701:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471e800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.091703:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091707:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091712:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736100) 00010000:00010000:1.0:1746142901.091714:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.091716:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091720:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccb196 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.091749:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccb188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895b7 expref: 55 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.091758:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccb19d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895b7 expref: 54 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.091817:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.091820:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142901.091823:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ee00, rc 0) 00000100:00100000:1.0:1746142901.092617:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+54:32010:x1830962867061504:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1276us (1385us total) trans 8589936388 rc 0/0 00000100:00100000:1.0:1746142901.092624:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14265 00000100:00100000:1.0:1746142901.092791:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.093333:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867061760 00000100:00100000:0.0:1746142901.093338:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867061760 00002000:00100000:0.0:1746142901.093361:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1552384->1556479) req@ffff880135d71880 x1830962867061760/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.093375:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d71880 with x1830962867061760 ext(1552384->1556479) 00002000:00010000:0.0:1746142901.093378:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d71880 00000100:00100000:0.0:1746142901.093501:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4003 00000100:00100000:0.0:1746142901.093511:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867061760:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142901.093661:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867061760:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 150us (867us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142901.093667:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4003 00002000:00100000:0.0:1746142901.093673:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1552384->1556479) req@ffff880135d71880 x1830962867061760/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.093679:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d71880 with x1830962867061760 ext(1552384->1556479) 00002000:00010000:0.0:1746142901.093682:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d71880 00000100:00100000:0.0:1746142901.097047:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.100205:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.102962:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.103291:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867062144 00000100:00100000:0.0:1746142901.103297:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867062144 00000100:00100000:0.0:1746142901.103328:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13463 00000100:00100000:0.0:1746142901.103335:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:32004:x1830962867062144:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142901.103347:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.103361:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895c5 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.103383:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3ec00/0x2fa243e067ccb04d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89524 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.103395:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982c6600/0x2fa243e067ccb08c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89540 expref: 25 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.103400:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.103402:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.103405:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1339391] (req 1048576->1339391) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895c5 expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.103426:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982c6600/0x2fa243e067ccb08c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89540 expref: 25 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.103437:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982c6600/0x2fa243e067ccb08c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89540 expref: 25 pid: 9579 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746142901.103446:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867691648:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142901.103531:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3ec00/0x2fa243e067ccb04d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89524 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.103540:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3ec00/0x2fa243e067ccb04d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89524 expref: 40 pid: 1852 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746142901.103560:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096095180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867691776:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.103581:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.106603:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.108248:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.112469:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.114512:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867062784 00000100:00100000:0.0:1746142901.114518:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867062784 00000100:00100000:0.0:1746142901.114559:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13464 00000100:00100000:0.0:1746142901.114566:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32006:x1830962867062784:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142901.114577:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.114591:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895cc expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.114610:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067ccb0bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8955c expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.114618:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccb0c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89563 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.114624:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.114625:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.114629:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [942080->1048575] (req 942080->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895cc expref: 40 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.114651:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccb0c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89563 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.114661:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccb0c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89563 expref: 40 pid: 11943 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746142901.114671:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867692032:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142901.115695:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067ccb0bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8955c expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.115706:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968cc200/0x2fa243e067ccb0bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8955c expref: 28 pid: 11943 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746142901.115715:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867692160:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.115731:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.116831:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.120168:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867692032:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.120177:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867692160:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142901.120204:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [942080->1048575] (req 942080->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895cc expref: 40 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.120218:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba200, rc 0) 00000100:00100000:0.0:1746142901.120239:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32006:x1830962867062784:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5674us (5753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.120245:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13464 00000100:00100000:0.0:1746142901.121981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.122012:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.126278:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.126372:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.130455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.134933:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.135754:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.139435:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.139742:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867064320 00000100:00100000:0.0:1746142901.139749:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867064320 00002000:00100000:0.0:1746142901.139773:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3375104->3674111) req@ffff8801355d0000 x1830962867064320/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.139783:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0000 with x1830962867064320 ext(3375104->3674111) 00010000:00010000:0.0:1746142901.139789:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccb0fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8957f expref: 39 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746142901.139797:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccb0fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8957f expref: 39 pid: 11943 timeout: 775 lvb_type: 0 00002000:00010000:0.0:1746142901.139802:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801355d0000 00000100:00100000:0.0:1746142901.139824:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1244 00000100:00100000:0.0:1746142901.139829:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867064320:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142901.145707:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.151651:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.156803:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.158321:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.170437:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.171999:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.172846:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867065472 00000100:00100000:0.0:1746142901.172852:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867065472 00000100:00100000:0.0:1746142901.172894:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14266 00000100:00100000:0.0:1746142901.172928:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+19:32012:x1830962867065472:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142901.172943:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.172957:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067ccb1ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895e1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.172998:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173010:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173019:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173028:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173033:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173037:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173090:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.173103:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccafe4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894fa expref: 52 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.173109:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.173166:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccafe4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894fa expref: 52 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.173177:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccafe4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb894fa expref: 52 pid: 10924 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.173187:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096096300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867692928:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.173252:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.174750:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096096300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867692928:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.174767:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142901.176400:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.177751:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142901.178052:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178059:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142901.178088:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142901.178091:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142901.178101:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178110:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178122:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178127:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178132:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178137:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178142:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cde00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.178145:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178151:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178158:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142901.178161:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.178163:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178168:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cde00/0x2fa243e067ccb1d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178193:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178198:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178203:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178207:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cc600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.178209:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178213:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178220:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4100) 00010000:00010000:1.0:1746142901.178222:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.178224:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178228:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067ccb1dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.178255:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067ccb1ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895e1 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.178265:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895e1 expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.178270:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.178272:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142901.178274:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc200, rc 0) 00000100:00100000:1.0:1746142901.178305:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+20:32012:x1830962867065472:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5405us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.178311:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14266 00000100:00100000:0.0:1746142901.179819:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.179841:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.179857:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.179869:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.179977:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867065984 00000100:00100000:0.0:1746142901.179978:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.179983:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867065984 00000100:00100000:0.0:1746142901.180000:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.180103:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867066112 00000100:00100000:1.0:1746142901.180106:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867066112 00000100:00100000:1.0:1746142901.180240:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867066368 00000100:00100000:1.0:1746142901.180244:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867066368 00000100:00100000:1.0:1746142901.180258:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13469 00000100:00100000:1.0:1746142901.180262:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867066240:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142901.180268:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.180274:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccb1f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb895f6 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.180294:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867693312:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.180591:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.181365:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.181384:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.181480:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867066752 00000100:00100000:1.0:1746142901.181483:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867066752 00000100:00100000:1.0:1746142901.181500:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867066880 00000100:00100000:1.0:1746142901.181501:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867066880 00000100:00100000:1.0:1746142901.181513:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13473 00000100:00100000:1.0:1746142901.181517:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867066752:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.181524:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.181530:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccb214 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89612 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.181567:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867693440:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.181602:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.181658:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13474 00000100:00100000:0.0:1746142901.181664:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867066880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.181670:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.181676:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067ccb21b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89619 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.181695:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867693568:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142901.181756:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.182242:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867693312:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.182255:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccb1f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895f6 expref: 15 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.182264:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccb1f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895f6 expref: 15 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.182271:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1000, rc 0) 00000100:00100000:1.0:1746142901.182287:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867066240:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2024us (2429us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.182292:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13469 00000100:00100000:1.0:1746142901.182830:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867693440:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.182853:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccb214 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89612 expref: 30 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.182861:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccb214 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89612 expref: 30 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.182867:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0c00, rc 0) 00000100:00100000:1.0:1746142901.182883:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867066752:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1365us (1518us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.182888:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13473 00000100:00100000:0.0:1746142901.185012:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.185146:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867067136 00000100:00100000:1.0:1746142901.185153:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867067136 00000100:00100000:1.0:1746142901.185195:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14267 00000100:00100000:1.0:1746142901.185201:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+20:32012:x1830962867067136:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142901.185214:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.185226:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067ccb222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89620 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.185302:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.185315:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895e1 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.185321:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.185342:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895e1 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.185349:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc200/0x2fa243e067ccb1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895e1 expref: 21 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.185356:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867693696:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.185414:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.186433:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.186476:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867693696:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.186503:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142901.186928:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142901.187001:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.187007:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142901.187019:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.187101:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067ccb222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89620 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.187111:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89620 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.187117:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.187119:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746142901.187121:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1e00, rc 0) 00000100:00100000:1.0:1746142901.187139:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+21:32012:x1830962867067136:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1939us (2133us total) trans 8589936391 rc 0/0 00000100:00100000:1.0:1746142901.187145:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14267 00000100:00100000:0.0:1746142901.190763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.191021:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867067648 00000100:00100000:1.0:1746142901.191030:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867067648 00000100:00100000:1.0:1746142901.191076:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14268 00000100:00100000:1.0:1746142901.191084:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+21:32012:x1830962867067648:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142901.191098:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.191113:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccb237 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89627 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.191392:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.191405:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89620 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.191412:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.191435:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89620 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.191445:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccb229 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89620 expref: 22 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.191455:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867693824:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.191506:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.194027:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.194061:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.194160:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13476 00000100:00100000:1.0:1746142901.194167:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867067904:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.194178:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.194191:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1200/0x2fa243e067ccb245 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89635 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.194232:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867693952:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.194300:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.194333:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867693824:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.194360:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142901.194869:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142901.195080:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.195086:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142901.195123:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142901.195127:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142901.195140:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.195163:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccb237 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89627 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.195179:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89627 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.195185:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142901.195188:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142901.195190:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0600, rc 0) 00000100:00100000:0.0:1746142901.195211:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+21:32012:x1830962867067648:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4128us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.195218:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14268 00000100:00100000:1.0:1746142901.196386:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867693952:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.196415:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1200/0x2fa243e067ccb245 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89635 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.196425:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1200/0x2fa243e067ccb245 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89635 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.196434:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1200, rc 0) 00000100:00100000:1.0:1746142901.196452:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867067904:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2286us (2391us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.196687:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13476 00000100:00100000:0.0:1746142901.198074:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.198113:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.198140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.198154:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.198207:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13477 00000100:00100000:0.0:1746142901.198208:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.198215:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867068160:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142901.198228:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.198239:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb253 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8963c expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.198272:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867694464:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.198594:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13481 00000100:00100000:1.0:1746142901.198600:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2003:x1830962867068672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.198607:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.198613:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067ccb26f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89658 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.198633:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867694720:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.198654:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.198663:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.199761:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867694720:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.199785:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067ccb26f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89658 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.199793:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067ccb26f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89658 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.199800:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0000, rc 0) 00000100:00100000:1.0:1746142901.199820:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2003:x1830962867068672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1220us (1612us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.199825:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13481 00000100:00100000:1.0:1746142901.199849:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867694464:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.199971:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb253 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8963c expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.199979:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb253 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8963c expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.199986:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1c00, rc 0) 00000100:00100000:1.0:1746142901.200002:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867068160:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1788us (1931us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.200007:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13477 00000100:00100000:0.0:1746142901.202996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.203040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.203284:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867068928 00000100:00100000:1.0:1746142901.203292:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867068928 00000100:00100000:1.0:1746142901.203329:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14269 00000100:00100000:1.0:1746142901.203335:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+21:32012:x1830962867068928:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142901.203350:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.203365:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbaa00/0x2fa243e067ccb276 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8965f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.203413:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.203473:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.203484:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142901.203494:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.203537:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbaa00/0x2fa243e067ccb276 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8965f expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.203561:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8965f expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.203567:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.203569:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142901.203572:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbb200, rc 0) 00000100:00100000:1.0:1746142901.203697:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+23:32012:x1830962867068928:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 361us (707us total) trans 8589936393 rc 0/0 00000100:00100000:1.0:1746142901.203703:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14269 00000100:00100000:0.0:1746142901.207085:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.207124:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.207155:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.207180:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.207192:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.207211:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.207839:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13484 00000100:00100000:1.0:1746142901.207845:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867069568:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142901.207864:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.207874:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895c5 expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.207879:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142901.207880:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142901.207882:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.207895:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895c5 expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.207925:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895c5 expref: 24 pid: 11943 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.207933:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867695104:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.207960:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.207975:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13486 00000100:00100000:1.0:1746142901.207979:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867069824:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142901.207993:0:9579:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.208001:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098290400/0x2fa243e067ccb1c7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895da expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.208008:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccb20d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89604 expref: 14 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.208017:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.208018:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.208020:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.208032:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccb20d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89604 expref: 14 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.208038:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccb20d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89604 expref: 14 pid: 9580 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746142901.208045:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867695616:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.208063:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098290400/0x2fa243e067ccb1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895da expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.208069:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098290400/0x2fa243e067ccb1c7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895da expref: 28 pid: 11943 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.208075:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867695744:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.208089:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d240 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.212374:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867695104:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.212398:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.212507:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867695616:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.212515:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867695744:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142901.212535:0:9579:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.212652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.212700:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.212818:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1245 00000100:00100000:0.0:1746142901.212826:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867070208:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142901.215521:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867070080 00000100:00100000:1.0:1746142901.215528:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867070080 00002000:00100000:1.0:1746142901.215562:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (942080->1048575) req@ffff880096141880 x1830962867070080/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.215572:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141880 with x1830962867070080 ext(942080->1048575) 00010000:00010000:1.0:1746142901.215579:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895cc expref: 40 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.215588:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895cc expref: 40 pid: 11943 timeout: 775 lvb_type: 0 00002000:00010000:1.0:1746142901.215593:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096141880 00000100:00100000:1.0:1746142901.215620:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1247 00000100:00100000:1.0:1746142901.215627:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867070080:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142901.217510:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867070592 00000100:00100000:1.0:1746142901.217520:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867070592 00010000:00010000:1.0:1746142901.217562:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccb12d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89594 expref: 43 pid: 1852 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746142901.217591:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5988 00000100:00100000:1.0:1746142901.217598:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867071104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.217609:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.217625:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x2fa243e067ccb0d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89571 expref: 27 pid: 9579 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.217642:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x2fa243e067ccb0d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89571 expref: 27 pid: 9579 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.217662:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107a00/0x2fa243e067ccb0d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89571 expref: 27 pid: 9579 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.217679:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.217713:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867071104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.217719:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5988 00000100:00100000:0.0:1746142901.217961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.218000:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.218014:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.218046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142901.218986:0:9579:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.218993:0:9579:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219003:0:9579:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219008:0:9579:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219013:0:9579:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219018:0:9579:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fbae00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142901.219020:0:9579:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219029:0:9579:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219037:0:9579:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.219041:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccb2a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.219072:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867069824:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 11092us (11879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.219077:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13486 00000100:00100000:1.0:1746142901.221248:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867071360 00000100:00100000:1.0:1746142901.221255:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867071360 00010000:00010000:1.0:1746142901.221281:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccb054 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8952b expref: 42 pid: 1852 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.221316:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5994 00000100:00100000:1.0:1746142901.221323:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867071360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.221333:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.221348:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccb054 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8952b expref: 42 pid: 1852 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.221358:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccb054 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8952b expref: 42 pid: 1852 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.221374:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccb054 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8952b expref: 42 pid: 1852 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.221386:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.221387:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.221390:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800923f0000/0x2fa243e067ccb2a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.221397:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800923f0000/0x2fa243e067ccb2a0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.221425:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.221453:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867071360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.221459:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5994 00000100:00100000:0.0:1746142901.222430:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867070336:12345-192.168.204.50@tcp:4:cat.0 Request processed in 9564us (9729us total) trans 17179873788 rc 0/0 00000100:00100000:0.0:1746142901.222438:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1246 00002000:00100000:0.0:1746142901.222445:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1339391) req@ffff8801355d2a00 x1830962867070336/t17179873788(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/448 e 0 to 0 dl 1746142912 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.222457:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d2a00 with x1830962867070336 ext(1048576->1339391) 00010000:00010000:0.0:1746142901.222466:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895c5 expref: 26 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746142901.222475:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccb1b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1339391) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895c5 expref: 26 pid: 11943 timeout: 775 lvb_type: 0 00002000:00010000:0.0:1746142901.222480:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801355d2a00 00000100:00100000:0.0:1746142901.226264:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.226364:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867070080:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 10650us (11669us total) trans 21474841055 rc 0/0 00000100:00100000:1.0:1746142901.226374:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1247 00002000:00100000:1.0:1746142901.226383:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (942080->1048575) req@ffff880096141880 x1830962867070080/t21474841055(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/448 e 0 to 0 dl 1746142912 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.226392:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141880 with x1830962867070080 ext(942080->1048575) 00010000:00010000:1.0:1746142901.226400:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895cc expref: 41 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.226411:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fba200/0x2fa243e067ccb1b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 942080->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895cc expref: 41 pid: 11943 timeout: 775 lvb_type: 0 00002000:00010000:1.0:1746142901.226417:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096141880 00010000:00010000:1.0:1746142901.227922:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227929:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227943:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227949:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227956:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227961:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fba600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142901.227964:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227971:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227985:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.227990:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba600/0x2fa243e067ccb299 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.228031:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867069568:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 20185us (20875us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.228038:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13484 00000100:00100000:0.0:1746142901.228486:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.229861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.229909:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867071744 00000100:00100000:1.0:1746142901.229915:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867071744 00010000:00010000:1.0:1746142901.229931:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccb1c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1671167) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb895d3 expref: 42 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746142901.230031:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230039:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230051:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230057:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230062:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230067:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142901.230070:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230076:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230084:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.230094:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1a00/0x2fa243e067ccb292 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.230137:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867069440:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 22351us (23012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.230143:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13483 00000100:00100000:0.0:1746142901.233649:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.233781:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867072000 00000100:00100000:1.0:1746142901.233788:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867072000 00000100:00100000:1.0:1746142901.234227:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14270 00000100:00100000:1.0:1746142901.234234:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+23:32012:x1830962867072000:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1746142901.234289:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1746142901.234308:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccb23e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89627 expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234323:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067cca732 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89015 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234331:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.234334:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142901.234354:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe000/0x2fa243e067ccb2b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.234363:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25000/0x2fa243e067cca85f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890e0 expref: 65 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234372:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067cca8dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89126 expref: 53 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234377:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 53 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234382:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6e00/0x2fa243e067cca72b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8900e expref: 53 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234387:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe000/0x2fa243e067ccb2b5 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.234410:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6e00/0x2fa243e067cca72b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8900e expref: 53 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234418:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6e00/0x2fa243e067cca72b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8900e expref: 53 pid: 7230 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.234428:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867696256:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.234579:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 53 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234587:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 53 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.234594:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867696384:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.234617:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067cca8dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89126 expref: 53 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234623:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067cca8dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89126 expref: 53 pid: 7230 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.234629:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867696512:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.234649:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25000/0x2fa243e067cca85f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890e0 expref: 65 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.234656:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb25000/0x2fa243e067cca85f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb890e0 expref: 65 pid: 10924 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.234662:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867696640:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.234678:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.237826:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.238003:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.238020:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.238271:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.238320:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867072256 00000100:00100000:0.0:1746142901.238323:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867072256 00010000:00010000:0.0:1746142901.238335:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 55 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746142901.238757:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6001 00000100:00100000:0.0:1746142901.238762:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+52:2006:x1830962867072256:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142901.238768:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142901.238771:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 52 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746142901.238843:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 52 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746142901.238854:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067cca71d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89007 expref: 52 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:0.0:1746142901.238862:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142901.238865:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe000/0x2fa243e067ccb2b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.238871:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe000/0x2fa243e067ccb2b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.238877:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800987fe000/0x2fa243e067ccb2b5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142901.238894:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142901.238923:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+51:2006:x1830962867072256:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 161us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.238928:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6001 00000100:00100000:0.0:1746142901.239208:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.243468:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13490 00000100:00100000:0.0:1746142901.243474:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3764:x1830962867696768:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746142901.243581:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.243588:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.243592:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.243596:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa50400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.243598:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.243606:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.243614:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.243616:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.243618:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.243623:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cca724 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00000100:00100000:1.0:1746142901.243644:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13492 00000100:00100000:1.0:1746142901.243650:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3762:x1830962867696896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.244970:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3764:x1830962867696768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1497us (1838us total) trans 21474841057 rc 0/0 00000100:00100000:1.0:1746142901.244975:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3762:x1830962867696896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1324us (1775us total) trans 21474841059 rc 0/0 00000100:00100000:0.0:1746142901.244975:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13490 00000100:00100000:1.0:1746142901.244981:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13492 00000100:00100000:0.0:1746142901.244984:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13494 00000100:00100000:0.0:1746142901.244988:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3762:x1830962867697024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.244993:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13495 00000100:00100000:1.0:1746142901.244998:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3762:x1830962867697536:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142901.245024:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fdb480/2, rc 0, transno 21474841059 00000100:00100000:0.0:1746142901.245028:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3762:x1830962867697024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (1780us total) trans 21474841062 rc 0/0 00000100:00100000:1.0:1746142901.245029:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867696896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.245033:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13494 00000004:00080000:1.0:1746142901.245036:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092d0aa00/2, rc 0, transno 21474841061 00000100:00100000:0.0:1746142901.245099:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867697920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.245113:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.245122:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867698432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.245133:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.245145:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867697920 00000100:00100000:0.0:1746142901.245147:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867697920 00000100:00100000:0.0:1746142901.245159:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867698816 00000100:00100000:0.0:1746142901.245173:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867698816 00000100:00100000:0.0:1746142901.245181:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13497 00000100:00100000:0.0:1746142901.245665:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867698304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142901.245701:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142901.245704:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142901.245705:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142901.245707:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142901.245709:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142901.245741:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867698304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 555us (637us total) trans 17179873794 rc 0/0 00000100:00100000:0.0:1746142901.245746:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13497 00000004:00080000:0.0:1746142901.245765:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c5c00/2, rc 0, transno 17179873790 00000100:00100000:0.0:1746142901.245768:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867697920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142901.245773:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c5500/2, rc 0, transno 17179873791 00000100:00100000:0.0:1746142901.245775:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867698432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.246086:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867697408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.246096:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.246118:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.246130:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.246143:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746142901.246158:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd9f80/2, rc 0, transno 21474841062 00000100:00100000:1.0:1746142901.246161:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867697024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.246166:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746142901.246170:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.246183:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.246193:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.246193:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867698048 00000100:00100000:0.0:1746142901.246196:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867698048 00000100:00100000:1.0:1746142901.246204:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.246256:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867698176 00000100:00100000:0.0:1746142901.246256:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867698560 00000100:00100000:1.0:1746142901.246259:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867698176 00000100:00100000:1.0:1746142901.246276:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13502 00000100:00100000:1.0:1746142901.246280:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3762:x1830962867698176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.246343:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3762:x1830962867698176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (159us total) trans 17179873795 rc 0/0 00000100:00100000:1.0:1746142901.246348:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13502 00000004:00080000:1.0:1746142901.246368:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c5180/2, rc 0, transno 17179873795 00000100:00100000:1.0:1746142901.246371:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698176:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142901.246377:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c7800/2, rc 0, transno 17179873797 00000100:00100000:1.0:1746142901.246380:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698688:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142901.246386:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c6a00/2, rc 0, transno 17179873796 00000100:00100000:1.0:1746142901.246388:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.246421:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867698560 00002000:00010000:1.0:1746142901.246429:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142901.246431:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142901.246433:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142901.246434:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142901.246436:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142901.246437:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13504 00000100:00100000:0.0:1746142901.246441:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3762:x1830962867698560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.246456:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3762:x1830962867697536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1458us (3186us total) trans 21474841063 rc 0/0 00000100:00100000:1.0:1746142901.246461:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13495 00002000:00010000:0.0:1746142901.246478:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00000004:00080000:1.0:1746142901.246479:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092d08380/2, rc 0, transno 21474841063 00002000:00010000:0.0:1746142901.246480:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00000100:00100000:1.0:1746142901.246481:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867697536:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142901.246482:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142901.246484:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142901.246486:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142901.246508:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3762:x1830962867698560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (363us total) trans 17179873798 rc 0/0 00000100:00100000:0.0:1746142901.246513:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13504 00000004:00080000:1.0:1746142901.246514:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c6300/2, rc 0, transno 17179873798 00000100:00100000:1.0:1746142901.246517:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867698560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.247222:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.247258:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.247353:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867073024 00000100:00100000:1.0:1746142901.247356:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867073024 00010000:00010000:1.0:1746142901.247369:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8965f expref: 8 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.247402:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6002 00000100:00100000:1.0:1746142901.247407:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867073024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.247413:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.247417:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8965f expref: 9 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.247609:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8965f expref: 8 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.247623:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb200/0x2fa243e067ccb27d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8965f expref: 8 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.247632:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.247636:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccb2d1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.247645:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccb2d1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.247649:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccb2d1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.247697:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.247720:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:2003:x1830962867073024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 313us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.247725:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6002 00000100:00100000:0.0:1746142901.250214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.253413:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.255053:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.255094:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867073664 00000100:00100000:0.0:1746142901.255098:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867073664 00000100:00100000:0.0:1746142901.255183:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5163 00000100:00100000:0.0:1746142901.255189:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32012:x1830962867073664:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1746142901.255518:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:32012:x1830962867073664:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 328us (465us total) trans 8589936397 rc 0/0 00000100:00100000:0.0:1746142901.255524:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5163 00000100:00100000:0.0:1746142901.259010:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.261052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.261567:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867074048 00000100:00100000:1.0:1746142901.261573:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867074048 00010000:00010000:1.0:1746142901.261595:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067ccb2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8966d expref: 9 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.261628:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6003 00000100:00100000:1.0:1746142901.261634:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867074048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.261645:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.261650:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067ccb2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8966d expref: 9 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.261659:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067ccb2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8966d expref: 9 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.261675:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093379a00/0x2fa243e067ccb2d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8966d expref: 9 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.261695:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.261700:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.261708:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.261713:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.261738:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.262232:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867074048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 597us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.262239:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6003 00000100:00100000:0.0:1746142901.265055:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867699584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.265118:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.265128:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265134:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867700096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.265153:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.265158:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867699584 00000100:00100000:0.0:1746142901.265160:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867699584 00000100:00100000:1.0:1746142901.265169:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265177:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867699968 00000100:00100000:0.0:1746142901.265179:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867699968 00000100:00100000:1.0:1746142901.265183:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.265190:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867700480 00000100:00100000:0.0:1746142901.265191:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867700480 00000100:00100000:1.0:1746142901.265199:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.265204:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13506 00000100:00100000:0.0:1746142901.265208:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3764:x1830962867699456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.265211:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.265217:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.265258:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.265271:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746142901.265276:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.265297:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.265298:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3764:x1830962867699456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (198us total) trans 21474841064 rc 0/0 00000100:00100000:0.0:1746142901.265303:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13506 00000100:00100000:1.0:1746142901.265305:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.265312:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867700736 00000100:00100000:0.0:1746142901.265314:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867700736 00000100:00100000:1.0:1746142901.265317:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.265322:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867700992 00000100:00100000:1.0:1746142901.265323:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265323:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867700992 00000100:00100000:0.0:1746142901.265333:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13509 00000100:00100000:1.0:1746142901.265335:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142901.265336:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3763:x1830962867699328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.265339:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.265347:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.265359:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867700864 00000100:00100000:1.0:1746142901.265361:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867700864 00000100:00100000:1.0:1746142901.265374:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13512 00000100:00100000:1.0:1746142901.265377:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867700736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265387:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867699328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (234us total) trans 21474841066 rc 0/0 00000100:00100000:0.0:1746142901.265392:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13509 00000100:00100000:0.0:1746142901.265402:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13513 00000100:00100000:0.0:1746142901.265406:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867699200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142901.265417:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142901.265419:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142901.265420:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142901.265421:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142901.265422:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142901.265437:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3763:x1830962867700736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (180us total) trans 21474841069 rc 0/0 00000100:00100000:1.0:1746142901.265441:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13512 00000100:00100000:0.0:1746142901.265447:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3763:x1830962867699200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (149us total) trans 17179873801 rc 0/0 00000100:00100000:1.0:1746142901.265455:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13516 00000100:00100000:0.0:1746142901.265457:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13513 00000100:00100000:1.0:1746142901.265458:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3763:x1830962867700224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265466:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13517 00000100:00100000:0.0:1746142901.265470:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867700864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.265491:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3763:x1830962867700224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 33us (156us total) trans 21474841070 rc 0/0 00000100:00100000:1.0:1746142901.265495:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13516 00000100:00100000:0.0:1746142901.265511:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867700864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (163us total) trans 17179873804 rc 0/0 00000004:00080000:1.0:1746142901.265512:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097433100/2, rc 0, transno 17179873801 00000100:00100000:0.0:1746142901.265515:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13517 00000100:00100000:1.0:1746142901.265518:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142901.265523:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097431c00/2, rc 0, transno 17179873803 00000100:00100000:1.0:1746142901.265525:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.265528:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746142901.265529:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de1f80/2, rc 0, transno 21474841070 00000100:00100000:1.0:1746142901.265532:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142901.265536:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097431880/2, rc 0, transno 17179873804 00000100:00100000:1.0:1746142901.265551:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.265553:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867700608:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142901.265559:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de3b80/2, rc 0, transno 21474841066 00000100:00100000:1.0:1746142901.265561:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142901.265565:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de2d80/2, rc 0, transno 21474841068 00000100:00100000:1.0:1746142901.265567:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867699840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265570:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746142901.265571:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097432680/2, rc 0, transno 17179873800 00000100:00100000:1.0:1746142901.265572:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142901.265576:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d4c1180/2, rc 0, transno 21474841069 00000100:00100000:1.0:1746142901.265577:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867700736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265581:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867701120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.265589:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867700608 00000100:00100000:1.0:1746142901.265591:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867700608 00000100:00100000:0.0:1746142901.265593:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142901.265601:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867701120 00000100:00100000:1.0:1746142901.265602:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867701120 00000100:00100000:1.0:1746142901.265609:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13520 00000004:00080000:0.0:1746142901.265609:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097432d80/2, rc 0, transno 17179873799 00000100:00100000:1.0:1746142901.265611:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3765:x1830962867701120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142901.265612:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867699584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.265659:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3765:x1830962867701120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (65us total) trans 21474841071 rc 0/0 00000100:00100000:1.0:1746142901.265662:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13520 00000004:00080000:0.0:1746142901.265670:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d4c3480/2, rc 0, transno 21474841071 00000100:00100000:1.0:1746142901.265671:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142901.265673:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867701120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142901.265675:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867701248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142901.265679:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097431f80/2, rc 0, transno 17179873806 00000100:00100000:0.0:1746142901.265681:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867700608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142901.265685:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746142901.265723:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430380/2, rc 0, transno 17179873805 00000100:00100000:1.0:1746142901.265725:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867700096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142901.265838:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430a80/2, rc 0, transno 17179873807 00000100:00100000:1.0:1746142901.265842:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867701248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142901.268084:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.269848:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867074432 00000100:00100000:0.0:1746142901.269853:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867074432 00002000:00100000:0.0:1746142901.269876:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2334720->2338815) req@ffff880096140380 x1830962867074432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.269883:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140380 with x1830962867074432 ext(2334720->2338815) 00002000:00010000:0.0:1746142901.269887:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096140380 00000100:00100000:0.0:1746142901.269917:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4011 00000100:00100000:0.0:1746142901.269921:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867074432:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142901.270166:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867074432:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 243us (352us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142901.270172:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4011 00002000:00100000:0.0:1746142901.270177:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2334720->2338815) req@ffff880096140380 x1830962867074432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.270184:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140380 with x1830962867074432 ext(2334720->2338815) 00002000:00010000:0.0:1746142901.270187:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096140380 00000100:00100000:0.0:1746142901.274145:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.275778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.275994:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867074944 00000100:00100000:1.0:1746142901.276026:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867074944 00002000:00100000:1.0:1746142901.276051:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2523136->2527231) req@ffff880097431500 x1830962867074944/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.276060:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431500 with x1830962867074944 ext(2523136->2527231) 00002000:00010000:1.0:1746142901.276065:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097431500 00000100:00100000:1.0:1746142901.276088:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4012 00000100:00100000:1.0:1746142901.276094:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867074944:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142901.276188:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867074944:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 94us (412us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142901.276193:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4012 00002000:00100000:1.0:1746142901.276198:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2523136->2527231) req@ffff880097431500 x1830962867074944/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.276205:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431500 with x1830962867074944 ext(2523136->2527231) 00002000:00010000:1.0:1746142901.276207:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097431500 00000100:00100000:0.0:1746142901.281881:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867075200 00000100:00100000:0.0:1746142901.281886:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867075200 00000100:00100000:0.0:1746142901.281925:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5164 00000100:00100000:0.0:1746142901.281931:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:32016:x1830962867075200:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142901.282065:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32016:x1830962867075200:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 133us (681us total) trans 8589936400 rc 0/0 00000100:00100000:0.0:1746142901.282071:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5164 00000100:00100000:0.0:1746142901.283512:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867075712 00000100:00100000:0.0:1746142901.283518:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867075712 00000100:00100000:0.0:1746142901.283557:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867075840 00000100:00100000:0.0:1746142901.283559:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867075840 00000100:00100000:0.0:1746142901.283576:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867075968 00000100:00100000:0.0:1746142901.283578:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867075968 00000100:00100000:1.0:1746142901.283582:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13526 00000100:00100000:1.0:1746142901.283589:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867075712:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142901.283596:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13528 00010000:00010000:1.0:1746142901.283598:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142901.283601:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867075968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.283606:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.283610:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067ccb33a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896a5 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.283612:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471f400/0x2fa243e067ccb348 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896b3 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.283646:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097433480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867701376:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142901.283694:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00002000:00010000:1.0:1746142901.283741:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406b5, atime: 0x681406b5, ctime: 0x681406b5, blocks: 0x808 00010000:00010000:1.0:1746142901.283754:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.283755:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.283761:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067ccb33a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896a5 expref: 43 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.283771:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067ccb33a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896a5 expref: 43 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.283778:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba600, rc 0) 00000100:00100000:1.0:1746142901.283798:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867075712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 209us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.283802:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13526 00000100:00100000:0.0:1746142901.300006:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.301235:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867076224 00000100:00100000:1.0:1746142901.301243:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867076224 00002000:00100000:1.0:1746142901.301278:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880097433480 x1830962867076224/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.301286:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433480 with x1830962867076224 ext(0->1048575) 00002000:00010000:1.0:1746142901.301290:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097433480 00000100:00100000:1.0:1746142901.301317:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4013 00000100:00100000:1.0:1746142901.301323:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867076224:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.306574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.306605:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.306624:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867076608 00000100:00100000:0.0:1746142901.306631:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867076608 00002000:00100000:0.0:1746142901.306665:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092404a80 x1830962867076608/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.306674:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404a80 with x1830962867076608 ext(1048576->2097151) 00002000:00010000:0.0:1746142901.306679:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092404a80 00000100:00100000:0.0:1746142901.306704:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867076736 00000100:00100000:0.0:1746142901.306706:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867076736 00002000:00100000:0.0:1746142901.306718:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800938d2d80 x1830962867076736/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.306724:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2d80 with x1830962867076736 ext(1048576->2097151) 00002000:00010000:0.0:1746142901.306727:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d2d80 00000100:00100000:0.0:1746142901.306738:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4014 00000100:00100000:0.0:1746142901.306744:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867076608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.307324:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.307921:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867076864 00000100:00100000:1.0:1746142901.307926:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867076864 00002000:00100000:1.0:1746142901.307946:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800938d3b80 x1830962867076864/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.307954:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3b80 with x1830962867076864 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.307958:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938d3b80 00000100:00100000:1.0:1746142901.307973:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4015 00000100:00100000:1.0:1746142901.307978:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867076736:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.308505:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4016 00000100:00100000:1.0:1746142901.308511:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867076864:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.326371:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867076736:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18383us (19755us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.326381:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4015 00002000:00100000:1.0:1746142901.326391:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800938d2d80 x1830962867076736/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.326400:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2d80 with x1830962867076736 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.326405:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d2d80 00000100:00100000:0.0:1746142901.331290:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.337714:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.337731:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.337743:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.337806:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.337832:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867077632 00000100:00100000:0.0:1746142901.337838:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867077632 00000100:00100000:0.0:1746142901.337874:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867077760 00000100:00100000:0.0:1746142901.337876:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867077760 00000100:00100000:0.0:1746142901.337885:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867077888 00000100:00100000:0.0:1746142901.337886:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867077888 00000100:00100000:0.0:1746142901.337893:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867078016 00000100:00100000:0.0:1746142901.337894:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867078016 00000100:00100000:0.0:1746142901.337918:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13529 00000100:00100000:0.0:1746142901.337925:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867077632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.337938:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.337951:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb372 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896c1 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.337968:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.337969:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.337975:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb372 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896c1 expref: 29 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.337987:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb372 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896c1 expref: 29 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.337995:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1600, rc 0) 00000100:00100000:0.0:1746142901.338030:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867077632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 104us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.338035:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13529 00000100:00100000:0.0:1746142901.338048:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13530 00000100:00100000:0.0:1746142901.338052:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867077760:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.338058:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.338065:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccb379 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896c8 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.338074:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.338075:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.338078:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccb379 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896c8 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.338091:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccb379 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896c8 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.338097:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0a00, rc 0) 00000100:00100000:0.0:1746142901.338107:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2003:x1830962867077760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 56us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.338111:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13530 00000100:00100000:0.0:1746142901.338118:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13531 00000100:00100000:0.0:1746142901.338122:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867077888:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.338126:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.338130:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb380 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896cf expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.338138:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.338139:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.338142:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb380 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896cf expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.338148:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb380 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896cf expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.338153:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1000, rc 0) 00000100:00100000:0.0:1746142901.338161:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867077888:12345-192.168.204.50@tcp:101:cat.0 Request processed in 39us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.338165:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13531 00000100:00100000:0.0:1746142901.338171:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13532 00000100:00100000:0.0:1746142901.338174:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867078016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.338178:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.338182:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb387 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896d6 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.338188:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.338190:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.338192:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb387 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896d6 expref: 29 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.338198:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb387 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896d6 expref: 29 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.338203:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1400, rc 0) 00000100:00100000:0.0:1746142901.338211:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867078016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.338214:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13532 00000100:00100000:0.0:1746142901.341802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.341843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.350413:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.350446:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.350478:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.350503:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.350557:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4018 00000100:00100000:0.0:1746142901.350566:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867078912:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.354818:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.354878:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867079296 00000100:00100000:1.0:1746142901.354885:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867079296 00000100:00100000:1.0:1746142901.354946:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13534 00000100:00100000:1.0:1746142901.354952:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32020:x1830962867079296:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.354965:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.354979:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896e4 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.355001:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 31 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.355008:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142901.355009:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142901.355012:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.355036:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 31 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.355046:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 31 pid: 11943 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.355055:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867701504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.355115:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.362990:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.363112:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867701504:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.363147:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.363163:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471fc00, rc 0) 00000100:00100000:1.0:1746142901.363194:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32020:x1830962867079296:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8241us (8383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.363200:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13534 00000100:00100000:1.0:1746142901.371111:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867078912:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20537us (20692us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.371121:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4018 00002000:00100000:1.0:1746142901.371131:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088d7fb80 x1830962867078912/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.371140:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7fb80 with x1830962867078912 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.371145:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7fb80 00000100:00100000:0.0:1746142901.380198:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.382834:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867079552 00000100:00100000:1.0:1746142901.382845:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867079552 00010000:00010000:1.0:1746142901.382878:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 30 pid: 11943 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.382923:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6004 00000100:00100000:1.0:1746142901.382929:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2004:x1830962867079552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.382942:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.382959:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 30 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.382969:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 30 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.382987:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968cd800/0x2fa243e067ccb2fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2334720->2527231) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89682 expref: 30 pid: 11943 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.383014:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.383016:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.383022:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.383029:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.383058:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.383072:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867701632:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142901.383156:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.383662:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.388431:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867701632:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142901.388465:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.389030:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867079552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6098us (8835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.389040:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6004 00000100:00100000:0.0:1746142901.390868:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.392324:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.392420:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867080192 00000100:00100000:1.0:1746142901.392428:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867080192 00002000:00100000:1.0:1746142901.392461:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880088f1bb80 x1830962867080192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.392470:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1bb80 with x1830962867080192 ext(3145728->4194303) 00002000:00010000:1.0:1746142901.392474:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f1bb80 00000100:00100000:1.0:1746142901.392495:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867080320 00000100:00100000:1.0:1746142901.392497:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867080320 00002000:00100000:1.0:1746142901.392507:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088f1a680 x1830962867080320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.392514:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1a680 with x1830962867080320 ext(2097152->4194303) 00002000:00010000:1.0:1746142901.392517:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f1a680 00000100:00100000:1.0:1746142901.392532:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4023 00000100:00100000:1.0:1746142901.392547:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867080192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.393111:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4024 00000100:00100000:1.0:1746142901.393117:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867080320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.404730:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867080192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12185us (13859us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.404740:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4023 00002000:00100000:1.0:1746142901.404750:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880088f1bb80 x1830962867080192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.404759:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1bb80 with x1830962867080192 ext(3145728->4194303) 00002000:00010000:1.0:1746142901.404764:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f1bb80 00000100:00100000:0.0:1746142901.406873:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.406922:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867080448 00000100:00100000:1.0:1746142901.406928:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867080448 00000100:00100000:1.0:1746142901.406960:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13535 00000100:00100000:1.0:1746142901.406965:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+29:32024:x1830962867080448:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.406976:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.406987:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccb39c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb896eb expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.407003:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.407004:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.407009:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccb39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896eb expref: 30 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.407022:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccb39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896eb expref: 30 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.407030:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37200, rc 0) 00000100:00100000:1.0:1746142901.407073:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+30:32024:x1830962867080448:12345-192.168.204.50@tcp:101:cat.0 Request processed in 106us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.407080:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13535 00000100:00100000:0.0:1746142901.407549:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.407626:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867080320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14508us (15304us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142901.407634:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4024 00002000:00100000:1.0:1746142901.407641:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088f1a680 x1830962867080320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.407649:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1a680 with x1830962867080320 ext(2097152->4194303) 00002000:00010000:1.0:1746142901.407653:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f1a680 00000100:00100000:0.0:1746142901.411200:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.411249:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.411284:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867080832 00000100:00100000:1.0:1746142901.411290:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867080832 00010000:00010000:1.0:1746142901.411318:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba200/0x2fa243e067ccb364 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896ba expref: 11 pid: 10924 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.411340:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6005 00000100:00100000:1.0:1746142901.411346:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867080832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.411356:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.411362:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba200/0x2fa243e067ccb364 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896ba expref: 11 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.411370:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba200/0x2fa243e067ccb364 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896ba expref: 11 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.411387:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba200/0x2fa243e067ccb364 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896ba expref: 11 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.411406:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.411411:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.411418:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.411424:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.411451:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.411469:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867080832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.411475:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6005 00000100:00100000:0.0:1746142901.411612:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.413169:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.413207:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.413215:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867081344 00000100:00100000:1.0:1746142901.413220:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867081344 00002000:00100000:1.0:1746142901.413242:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800924f7480 x1830962867081344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.413251:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7480 with x1830962867081344 ext(2097152->4194303) 00002000:00010000:1.0:1746142901.413254:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f7480 00000100:00100000:1.0:1746142901.413277:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867081600 00000100:00100000:1.0:1746142901.413278:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867081600 00002000:00100000:1.0:1746142901.413287:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880098190000 x1830962867081600/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.413291:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098190000 with x1830962867081600 ext(3145728->4194303) 00002000:00010000:1.0:1746142901.413293:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098190000 00000100:00100000:1.0:1746142901.413311:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4025 00000100:00100000:1.0:1746142901.413316:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867081344:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.419009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.426741:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867081344:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13413us (13564us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142901.426753:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4025 00002000:00100000:1.0:1746142901.426762:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800924f7480 x1830962867081344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.426771:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7480 with x1830962867081344 ext(2097152->4194303) 00002000:00010000:1.0:1746142901.426776:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f7480 00000100:00100000:0.0:1746142901.428094:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867081856:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8771us (9090us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746142901.428102:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4027 00002000:00100000:0.0:1746142901.428109:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880098193100 x1830962867081856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.428118:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098193100 with x1830962867081856 ext(4194304->5033983) 00002000:00010000:0.0:1746142901.428121:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098193100 00000100:00100000:1.0:1746142901.434023:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.437921:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.438112:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867082368 00000100:00100000:0.0:1746142901.438119:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867082368 00002000:00100000:0.0:1746142901.438155:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800946c4700 x1830962867082368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142901.438165:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4700 with x1830962867082368 ext(4194304->5033983) 00002000:00010000:0.0:1746142901.438170:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c4700 00000100:00100000:0.0:1746142901.438187:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4028 00000100:00100000:0.0:1746142901.438194:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2004:x1830962867082368:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.455549:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.470028:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.474094:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.474365:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867082880 00000100:00100000:1.0:1746142901.474374:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867082880 00010000:00010000:1.0:1746142901.474405:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f2 expref: 31 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.474462:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6007 00000100:00100000:1.0:1746142901.474472:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867082880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.474486:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.474492:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f2 expref: 31 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.474502:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f2 expref: 31 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.474522:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a89dc00/0x2fa243e067ccb3aa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f2 expref: 31 pid: 7231 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.474567:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.474573:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb3d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.474582:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.474588:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb3d4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.474629:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.474693:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867082880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 221us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.474701:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6007 00000100:00100000:0.0:1746142901.477683:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.477972:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867083008 00000100:00100000:1.0:1746142901.477982:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867083008 00000100:00100000:0.0:1746142901.478037:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.478383:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867083136 00000100:00100000:1.0:1746142901.478389:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867083136 00000100:00100000:0.0:1746142901.478395:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13536 00000100:00100000:0.0:1746142901.478404:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2003:x1830962867083008:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142901.478418:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142901.478420:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13537 00000100:00100000:1.0:1746142901.478427:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867083136:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142901.478432:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccb3db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89707 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.478450:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.478452:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.478460:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccb3db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89707 expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.478473:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccb3db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89707 expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.478481:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:0.0:1746142901.478513:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867083008:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 110us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.478519:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13536 00000100:00100000:0.0:1746142901.478564:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142901.478609:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.478621:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea40000/0x2fa243e067ccb3e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8970e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.478636:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.478638:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.478645:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea40000/0x2fa243e067ccb3e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8970e expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.478657:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea40000/0x2fa243e067ccb3e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8970e expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.478665:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea40000, rc 0) 00000100:00100000:1.0:1746142901.478693:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867083136:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 265us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.478699:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13537 00000100:00100000:0.0:1746142901.478830:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.478933:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867083264 00000100:00100000:1.0:1746142901.478938:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867083264 00000100:00100000:1.0:1746142901.478966:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13538 00000100:00100000:1.0:1746142901.478972:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867083264:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.478980:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.478988:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89715 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.479000:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.479002:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.479007:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89715 expref: 15 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.479017:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89715 expref: 15 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.479025:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea41c00, rc 0) 00000100:00100000:1.0:1746142901.479047:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867083264:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 75us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.479052:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13538 00000100:00100000:0.0:1746142901.479774:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.479795:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.479882:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867083648 00000100:00100000:1.0:1746142901.479887:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867083648 00000100:00100000:1.0:1746142901.479938:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13541 00000100:00100000:1.0:1746142901.479945:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867083648:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.479956:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.479965:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8972a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.479977:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.479978:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.479984:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.479995:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.480002:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea41e00, rc 0) 00000100:00100000:1.0:1746142901.480028:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867083648:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.480033:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13541 00000100:00100000:1.0:1746142901.483156:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.485938:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.489334:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.493608:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.506958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.559794:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.571447:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.579375:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.580737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.581546:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.582847:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.585407:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867085952 00000100:00100000:0.0:1746142901.585411:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867085952 00000100:00100000:0.0:1746142901.585432:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867086080 00000100:00100000:0.0:1746142901.585434:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867086080 00000100:00100000:0.0:1746142901.585446:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13543 00000100:00100000:0.0:1746142901.585451:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867085952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.585462:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.585471:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccb48a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8975b expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.585504:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867702784:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142901.585546:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00002000:00010000:1.0:1746142901.586561:0:11943:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142901 -> 1746142902 00000100:00100000:1.0:1746142901.586578:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867702784:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.586603:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccb48a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8975b expref: 44 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.586614:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccb48a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8975b expref: 44 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.586627:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75200, rc 0) 00000100:00100000:1.0:1746142901.586650:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867085952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1198us (1328us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.586657:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13543 00000100:00100000:0.0:1746142901.587503:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.590717:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.591054:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867086592 00000100:00100000:1.0:1746142901.591060:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867086592 00000100:00100000:1.0:1746142901.591105:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5168 00000100:00100000:1.0:1746142901.591111:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32035:x1830962867086592:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142901.591239:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32035:x1830962867086592:12345-192.168.204.50@tcp:35:cat.0 Request processed in 128us (527us total) trans 8589936410 rc 0/0 00000100:00100000:1.0:1746142901.591245:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5168 00000100:00100000:0.0:1746142901.592645:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.598192:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.598237:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.601128:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.619287:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867087616 00000100:00100000:1.0:1746142901.619297:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867087616 00000100:00100000:1.0:1746142901.619339:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14285 00000100:00100000:1.0:1746142901.619346:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32041:x1830962867087616:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.619367:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.619384:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea40400/0x2fa243e067ccb4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89777 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.619794:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619805:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619815:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619825:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619830:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619835:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619889:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619897:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619919:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142901.619950:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142901.619954:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142901.619967:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619976:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619983:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619988:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619992:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.619997:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.620002:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092131600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.620005:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.620011:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.620019:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142901.620021:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.620025:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621051:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092131600/0x2fa243e067ccb4ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621067:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621072:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621077:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621081:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092130600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.621083:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621087:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621105:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9fea00) 00010000:00010000:1.0:1746142901.621107:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.621109:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621113:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092130600/0x2fa243e067ccb4b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.621139:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea40400/0x2fa243e067ccb4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89777 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.621150:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89777 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.621156:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.621158:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142901.621160:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092131400, rc 0) 00000100:00100000:1.0:1746142901.621181:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32041:x1830962867087616:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 1836us (2703us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.621188:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14285 00000100:00100000:0.0:1746142901.623361:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.624349:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.624431:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.624466:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.624510:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867088128 00000100:00100000:1.0:1746142901.624514:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867088128 00000100:00100000:1.0:1746142901.624547:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867088256 00000100:00100000:1.0:1746142901.624549:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867088256 00000100:00100000:1.0:1746142901.624562:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13547 00000100:00100000:1.0:1746142901.624567:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867088128:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.624575:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.624589:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccb4c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8977e expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.624628:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867703680:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.624678:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.624734:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13548 00000100:00100000:1.0:1746142901.624739:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867088256:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.624746:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.624752:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130ab4600/0x2fa243e067ccb4c9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89785 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.624773:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867703808:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142901.624791:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.630343:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142901.630733:0:11943:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from glimpse AST (req@ffff8800946c6680 x1830962867703680) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccb46e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8974d expref: 45 pid: 12211 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.630750:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccb46e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1622016->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8974d expref: 45 pid: 12211 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.630760:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867703680:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.630778:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccb4c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8977e expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.630786:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccb4c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8977e expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.630791:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa51600, rc 0) 00000100:00100000:1.0:1746142901.631579:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867088128:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 7011us (7146us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.631585:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13547 00000100:00100000:0.0:1746142901.635605:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.642801:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.642851:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867089024 00000100:00100000:1.0:1746142901.642858:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867089024 00000100:00100000:1.0:1746142901.642920:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14286 00000100:00100000:1.0:1746142901.642928:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32041:x1830962867089024:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.642944:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.642959:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067ccb4d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8978c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643036:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.643047:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fea000/0x2fa243e067ccb43d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8973f expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643054:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccb460 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89746 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643059:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89777 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643065:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.643087:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89777 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643096:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092131400/0x2fa243e067ccb4bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89777 expref: 10 pid: 10924 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.643105:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867704064:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.643227:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccb460 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89746 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643235:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccb460 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89746 expref: 33 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.643241:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867704192:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.643266:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091fea000/0x2fa243e067ccb43d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8973f expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.643276:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fea000/0x2fa243e067ccb43d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8973f expref: 14 pid: 7231 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.643282:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867704320:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.643298:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.647074:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867704064:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.647085:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867704192:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.647981:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.648192:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.652004:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867704320:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.652043:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.652202:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.652209:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142901.652223:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.652322:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067ccb4d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8978c expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.653768:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8978c expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.653776:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.653778:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746142901.653781:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea4da00, rc 0) 00000100:00100000:1.0:1746142901.653811:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32041:x1830962867089024:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10885us (11019us total) trans 8589936412 rc 0/0 00000100:00100000:1.0:1746142901.653818:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14286 00000100:00100000:0.0:1746142901.656322:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.656378:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867089664 00000100:00100000:1.0:1746142901.656387:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867089664 00000100:00100000:1.0:1746142901.656677:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14287 00000100:00100000:1.0:1746142901.656684:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32041:x1830962867089664:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142901.656702:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.656704:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746142901.656723:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4da00/0x2fa243e067ccb4d7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8978c expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.656736:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.656739:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142901.656747:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79400/0x2fa243e067ccb4e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89793 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.656814:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656823:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656830:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656838:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656843:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656847:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656852:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc79200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.656855:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656859:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656864:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.656866:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142901.656868:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656872:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb4ec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.656886:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79400/0x2fa243e067ccb4e5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89793 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.656891:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79400/0x2fa243e067ccb4e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89793 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.656933:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc79400, rc 0) 00000100:00100000:1.0:1746142901.658484:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32041:x1830962867089664:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 1794us (2161us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.658493:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14287 00000100:00100000:0.0:1746142901.660654:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867089792 00000100:00100000:0.0:1746142901.660663:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867089792 00000100:00100000:0.0:1746142901.660709:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13549 00000100:00100000:0.0:1746142901.660716:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:32038:x1830962867089792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.660729:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.660743:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711a000/0x2fa243e067ccb4f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8979a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.660769:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097794200/0x2fa243e067ccb49f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89770 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.660776:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142901.660778:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142901.660780:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009711a000/0x2fa243e067ccb4f3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8979a expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.660805:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097794200/0x2fa243e067ccb49f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89770 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.660816:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097794200/0x2fa243e067ccb49f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2629631) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89770 expref: 43 pid: 12211 timeout: 775 lvb_type: 0 00000100:00100000:0.0:1746142901.660826:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867704448:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.660915:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.662395:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.663796:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.674051:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.676381:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.681625:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867704704:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.681635:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867704832:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142901.681641:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867704960:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142901.681670:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccb4fa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [147456->1048575] (req 147456->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a1 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.681685:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1a00, rc 0) 00000100:00100000:0.0:1746142901.681780:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+31:32031:x1830962867090304:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4781us (7728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.681788:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13550 00000100:00100000:0.0:1746142901.683805:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.683838:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.683873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.683897:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867090688 00000100:00100000:1.0:1746142901.683927:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867090688 00010000:00010000:1.0:1746142901.683960:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccb325 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89690 expref: 45 pid: 11943 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746142901.683983:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867090816 00000100:00100000:1.0:1746142901.683985:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867090816 00010000:00010000:1.0:1746142901.683994:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb372 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896c1 expref: 31 pid: 1397 timeout: 775 lvb_type: 1 00000100:00100000:1.0:1746142901.684077:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6021 00000100:00100000:1.0:1746142901.684084:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867090560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.684092:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.684100:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccb3db lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89707 expref: 11 pid: 11943 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746142901.684108:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccb3db lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89707 expref: 11 pid: 11943 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746142901.684121:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccb3db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89707 expref: 11 pid: 11943 timeout: 775 lvb_type: 1 00010000:00010000:1.0:1746142901.684137:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.684154:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867090560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.684160:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6021 00000100:00100000:1.0:1746142901.687220:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.687673:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.687691:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867091200 00000100:00100000:1.0:1746142901.687694:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867091200 00002000:00100000:1.0:1746142901.687709:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (147456->151551) req@ffff8800946c7480 x1830962867091200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.687716:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c7480 with x1830962867091200 ext(147456->151551) 00002000:00010000:1.0:1746142901.687719:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c7480 00000100:00100000:1.0:1746142901.687736:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4033 00000100:00100000:1.0:1746142901.687741:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2004:x1830962867091200:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142901.690735:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2004:x1830962867091200:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 2985us (3054us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142901.690744:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4033 00002000:00100000:1.0:1746142901.690751:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (147456->151551) req@ffff8800946c7480 x1830962867091200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.690759:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c7480 with x1830962867091200 ext(147456->151551) 00002000:00010000:1.0:1746142901.690764:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c7480 00000100:00100000:0.0:1746142901.701440:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.704686:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867091072:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 17160us (17470us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142901.704699:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4032 00002000:00100000:1.0:1746142901.704708:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800946c5f80 x1830962867091072/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.704716:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c5f80 with x1830962867091072 ext(2097152->4194303) 00002000:00010000:1.0:1746142901.704721:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c5f80 00000100:00100000:0.0:1746142901.708268:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.708315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.708342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.712186:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.713015:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867092096 00000100:00100000:1.0:1746142901.713028:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867092096 00002000:00100000:1.0:1746142901.713063:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1056768->1060863) req@ffff880096096a00 x1830962867092096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.713767:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096096a00 with x1830962867092096 ext(1056768->1060863) 00002000:00010000:1.0:1746142901.713772:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096096a00 00000100:00100000:1.0:1746142901.713804:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4034 00000100:00100000:1.0:1746142901.713810:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867092096:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142901.713956:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867092096:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 145us (1770us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142901.713962:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4034 00002000:00100000:1.0:1746142901.713967:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1056768->1060863) req@ffff880096096a00 x1830962867092096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/4536 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.713975:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096096a00 with x1830962867092096 ext(1056768->1060863) 00002000:00010000:1.0:1746142901.713977:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096096a00 00000100:00100000:0.0:1746142901.717977:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.721816:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867092608 00000100:00100000:0.0:1746142901.721822:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867092608 00000100:00100000:0.0:1746142901.721861:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5171 00000100:00100000:0.0:1746142901.721868:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:32031:x1830962867092608:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142901.722699:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:32031:x1830962867092608:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 828us (1018us total) trans 8589936414 rc 0/0 00000100:00100000:0.0:1746142901.722707:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5171 00000100:00100000:0.0:1746142901.765326:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.765440:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867092864 00000100:00100000:1.0:1746142901.765448:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867092864 00000100:00100000:1.0:1746142901.766074:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14288 00000100:00100000:1.0:1746142901.766082:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32048:x1830962867092864:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142901.766119:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.766135:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79400/0x2fa243e067ccb508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897af expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.766193:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766329:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766339:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766352:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766357:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766361:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766429:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766435:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766439:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142901.766445:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.766492:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766501:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766506:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766510:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766541:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc79c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.766544:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766548:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766556:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142901.766559:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.766562:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766566:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb50f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766589:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766593:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766612:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766616:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0a1400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.766619:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766623:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766628:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9fe600) 00010000:00010000:1.0:1746142901.766629:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.766631:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766635:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccb516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.766664:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79400/0x2fa243e067ccb508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897af expref: 36 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.766673:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897af expref: 35 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.766678:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.766679:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142901.766681:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a0600, rc 0) 00000100:00100000:1.0:1746142901.767469:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32048:x1830962867092864:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1385us (2147us total) trans 8589936415 rc 0/0 00000100:00100000:1.0:1746142901.767476:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14288 00000100:00100000:0.0:1746142901.775730:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.779211:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.779239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.779271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.779294:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867093120 00000100:00100000:0.0:1746142901.779299:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867093120 00010000:00010000:0.0:1746142901.779319:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89715 expref: 15 pid: 12211 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746142901.779349:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867093248 00000100:00100000:0.0:1746142901.779351:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867093248 00010000:00010000:0.0:1746142901.779359:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb380 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896cf expref: 30 pid: 1397 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746142901.779371:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867093376 00000100:00100000:0.0:1746142901.779373:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867093376 00010000:00010000:0.0:1746142901.779379:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bedde00/0x2fa243e067ccb333 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8969e expref: 44 pid: 12211 timeout: 775 lvb_type: 1 00000100:00100000:0.0:1746142901.779390:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6026 00000100:00100000:0.0:1746142901.779395:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867093120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142901.779406:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142901.779420:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89715 expref: 15 pid: 12211 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746142901.779429:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89715 expref: 15 pid: 12211 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746142901.779445:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea41c00/0x2fa243e067ccb3e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89715 expref: 15 pid: 12211 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746142901.779458:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142901.779477:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867093120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.779483:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6026 00000100:00100000:0.0:1746142901.779493:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6028 00000100:00100000:0.0:1746142901.779497:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867093376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142901.779502:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142901.779509:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bedde00/0x2fa243e067ccb333 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8969e expref: 44 pid: 12211 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746142901.779517:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bedde00/0x2fa243e067ccb333 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8969e expref: 44 pid: 12211 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746142901.779527:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bedde00/0x2fa243e067ccb333 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8969e expref: 44 pid: 12211 timeout: 775 lvb_type: 1 00010000:00010000:0.0:1746142901.780229:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142901.780399:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867093376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 900us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.780405:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6028 00000100:00100000:0.0:1746142901.783547:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.794309:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.823107:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.823204:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867094400 00000100:00100000:1.0:1746142901.823212:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867094400 00000100:00100000:1.0:1746142901.823576:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14289 00000100:00100000:1.0:1746142901.823585:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32052:x1830962867094400:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.823621:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.823636:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb532 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897bd expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.823710:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.823721:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.823730:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142901.823738:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.823811:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb532 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 39 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.823844:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 38 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.823850:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.823853:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746142901.823855:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1c00, rc 0) 00000100:00100000:1.0:1746142901.824941:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32052:x1830962867094400:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1354us (1838us total) trans 8589936417 rc 0/0 00000100:00100000:1.0:1746142901.824948:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14289 00000100:00100000:0.0:1746142901.827493:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.827512:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.827784:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.828352:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867094784 00000100:00100000:0.0:1746142901.828355:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867094784 00000100:00100000:1.0:1746142901.828514:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867094656 00000100:00100000:1.0:1746142901.828517:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867094656 00000100:00100000:0.0:1746142901.829399:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867094912 00000100:00100000:0.0:1746142901.829403:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867094912 00000100:00100000:0.0:1746142901.829422:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13554 00000100:00100000:0.0:1746142901.829427:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867094784:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.829433:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.829440:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897d2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.829455:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.829457:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.829463:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d2 expref: 48 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.829475:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d2 expref: 48 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.829483:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5600, rc 0) 00000100:00100000:0.0:1746142901.829502:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867094784:12345-192.168.204.50@tcp:101:cat.0 Request processed in 75us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.829508:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13554 00000100:00100000:0.0:1746142901.829519:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13555 00000100:00100000:0.0:1746142901.829523:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867094656:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.829541:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.829548:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4400/0x2fa243e067ccb555 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897cb expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.829569:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867706368:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142901.829591:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.829605:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13556 00000100:00100000:0.0:1746142901.829610:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867094912:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.829615:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.829621:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897d9 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142901.829631:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.829633:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142901.829637:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d9 expref: 48 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.829645:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d9 expref: 48 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.829651:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4200, rc 0) 00000100:00100000:0.0:1746142901.829663:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867094912:12345-192.168.204.50@tcp:101:cat.0 Request processed in 53us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142901.829668:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13556 00002000:00010000:1.0:1746142901.835052:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142901 -> 1746142902 00002000:00010000:1.0:1746142901.835057:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142901 -> 1746142902 00002000:00010000:1.0:1746142901.835059:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142901 -> 1746142902 00000100:00100000:1.0:1746142901.835072:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867706368:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.835094:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4400/0x2fa243e067ccb555 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897cb expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.835105:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4400/0x2fa243e067ccb555 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897cb expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.835120:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4400, rc 0) 00000100:00100000:1.0:1746142901.835190:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867094656:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5664us (7404us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.835196:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13555 00000100:00100000:0.0:1746142901.838680:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.840070:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867095040 00000100:00100000:1.0:1746142901.840080:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867095040 00000100:00100000:1.0:1746142901.840135:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13557 00000100:00100000:1.0:1746142901.840142:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32052:x1830962867095040:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.840157:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.840172:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897e0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.840195:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccb4fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 147456->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a1 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.840202:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142901.840204:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142901.840206:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e0 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.840234:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccb4fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 147456->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a1 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.840245:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1a00/0x2fa243e067ccb4fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 147456->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a1 expref: 29 pid: 9580 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.840255:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867706496:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142901.840996:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bd4e840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.848858:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867706496:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142901.848944:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e0 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.848959:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1e00, rc 0) 00000100:00100000:1.0:1746142901.849020:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32052:x1830962867095040:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8876us (10344us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.849027:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13557 00000100:00100000:0.0:1746142901.852959:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.856002:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.856065:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867095424 00000100:00100000:1.0:1746142901.856073:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867095424 00000100:00100000:1.0:1746142901.856248:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14290 00000100:00100000:1.0:1746142901.856256:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:32057:x1830962867095424:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.856275:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.856291:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb56a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897e7 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.856346:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856357:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856366:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856377:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856382:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856387:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856459:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856466:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856471:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142901.856478:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.856542:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856547:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856552:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856557:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856563:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc79200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.856566:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856572:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856580:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142901.856582:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.856586:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856590:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79200/0x2fa243e067ccb571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856616:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856620:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856625:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856628:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0a0200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142901.856630:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856634:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856640:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9fef00) 00010000:00010000:1.0:1746142901.856642:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142901.856645:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856648:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccb578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142901.856678:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccb56a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e7 expref: 18 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.856687:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e7 expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.856692:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.856693:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142901.856695:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a0e00, rc 0) 00000100:00100000:1.0:1746142901.856732:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:32057:x1830962867095424:12345-192.168.204.50@tcp:101:cat.0 Request processed in 474us (734us total) trans 8589936418 rc 0/0 00000100:00100000:1.0:1746142901.856737:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14290 00000100:00100000:0.0:1746142901.864190:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.871618:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.871682:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.871703:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.871732:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867095808 00000100:00100000:0.0:1746142901.871738:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867095808 00000100:00100000:0.0:1746142901.871764:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867095936 00000100:00100000:0.0:1746142901.871766:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867095936 00000100:00100000:0.0:1746142901.871778:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13558 00000100:00100000:0.0:1746142901.871785:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867095808:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.871797:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.871809:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccb58d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897ee expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.871848:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867706624:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142901.871922:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.871965:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13559 00000100:00100000:0.0:1746142901.871971:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867095936:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142901.871978:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142901.871987:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccb594 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb897f5 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142901.872006:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867706752:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142901.872036:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142901.873594:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867706624:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142901.873615:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccb58d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897ee expref: 33 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142901.873630:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccb58d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897ee expref: 33 pid: 1853 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746142901.873635:0:11943:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142901 -> 1746142902 00002000:00010000:1.0:1746142901.873638:0:11943:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142901 -> 1746142902 00002000:00010000:1.0:1746142901.873640:0:11943:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142901 -> 1746142902 00010000:00010000:0.0:1746142901.873652:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4a00, rc 0) 00000100:00100000:0.0:1746142901.873680:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867095808:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1895us (1997us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142901.873686:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13558 00000100:00100000:1.0:1746142901.873699:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867706752:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142901.873714:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccb594 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897f5 expref: 30 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.873723:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccb594 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897f5 expref: 30 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.873732:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795600, rc 0) 00000100:00100000:1.0:1746142901.874468:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867095936:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2495us (2763us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142901.874473:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13559 00000100:00100000:0.0:1746142901.874952:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.878562:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.878808:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.879474:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867096576 00000100:00100000:1.0:1746142901.879482:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867096576 00010000:00010000:1.0:1746142901.879496:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e7 expref: 20 pid: 10924 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.879524:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6030 00000100:00100000:1.0:1746142901.879537:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867096448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.879547:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.879552:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897af expref: 38 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.879560:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897af expref: 38 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.879577:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccb51d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897af expref: 38 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.879588:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.879592:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.879599:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.879603:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.879619:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867096448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 91us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.879625:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6030 00000100:00100000:1.0:1746142901.879634:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6031 00000100:00100000:1.0:1746142901.879638:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867096576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.879643:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.879646:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e7 expref: 20 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.879653:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e7 expref: 20 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.879662:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccb57f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e7 expref: 20 pid: 10924 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.879668:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.879671:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.879677:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.879683:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.879709:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.879718:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867096576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.879722:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6031 00010000:00010000:1.0:1746142901.879807:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142901.879813:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142901.879829:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142901.879937:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccb59b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897fc expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.879948:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897fc expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.879953:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142901.879956:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746142901.879958:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6c00, rc 0) 00000100:00100000:1.0:1746142901.879977:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:32056:x1830962867096192:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7892us (8362us total) trans 8589936420 rc 0/0 00000100:00100000:1.0:1746142901.879982:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14291 00000100:00100000:1.0:1746142901.880650:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867096704 00000100:00100000:1.0:1746142901.880654:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867096704 00000100:00100000:1.0:1746142901.881230:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13560 00000100:00100000:1.0:1746142901.881236:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+31:32057:x1830962867096704:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.881248:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.881259:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89803 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.881275:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.881277:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.881282:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89803 expref: 32 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.881297:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89803 expref: 32 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.881305:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8800, rc 0) 00000100:00100000:1.0:1746142901.881339:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+32:32057:x1830962867096704:12345-192.168.204.50@tcp:101:cat.0 Request processed in 103us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.881345:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13560 00000100:00100000:0.0:1746142901.883178:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.885766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.885847:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867097344 00000100:00100000:1.0:1746142901.885854:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867097344 00002000:00100000:1.0:1746142901.885882:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092432680 x1830962867097344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.885890:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432680 with x1830962867097344 ext(0->1048575) 00002000:00010000:1.0:1746142901.885894:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092432680 00000100:00100000:1.0:1746142901.885939:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4039 00000100:00100000:1.0:1746142901.885945:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867097344:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.911649:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867097344:12345-192.168.204.50@tcp:3:cat.0 Request processed in 25695us (25879us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.911661:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4039 00002000:00100000:1.0:1746142901.911672:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092432680 x1830962867097344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.911680:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432680 with x1830962867097344 ext(0->1048575) 00002000:00010000:1.0:1746142901.911685:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092432680 00000100:00100000:0.0:1746142901.917415:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.925828:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.933273:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.940272:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.940340:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.940461:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867097984 00000100:00100000:1.0:1746142901.940468:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867097984 00010000:00010000:1.0:1746142901.940494:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067ccb501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a8 expref: 32 pid: 9580 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.940540:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6032 00000100:00100000:1.0:1746142901.940547:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867097984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.940558:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.940575:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067ccb501 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a8 expref: 32 pid: 9580 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.940584:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067ccb501 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a8 expref: 32 pid: 9580 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.940603:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067ccb501 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897a8 expref: 32 pid: 9580 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.940618:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.940620:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.940625:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.940632:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.940656:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.940666:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867707520:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142901.940721:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.942638:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867707520:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142901.942652:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.942677:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867097984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2130us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.942684:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6032 00000100:00100000:0.0:1746142901.947706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.947757:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867098368 00000100:00100000:1.0:1746142901.947765:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867098368 00002000:00100000:1.0:1746142901.947792:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009809f800 x1830962867098368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.947800:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f800 with x1830962867098368 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.947803:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809f800 00000100:00100000:1.0:1746142901.947816:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4041 00000100:00100000:1.0:1746142901.947822:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867098368:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142901.960701:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867098496 00000100:00100000:1.0:1746142901.960708:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867098496 00010000:00010000:1.0:1746142901.960737:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d7c00/0x2fa243e067ccb52b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1540096->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897b6 expref: 48 pid: 9580 timeout: 775 lvb_type: 0 00000100:00100000:1.0:1746142901.960773:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6033 00000100:00100000:1.0:1746142901.960780:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867098496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142901.960791:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142901.960807:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927d7c00/0x2fa243e067ccb52b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897b6 expref: 48 pid: 9580 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.960822:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927d7c00/0x2fa243e067ccb52b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897b6 expref: 48 pid: 9580 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.960842:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d7c00/0x2fa243e067ccb52b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1540096->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897b6 expref: 48 pid: 9580 timeout: 775 lvb_type: 0 00010000:00010000:1.0:1746142901.960857:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.960859:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.960864:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.960871:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.960917:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142901.960929:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867707648:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142901.962216:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142901.966684:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867098368:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18852us (18976us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.966695:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4041 00002000:00100000:1.0:1746142901.966704:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009809f800 x1830962867098368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.966713:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f800 with x1830962867098368 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.966718:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809f800 00000100:00100000:1.0:1746142901.973998:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867707648:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142901.974016:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142901.974937:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867098496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 14154us (14609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.974948:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6033 00000100:00100000:0.0:1746142901.975147:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.976670:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.976739:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867098880 00000100:00100000:1.0:1746142901.976745:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867098880 00002000:00100000:1.0:1746142901.976770:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809ea00 x1830962867098880/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/0 e 0 to 0 dl 1746142912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.976778:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ea00 with x1830962867098880 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.976782:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809ea00 00000100:00100000:1.0:1746142901.976796:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4042 00000100:00100000:1.0:1746142901.976801:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867098880:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.983211:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142901.983252:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.983866:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867098880:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7063us (7196us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.983874:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4042 00002000:00100000:1.0:1746142901.983879:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809ea00 x1830962867098880/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.983885:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ea00 with x1830962867098880 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.983888:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809ea00 00000100:00100000:1.0:1746142901.983918:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4044 00000100:00100000:1.0:1746142901.983924:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867099392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142901.992958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142901.993412:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867099520 00000100:00100000:1.0:1746142901.993419:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867099520 00000100:00100000:1.0:1746142901.993464:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13564 00000100:00100000:1.0:1746142901.993470:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867099520:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142901.993483:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142901.993496:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8981f expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142901.993515:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.993516:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142901.993522:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8981f expref: 32 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.993545:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8981f expref: 32 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142901.993554:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d9800, rc 0) 00000100:00100000:1.0:1746142901.993585:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867099520:12345-192.168.204.50@tcp:101:cat.0 Request processed in 115us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142901.993590:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13564 00000100:00100000:1.0:1746142901.996036:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867099392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12104us (12776us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142901.996045:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4044 00002000:00100000:1.0:1746142901.996053:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88011e13df80 x1830962867099392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:52/0 lens 488/440 e 0 to 0 dl 1746142912 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142901.996062:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13df80 with x1830962867099392 ext(1048576->2097151) 00002000:00010000:1.0:1746142901.996066:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13df80 00000100:00100000:0.0:1746142902.010438:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.011022:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867099776 00000100:00100000:1.0:1746142902.011031:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867099776 00002000:00100000:1.0:1746142902.011074:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13f480 x1830962867099776/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.011083:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f480 with x1830962867099776 ext(2097152->4194303) 00002000:00010000:1.0:1746142902.011088:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13f480 00000100:00100000:1.0:1746142902.012000:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4045 00000100:00100000:1.0:1746142902.012009:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867099776:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.030937:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867099776:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18920us (20498us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142902.030948:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4045 00002000:00100000:1.0:1746142902.030957:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13f480 x1830962867099776/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.030966:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f480 with x1830962867099776 ext(2097152->4194303) 00002000:00010000:1.0:1746142902.030971:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13f480 00000100:00100000:0.0:1746142902.034047:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.040888:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867100288 00000100:00100000:1.0:1746142902.040896:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867100288 00000100:00100000:1.0:1746142902.040950:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13566 00000100:00100000:1.0:1746142902.040957:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32052:x1830962867100288:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.040972:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.040985:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89834 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.041005:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.041009:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.041019:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142902.041022:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 48 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.041118:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.041142:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867100160 00000100:00100000:0.0:1746142902.041146:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867100160 00000100:00100000:0.0:1746142902.041166:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14292 00000100:00100000:0.0:1746142902.041171:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32060:x1830962867100160:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142902.041181:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.041190:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880c00/0x2fa243e067ccb5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8982d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.041237:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041245:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041255:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041263:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041267:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041271:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041341:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041348:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041353:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142902.041359:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142902.041408:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041413:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041417:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041421:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041425:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c880e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142902.041428:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041433:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041440:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142902.041442:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142902.041445:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041449:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067ccb5e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041460:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041464:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041468:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041471:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142902.041472:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041476:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041480:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4700) 00010000:00010000:0.0:1746142902.041482:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142902.041483:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041490:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881c00/0x2fa243e067ccb5ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.041514:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880c00/0x2fa243e067ccb5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8982d expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.041522:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8982d expref: 39 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.041545:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142902.041546:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142902.041548:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880400, rc 0) 00000100:00100000:0.0:1746142902.041581:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32060:x1830962867100160:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 409us (463us total) trans 8589936421 rc 0/0 00000100:00100000:0.0:1746142902.041591:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14292 00010000:00010000:1.0:1746142902.042105:0:11943:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 33 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.042114:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 48 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.042120:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8600, rc 0) 00000100:00100000:1.0:1746142902.042133:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32052:x1830962867100288:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1178us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.042137:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13566 00000100:00100000:1.0:1746142902.042469:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867100416 00000100:00100000:1.0:1746142902.042472:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867100416 00010000:00010000:1.0:1746142902.042487:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d9 expref: 48 pid: 9578 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.042513:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6034 00000100:00100000:1.0:1746142902.042519:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867100416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.042536:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.042550:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d9 expref: 48 pid: 9578 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.042562:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d9 expref: 48 pid: 9578 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.042575:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccb55c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d9 expref: 48 pid: 9578 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.042585:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.042602:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867100416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.042607:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6034 00000100:00100000:1.0:1746142902.042914:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867100544 00000100:00100000:1.0:1746142902.042917:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867100544 00010000:00010000:1.0:1746142902.042928:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009711a000/0x2fa243e067ccb4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8979a expref: 33 pid: 9580 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.043055:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6035 00000100:00100000:1.0:1746142902.043060:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+33:2004:x1830962867100544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.043066:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.043072:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009711a000/0x2fa243e067ccb4f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8979a expref: 33 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.043080:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009711a000/0x2fa243e067ccb4f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8979a expref: 33 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.043090:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711a000/0x2fa243e067ccb4f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8979a expref: 33 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.043098:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.043099:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.043104:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.043110:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.043128:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 32 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.043137:0:7217:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 32 pid: 1853 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.043146:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867708160:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.043625:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.044993:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867708160:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.045007:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.045118:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:2004:x1830962867100544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2056us (2266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.045124:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6035 00000100:00100000:0.0:1746142902.047019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.047152:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867100800 00000100:00100000:1.0:1746142902.047158:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867100800 00002000:00100000:1.0:1746142902.047190:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4096000->4194303) req@ffff880093bcd180 x1830962867100800/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.047205:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd180 with x1830962867100800 ext(4096000->4194303) 00010000:00010000:1.0:1746142902.047211:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 32 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.047222:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 32 pid: 1853 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.047228:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093bcd180 00000100:00100000:1.0:1746142902.047609:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1254 00000100:00100000:1.0:1746142902.047616:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867100800:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142902.047929:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.048085:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867100928 00000100:00100000:1.0:1746142902.048088:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867100928 00000100:00100000:1.0:1746142902.048110:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13567 00000100:00100000:1.0:1746142902.048114:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+32:32056:x1830962867100928:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142902.048123:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.048135:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8983b expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.048153:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 45 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.048160:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.048166:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccb39c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896eb expref: 33 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.048172:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.048173:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.048176:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->3870719] (req 3145728->3870719) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 33 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.048197:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccb39c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896eb expref: 33 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.048204:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccb39c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896eb expref: 33 pid: 12211 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.048213:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867708288:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142902.048270:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.048277:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 13 pid: 9580 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.048284:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867708416:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142902.048301:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 45 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.048307:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009471fc00/0x2fa243e067ccb395 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896e4 expref: 45 pid: 12211 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.048318:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097432300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867708544:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142902.048328:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.052390:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.052473:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867708288:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142902.052483:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867708416:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142902.052489:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097432300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867708544:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142902.052513:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->3870719] (req 3145728->3870719) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 33 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.052537:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8000, rc 0) 00000100:00100000:0.0:1746142902.052573:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+33:32056:x1830962867100928:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4458us (4644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.052581:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13567 00000100:00100000:0.0:1746142902.052602:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867101056 00000100:00100000:0.0:1746142902.052607:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867101056 00000100:00100000:0.0:1746142902.052804:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13568 00000100:00100000:0.0:1746142902.052811:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32060:x1830962867101056:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142902.052822:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.052833:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89842 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.052851:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccb498 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89769 expref: 34 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.052858:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d2 expref: 48 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.052863:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.052864:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.052866:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1843200->2047999] (req 1843200->2047999) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 48 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.053144:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867100800:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 5526us (6128us total) trans 21474841075 rc 0/0 00000100:00100000:1.0:1746142902.053152:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1254 00002000:00100000:1.0:1746142902.053161:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4096000->4194303) req@ffff880093bcd180 x1830962867100800/t21474841075(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/448 e 0 to 0 dl 1746142913 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.053168:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd180 with x1830962867100800 ext(4096000->4194303) 00010000:00010000:1.0:1746142902.053174:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 34 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.053182:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccb5d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89826 expref: 34 pid: 1853 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.053187:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093bcd180 00000100:00100000:0.0:1746142902.053398:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.053511:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867101184 00000100:00100000:1.0:1746142902.053515:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867101184 00010000:00010000:1.0:1746142902.053538:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.053555:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6036 00000100:00100000:1.0:1746142902.053560:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867101184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.053567:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.053579:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.053588:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.053604:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea41e00/0x2fa243e067ccb3fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8972a expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.053613:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.053628:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962867101184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 69us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.053633:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6036 00000100:00100000:0.0:1746142902.054303:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.056181:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.056271:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.058667:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867709056:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142902.058680:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.060845:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867101568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4362us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.060855:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6039 00000100:00100000:1.0:1746142902.061323:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.061500:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.061825:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.061841:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867102080 00000100:00100000:1.0:1746142902.061844:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867102080 00002000:00100000:1.0:1746142902.061865:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096140a80 x1830962867102080/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.061873:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140a80 with x1830962867102080 ext(3145728->4194303) 00002000:00010000:1.0:1746142902.061877:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096140a80 00000100:00100000:0.0:1746142902.062201:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6040 00000100:00100000:0.0:1746142902.062208:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+33:2006:x1830962867101696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.062219:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.062236:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccb498 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89769 expref: 33 pid: 12211 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.062246:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccb498 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89769 expref: 33 pid: 12211 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.062265:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0800/0x2fa243e067ccb498 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89769 expref: 33 pid: 12211 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.062287:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.062320:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867101696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 113us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.062325:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6040 00000100:00100000:0.0:1746142902.062337:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6041 00000100:00100000:0.0:1746142902.062342:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867101824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.062348:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.062355:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d2 expref: 49 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.062367:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d2 expref: 49 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.062377:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccb54e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897d2 expref: 49 pid: 1853 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.062385:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.062386:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.062391:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 48 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.062397:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 48 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.062422:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 48 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.062432:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867709184:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142902.062472:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.062552:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4046 00000100:00100000:1.0:1746142902.062559:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867102080:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142902.065372:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.065594:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867709184:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142902.065611:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.066254:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867101824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3910us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.066262:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6041 00000100:00100000:0.0:1746142902.069229:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.072400:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867102080:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 9833us (10565us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142902.072413:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4046 00002000:00100000:1.0:1746142902.072422:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096140a80 x1830962867102080/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.072429:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140a80 with x1830962867102080 ext(3145728->4194303) 00002000:00010000:1.0:1746142902.072433:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096140a80 00000100:00100000:0.0:1746142902.072700:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.076993:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.079165:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.079229:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867103104 00000100:00100000:1.0:1746142902.079235:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867103104 00002000:00100000:1.0:1746142902.079258:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3870719) req@ffff880092134000 x1830962867103104/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.079265:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134000 with x1830962867103104 ext(3145728->3870719) 00010000:00010000:1.0:1746142902.079271:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 32 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.079281:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 32 pid: 11943 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.079286:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134000 00000100:00100000:1.0:1746142902.079312:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1255 00000100:00100000:1.0:1746142902.079319:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+32:2004:x1830962867103104:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142902.092341:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867103104:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 13016us (13170us total) trans 17179873811 rc 0/0 00000100:00100000:1.0:1746142902.092352:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1255 00002000:00100000:1.0:1746142902.092363:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3870719) req@ffff880092134000 x1830962867103104/t17179873811(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/448 e 0 to 0 dl 1746142913 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.092375:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134000 with x1830962867103104 ext(3145728->3870719) 00010000:00010000:1.0:1746142902.092384:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 34 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.092395:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 34 pid: 11943 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.092401:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134000 00000100:00100000:1.0:1746142902.096989:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.097048:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867103232 00000100:00100000:0.0:1746142902.097057:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867103232 00010000:00010000:0.0:1746142902.097170:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 34 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.097194:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6042 00000100:00100000:0.0:1746142902.097200:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867103232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.097212:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746142902.097225:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142901 -> 1746142902 00002000:00010000:0.0:1746142902.097227:0:13297:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142901 -> 1746142902 00010000:00010000:0.0:1746142902.097232:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 34 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.097243:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 34 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.097261:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8000/0x2fa243e067ccb604 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3870719) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8983b expref: 34 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.097277:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.097279:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.097285:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094715000/0x2fa243e067ccb612 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89849 expref: 45 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.097292:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094715000/0x2fa243e067ccb612 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89849 expref: 45 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.097325:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094715000/0x2fa243e067ccb612 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89849 expref: 45 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.097336:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867709440:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142902.097403:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.104619:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.104716:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867103488 00000100:00100000:1.0:1746142902.104724:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867103488 00002000:00100000:1.0:1746142902.104762:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff8800946c4e00 x1830962867103488/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.104771:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4e00 with x1830962867103488 ext(3145728->4194303) 00002000:00010000:1.0:1746142902.104776:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800946c4e00 00000100:00100000:1.0:1746142902.104807:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4049 00000100:00100000:1.0:1746142902.104815:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867103488:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142902.112269:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867103488:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7446us (7650us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142902.112279:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4049 00002000:00100000:1.0:1746142902.112288:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff8800946c4e00 x1830962867103488/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.112297:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4e00 with x1830962867103488 ext(3145728->4194303) 00002000:00010000:1.0:1746142902.112302:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800946c4e00 00000100:00100000:0.0:1746142902.119135:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.120030:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867103744 00000100:00100000:1.0:1746142902.120038:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867103744 00002000:00100000:1.0:1746142902.120071:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800922fd450 x1830962867103744/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.120080:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800922fd450 with x1830962867103744 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.120084:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800922fd450 00000100:00100000:1.0:1746142902.120112:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4050 00000100:00100000:1.0:1746142902.120118:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800922fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867103744:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.131560:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800922fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867103744:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11433us (12424us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142902.131570:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4050 00002000:00100000:1.0:1746142902.131581:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800922fd450 x1830962867103744/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.131590:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800922fd450 with x1830962867103744 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.131595:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800922fd450 00000100:00100000:0.0:1746142902.195287:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.199369:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.201114:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.204869:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.220172:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.225753:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.225792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.225817:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867105024 00000100:00100000:1.0:1746142902.225825:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867105024 00010000:00010000:1.0:1746142902.225864:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccb5c5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89818 expref: 48 pid: 1853 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.225887:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867104896 00000100:00100000:1.0:1746142902.225890:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867104896 00010000:00010000:1.0:1746142902.225921:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 33 pid: 1853 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.225936:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6043 00000100:00100000:1.0:1746142902.225943:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867105024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.225954:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.225972:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccb5c5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89818 expref: 48 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.225980:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccb5c5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89818 expref: 48 pid: 1853 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.226025:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6044 00000100:00100000:0.0:1746142902.226032:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+33:2003:x1830962867104896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.226039:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.228879:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 33 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.229087:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccb5c5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89818 expref: 47 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.229089:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 33 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.229103:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccb5be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89811 expref: 33 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.229111:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.229112:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.229119:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.229127:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.229135:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142902.229163:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.229175:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867709824:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142902.229177:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+32:2003:x1830962867104896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3145us (3383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.229185:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6044 00000100:00100000:1.0:1746142902.229226:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.232185:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.232343:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867105280 00000100:00100000:1.0:1746142902.232351:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867105280 00000100:00100000:1.0:1746142902.232397:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14295 00000100:00100000:1.0:1746142902.232403:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:32070:x1830962867105280:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.232423:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.232437:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06400/0x2fa243e067ccb666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89865 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.232497:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232507:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232516:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232538:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232544:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232548:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232622:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccb67b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232631:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccb67b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232636:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccb67b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142902.232644:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142902.232699:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232705:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232710:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232715:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232719:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d951800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142902.232723:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232729:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232738:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142902.232740:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142902.232743:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232747:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb66d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232757:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232761:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232764:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232767:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d951c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142902.232769:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232773:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232777:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b4860000) 00010000:00010000:1.0:1746142902.232778:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142902.232779:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232782:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb674 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.232813:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06400/0x2fa243e067ccb666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89865 expref: 25 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.232822:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccb67b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89865 expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.232828:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142902.232829:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142902.232831:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d951200, rc 0) 00000100:00100000:1.0:1746142902.232877:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:32070:x1830962867105280:12345-192.168.204.50@tcp:101:cat.0 Request processed in 474us (699us total) trans 8589936426 rc 0/0 00000100:00100000:1.0:1746142902.232883:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14295 00000100:00100000:0.0:1746142902.234887:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.234927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.235017:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867709824:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.235033:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.235070:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962867105024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9127us (9324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.235082:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6043 00000100:00100000:0.0:1746142902.235119:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.235138:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867105920 00000100:00100000:0.0:1746142902.235143:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867105920 00000100:00100000:0.0:1746142902.235171:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 745 00000100:00100000:0.0:1746142902.235181:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867105920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.235191:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.235208:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccb67b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89865 expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.235220:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142902.235224:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.235242:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867105920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.235266:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 745 00000100:00100000:0.0:1746142902.238469:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.240416:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.240612:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.243122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.243668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.243843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.244378:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867106944 00000100:00100000:0.0:1746142902.244381:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867106944 00000100:00100000:0.0:1746142902.244411:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5177 00000100:00100000:0.0:1746142902.244415:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32066:x1830962867106944:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142902.244548:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32066:x1830962867106944:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 132us (705us total) trans 8589936428 rc 0/0 00000100:00100000:0.0:1746142902.244554:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5177 00000100:00100000:0.0:1746142902.256186:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.258382:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867107200 00000100:00100000:1.0:1746142902.258392:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867107200 00002000:00100000:1.0:1746142902.258433:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dbf7800 x1830962867107200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.258443:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7800 with x1830962867107200 ext(1048576->2097151) 00002000:00010000:1.0:1746142902.258448:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7800 00000100:00100000:1.0:1746142902.258477:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4053 00000100:00100000:1.0:1746142902.258484:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+33:2004:x1830962867107200:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.270977:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+33:2004:x1830962867107200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12486us (14792us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142902.270987:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4053 00002000:00100000:1.0:1746142902.270996:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dbf7800 x1830962867107200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.271005:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7800 with x1830962867107200 ext(1048576->2097151) 00002000:00010000:1.0:1746142902.271010:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7800 00000100:00100000:0.0:1746142902.274071:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.281482:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.281590:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.281671:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867107840 00000100:00100000:1.0:1746142902.281678:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867107840 00000100:00100000:1.0:1746142902.281724:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5178 00000100:00100000:1.0:1746142902.281731:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32074:x1830962867107840:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142902.281883:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32074:x1830962867107840:12345-192.168.204.50@tcp:35:cat.0 Request processed in 152us (292us total) trans 8589936430 rc 0/0 00000100:00100000:1.0:1746142902.281889:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5178 00000100:00100000:1.0:1746142902.287351:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.287810:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867107968 00000100:00100000:0.0:1746142902.287817:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867107968 00000100:00100000:0.0:1746142902.287868:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 746 00000100:00100000:0.0:1746142902.287875:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867107968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.287886:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.287925:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccb6ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89888 expref: 45 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.287941:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142902.287945:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.287977:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2003:x1830962867107968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.287983:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 746 00000100:00100000:0.0:1746142902.293248:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.300103:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.300145:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867108096 00000100:00100000:1.0:1746142902.300153:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867108096 00002000:00100000:1.0:1746142902.300192:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1388544->1695743) req@ffff88012de10a80 x1830962867108096/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.300202:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de10a80 with x1830962867108096 ext(1388544->1695743) 00010000:00010000:1.0:1746142902.300210:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 46 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.300223:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 46 pid: 11943 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.300229:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de10a80 00000100:00100000:1.0:1746142902.300255:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1256 00000100:00100000:1.0:1746142902.300261:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867108096:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142902.306570:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.309545:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867108608 00000100:00100000:1.0:1746142902.309556:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867108608 00002000:00100000:1.0:1746142902.309596:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012de11500 x1830962867108608/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 504/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.309605:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de11500 with x1830962867108608 ext(1048576->2097151) 00002000:00010000:1.0:1746142902.309610:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de11500 00000100:00100000:1.0:1746142902.309639:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4054 00000100:00100000:1.0:1746142902.309647:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867108608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.317147:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867108096:12345-192.168.204.50@tcp:4:cat.0 Request processed in 16873us (23894us total) trans 17179873812 rc 0/0 00000100:00100000:1.0:1746142902.317162:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1256 00002000:00100000:1.0:1746142902.317171:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1388544->1695743) req@ffff88012de10a80 x1830962867108096/t17179873812(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/448 e 0 to 0 dl 1746142913 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.317180:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de10a80 with x1830962867108096 ext(1388544->1695743) 00010000:00010000:1.0:1746142902.317189:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 50 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.317202:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094714800/0x2fa243e067ccb65f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->1695743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8985e expref: 50 pid: 11943 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.317209:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de10a80 00000100:00100000:0.0:1746142902.319780:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867108608:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10133us (13217us total) trans 0 rc 843776/843776 00000100:00100000:0.0:1746142902.319786:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4054 00002000:00100000:0.0:1746142902.319792:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012de11500 x1830962867108608/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 504/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142902.319798:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de11500 with x1830962867108608 ext(1048576->2097151) 00002000:00010000:0.0:1746142902.319801:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de11500 00000100:00100000:0.0:1746142902.326717:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.330380:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.330419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.331289:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.331303:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867109504 00000100:00100000:1.0:1746142902.331307:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867109504 00002000:00100000:1.0:1746142902.331323:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012de12680 x1830962867109504/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.331330:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12680 with x1830962867109504 ext(1048576->2097151) 00002000:00010000:1.0:1746142902.331333:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de12680 00000100:00100000:1.0:1746142902.331358:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4057 00000100:00100000:1.0:1746142902.331364:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867109504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.353240:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867109504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21864us (21941us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142902.353253:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4057 00002000:00100000:1.0:1746142902.353267:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012de12680 x1830962867109504/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.353282:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12680 with x1830962867109504 ext(1048576->2097151) 00002000:00010000:1.0:1746142902.353288:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de12680 00000100:00100000:0.0:1746142902.359242:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.359805:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.364673:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.365258:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867109888 00000100:00100000:0.0:1746142902.365262:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867109888 00000100:00100000:0.0:1746142902.365297:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13578 00000100:00100000:0.0:1746142902.365303:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+35:32067:x1830962867109888:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142902.365311:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.365321:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb898a4 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.365336:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.365344:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8ee00/0x2fa243e067ccb697 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8987a expref: 36 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.365349:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.365351:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.365353:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898a4 expref: 36 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.365370:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8ee00/0x2fa243e067ccb697 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8987a expref: 36 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.365378:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8ee00/0x2fa243e067ccb697 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8987a expref: 36 pid: 12211 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746142902.365441:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867710592:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142902.365499:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.365507:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 46 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.365514:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867710720:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142902.365542:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.367126:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.367170:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.367757:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867110016 00000100:00100000:1.0:1746142902.367761:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867110016 00002000:00100000:1.0:1746142902.367783:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1843200->2047999) req@ffff88013644e300 x1830962867110016/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.367792:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e300 with x1830962867110016 ext(1843200->2047999) 00010000:00010000:1.0:1746142902.367797:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 47 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.367805:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 47 pid: 11943 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.367810:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644e300 00000100:00100000:1.0:1746142902.367830:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1258 00000100:00100000:1.0:1746142902.367835:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867110016:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142902.373321:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867110016:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5476us (6187us total) trans 21474841076 rc 0/0 00000100:00100000:1.0:1746142902.373334:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1258 00002000:00100000:1.0:1746142902.373346:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1843200->2047999) req@ffff88013644e300 x1830962867110016/t21474841076(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/448 e 0 to 0 dl 1746142913 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.373354:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e300 with x1830962867110016 ext(1843200->2047999) 00010000:00010000:1.0:1746142902.373364:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 49 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.373375:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 49 pid: 11943 timeout: 776 lvb_type: 0 00002000:00010000:1.0:1746142902.373382:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644e300 00000100:00100000:0.0:1746142902.374789:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867110400 00000100:00100000:0.0:1746142902.374792:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867110400 00010000:00010000:0.0:1746142902.374807:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 50 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.374825:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6047 00000100:00100000:0.0:1746142902.374829:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2004:x1830962867110400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.374836:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.374852:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 50 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.374861:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 50 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.374875:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccb5da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89834 expref: 50 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.374888:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.374889:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.374894:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898a4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.374915:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898a4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.374940:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898a4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.374950:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867710848:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142902.374993:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.379007:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.379087:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867710848:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.379103:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.379139:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867110400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4308us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.379148:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6047 00000100:00100000:1.0:1746142902.379172:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867110528 00000100:00100000:1.0:1746142902.379177:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867110528 00010000:00010000:1.0:1746142902.379197:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 49 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.379217:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6048 00000100:00100000:1.0:1746142902.379223:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867110528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.379234:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.379251:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 49 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.379260:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 49 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.379280:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccb60b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2047999) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89842 expref: 49 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.379301:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.379303:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.379309:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccb6d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8989d expref: 33 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.379316:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccb6d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8989d expref: 33 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.379341:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccb6d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8989d expref: 33 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.379351:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867710976:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.379393:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.380515:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.381453:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867110784 00000100:00100000:1.0:1746142902.381460:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867110784 00002000:00100000:1.0:1746142902.381495:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2682880->2686975) req@ffff88013644e680 x1830962867110784/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.381504:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e680 with x1830962867110784 ext(2682880->2686975) 00002000:00010000:1.0:1746142902.381508:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644e680 00000100:00100000:0.0:1746142902.382138:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.382747:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867710976:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142902.382760:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.382791:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867110528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3568us (3791us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.382799:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6048 00000100:00100000:1.0:1746142902.383348:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867111040 00000100:00100000:1.0:1746142902.383352:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867111040 00002000:00100000:1.0:1746142902.383370:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88013644ed80 x1830962867111040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.383377:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ed80 with x1830962867111040 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.383380:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644ed80 00000100:00100000:1.0:1746142902.383394:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4058 00000100:00100000:1.0:1746142902.383400:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867110784:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142902.383511:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867110784:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 110us (2998us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142902.383526:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4058 00002000:00100000:1.0:1746142902.383531:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2682880->2686975) req@ffff88013644e680 x1830962867110784/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.383538:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e680 with x1830962867110784 ext(2682880->2686975) 00002000:00010000:1.0:1746142902.383541:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644e680 00000100:00100000:1.0:1746142902.383552:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4059 00000100:00100000:1.0:1746142902.383557:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867111040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142902.392674:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.401528:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867111040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17954us (19375us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142902.401540:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4059 00002000:00100000:1.0:1746142902.401552:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88013644ed80 x1830962867111040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.401561:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ed80 with x1830962867111040 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.401566:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644ed80 00000100:00100000:0.0:1746142902.403348:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.403409:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867111552 00000100:00100000:1.0:1746142902.403416:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867111552 00010000:00010000:1.0:1746142902.403440:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e400/0x2fa243e067ccb69e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89881 expref: 36 pid: 12211 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.403472:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6049 00000100:00100000:1.0:1746142902.403477:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+36:2006:x1830962867111552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.403487:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.403501:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e400/0x2fa243e067ccb69e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89881 expref: 36 pid: 12211 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.403511:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e400/0x2fa243e067ccb69e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89881 expref: 36 pid: 12211 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.403537:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.403565:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+36:2006:x1830962867111552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.403571:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6049 00000100:00100000:0.0:1746142902.407316:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.410214:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867111808 00000100:00100000:1.0:1746142902.410219:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867111808 00000100:00100000:1.0:1746142902.410243:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867111936 00000100:00100000:1.0:1746142902.410245:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867111936 00000100:00100000:1.0:1746142902.410257:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13581 00000100:00100000:1.0:1746142902.410262:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867111808:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.410275:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.410287:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb898b9 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.410300:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.410301:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.410306:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b9 expref: 50 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.410317:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b9 expref: 50 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.410325:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098444400, rc 0) 00000100:00100000:1.0:1746142902.410348:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2003:x1830962867111808:12345-192.168.204.50@tcp:101:cat.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.410353:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13581 00000100:00100000:1.0:1746142902.410366:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13582 00000100:00100000:1.0:1746142902.410371:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867111936:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.410376:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.410382:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098445400/0x2fa243e067ccb6f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb898c0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.410396:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098445400/0x2fa243e067ccb6f9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898c0 expref: 50 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.410403:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098445400/0x2fa243e067ccb6f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898c0 expref: 50 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.410412:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445400, rc 0) 00000100:00100000:1.0:1746142902.410426:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867111936:12345-192.168.204.50@tcp:101:cat.0 Request processed in 55us (274us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142902.410431:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13582 00000100:00100000:0.0:1746142902.411274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.419691:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.424319:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.426286:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.426363:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.433849:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867112832 00000100:00100000:1.0:1746142902.433856:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867112832 00002000:00100000:1.0:1746142902.433887:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2572288->2576383) req@ffff88012e679f80 x1830962867112832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.433923:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679f80 with x1830962867112832 ext(2572288->2576383) 00002000:00010000:1.0:1746142902.433928:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e679f80 00000100:00100000:1.0:1746142902.433945:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4061 00000100:00100000:1.0:1746142902.433952:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867112832:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.434043:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867112832:12345-192.168.204.50@tcp:3:cat.0 Request processed in 92us (393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142902.434048:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4061 00002000:00100000:1.0:1746142902.434053:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2572288->2576383) req@ffff88012e679f80 x1830962867112832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.434059:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679f80 with x1830962867112832 ext(2572288->2576383) 00002000:00010000:1.0:1746142902.434062:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e679f80 00000100:00100000:0.0:1746142902.434374:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+37:2005:x1830962867112448:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6267us (8009us total) trans 21474841077 rc 0/0 00000100:00100000:0.0:1746142902.434380:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1259 00002000:00100000:0.0:1746142902.434385:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2682880->3145727) req@ffff88013644dc00 x1830962867112448/t21474841077(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/448 e 0 to 0 dl 1746142913 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142902.434390:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644dc00 with x1830962867112448 ext(2682880->3145727) 00010000:00010000:0.0:1746142902.434397:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898a4 expref: 37 pid: 1852 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.434409:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927d7c00/0x2fa243e067ccb6dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2682880->3145727] (req 2682880->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898a4 expref: 37 pid: 1852 timeout: 776 lvb_type: 0 00002000:00010000:0.0:1746142902.434414:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644dc00 00000100:00100000:0.0:1746142902.442362:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.458997:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.459046:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.459102:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867113472 00000100:00100000:1.0:1746142902.459106:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867113472 00002000:00100000:1.0:1746142902.459123:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2576384->4194303) req@ffff8800968eb100 x1830962867113472/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.459130:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb100 with x1830962867113472 ext(2576384->4194303) 00002000:00010000:1.0:1746142902.459134:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eb100 00000100:00100000:1.0:1746142902.459164:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4062 00000100:00100000:1.0:1746142902.459171:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867113472:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142902.475040:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.475107:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.475134:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867113856 00000100:00100000:0.0:1746142902.475137:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867113856 00000100:00100000:1.0:1746142902.475568:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14298 00000100:00100000:1.0:1746142902.475575:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32079:x1830962867113856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142902.475591:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.475599:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027c00/0x2fa243e067ccb731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb898ea expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.475624:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccb73f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475630:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccb73f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475636:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccb73f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475643:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027400/0x2fa243e067ccb746 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475648:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027400/0x2fa243e067ccb746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475652:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027400/0x2fa243e067ccb746 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475678:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927fc000/0x2fa243e067ccb74d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475685:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897fc expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.475691:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927fc000/0x2fa243e067ccb74d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.475715:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897fc expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.475725:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067ccb5a2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897fc expref: 23 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.475736:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867712000:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142902.475876:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bc4c000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.487027:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867113472:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27849us (27972us total) trans 0 rc 1617920/1617920 00000100:00100000:1.0:1746142902.487036:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4062 00002000:00100000:1.0:1746142902.487047:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2576384->4194303) req@ffff8800968eb100 x1830962867113472/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 1617920/1617920 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.487054:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb100 with x1830962867113472 ext(2576384->4194303) 00002000:00010000:1.0:1746142902.487059:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eb100 00000100:00100000:0.0:1746142902.487663:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.487828:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867114112 00000100:00100000:1.0:1746142902.487834:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867114112 00000100:00100000:1.0:1746142902.487861:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5179 00000100:00100000:1.0:1746142902.487867:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7d7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:27292:x1830962867114112:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142902.488083:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7d7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+25:27292:x1830962867114112:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 215us (420us total) trans 8589936432 rc 0/0 00000100:00100000:1.0:1746142902.488089:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5179 00000100:00100000:0.0:1746142902.498126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.498197:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867114368 00000100:00100000:1.0:1746142902.498202:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867114368 00000100:00100000:1.0:1746142902.498224:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 747 00000100:00100000:1.0:1746142902.498229:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867114368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.498235:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.498244:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b05fa00/0x2fa243e067ccb738 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898e3 expref: 46 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.498259:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142902.498261:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.498281:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867114368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.498286:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 747 00000100:00100000:1.0:1746142902.498412:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+36:2003:x1830962867113216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 39229us (39422us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142902.498418:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4063 00002000:00100000:1.0:1746142902.498425:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88013644d880 x1830962867113216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.498433:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d880 with x1830962867113216 ext(2097152->4194303) 00002000:00010000:1.0:1746142902.498437:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644d880 00000100:00100000:0.0:1746142902.500632:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.500664:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.500685:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.500705:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.500717:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.500735:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.500760:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867114496 00000100:00100000:0.0:1746142902.500765:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867114496 00000100:00100000:0.0:1746142902.500788:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867114624 00000100:00100000:0.0:1746142902.500790:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867114624 00000100:00100000:0.0:1746142902.500799:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867114752 00000100:00100000:0.0:1746142902.500800:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867114752 00000100:00100000:0.0:1746142902.500807:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867114880 00000100:00100000:0.0:1746142902.500809:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867114880 00000100:00100000:0.0:1746142902.500815:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867115008 00000100:00100000:0.0:1746142902.500817:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867115008 00000100:00100000:0.0:1746142902.500829:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867115136 00000100:00100000:0.0:1746142902.500830:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867115136 00000100:00100000:0.0:1746142902.500839:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13587 00000100:00100000:0.0:1746142902.500846:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867114496:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142902.500860:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.500872:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccb75b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb898f1 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.500889:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.500890:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.502834:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccb75b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898f1 expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.504774:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccb75b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898f1 expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.504788:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8f000, rc 0) 00000100:00100000:1.0:1746142902.504955:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867114496:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4106us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.504962:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13587 00000100:00100000:0.0:1746142902.510716:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.510805:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867115392 00000100:00100000:1.0:1746142902.510811:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867115392 00002000:00100000:1.0:1746142902.510847:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880088d63480 x1830962867115392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.510855:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d63480 with x1830962867115392 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.510859:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d63480 00000100:00100000:0.0:1746142902.528554:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.530310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.535008:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.536716:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.536766:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867116032 00000100:00100000:1.0:1746142902.536769:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867116032 00010000:00010000:1.0:1746142902.536782:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccb78c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8991b expref: 14 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.536805:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6054 00000100:00100000:1.0:1746142902.536809:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867116032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.536814:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.536817:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccb78c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8991b expref: 14 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.536823:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccb78c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8991b expref: 14 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.536833:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6000/0x2fa243e067ccb78c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8991b expref: 14 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.536844:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142902.536847:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067ccb7a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.536851:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067ccb7a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.536855:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067ccb7a1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142902.536863:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.536890:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867116032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.536893:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6054 00000100:00100000:0.0:1746142902.539023:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.545551:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.551054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.599009:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.604298:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.617464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.617539:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867117056 00000100:00100000:1.0:1746142902.617547:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867117056 00010000:00010000:1.0:1746142902.617582:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067ccb6eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b2 expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.617663:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6055 00000100:00100000:1.0:1746142902.617670:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+36:2006:x1830962867117056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.617683:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.617701:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067ccb6eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2576383) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b2 expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.617712:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067ccb6eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2576383) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b2 expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.617731:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067ccb6eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2576383) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b2 expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.617761:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.617763:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.617770:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccb7bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89937 expref: 47 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.617777:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccb7bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89937 expref: 47 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.617804:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccb7bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3059712->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89937 expref: 47 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.617813:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867712768:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.617883:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c5156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.619679:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867712768:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.619694:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.619720:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+35:2006:x1830962867117056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2050us (2262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.619728:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6055 00000100:00100000:0.0:1746142902.620455:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.624194:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.628350:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.628416:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.628619:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867117696 00000100:00100000:0.0:1746142902.628625:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867117696 00010000:00010000:0.0:1746142902.628650:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2200/0x2fa243e067ccb6e4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ab expref: 51 pid: 1852 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.628670:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867117568 00000100:00100000:0.0:1746142902.628672:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867117568 00010000:00010000:0.0:1746142902.628679:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067ccb777 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8990d expref: 13 pid: 9580 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746142902.628690:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6056 00000100:00100000:0.0:1746142902.628695:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2005:x1830962867117696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.628704:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.628719:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2200/0x2fa243e067ccb6e4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ab expref: 51 pid: 1852 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.628728:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2200/0x2fa243e067ccb6e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ab expref: 51 pid: 1852 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.628746:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.628775:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2005:x1830962867117696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.628780:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6056 00000100:00100000:0.0:1746142902.628791:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6057 00000100:00100000:0.0:1746142902.628795:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867117568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.628799:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.628804:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067ccb777 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8990d expref: 13 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.628815:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067ccb777 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8990d expref: 13 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.628824:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.628834:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867117568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.628838:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6057 00000100:00100000:0.0:1746142902.631202:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.631264:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867117824 00000100:00100000:1.0:1746142902.631270:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867117824 00010000:00010000:1.0:1746142902.631289:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f200/0x2fa243e067ccb707 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ce expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.631315:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6058 00000100:00100000:1.0:1746142902.631320:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+36:2005:x1830962867117824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.631329:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.631342:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f200/0x2fa243e067ccb707 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ce expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.631352:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f200/0x2fa243e067ccb707 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ce expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.631368:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f200/0x2fa243e067ccb707 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ce expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.631381:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.631383:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.631388:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 48 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.631395:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 48 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.631421:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 48 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.631430:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867713280:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.631485:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515240 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.633316:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867713280:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.633328:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.633359:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+35:2005:x1830962867117824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2039us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.633366:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6058 00000100:00100000:1.0:1746142902.639122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.642304:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.642408:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867118336 00000100:00100000:1.0:1746142902.642420:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867118336 00000100:00100000:1.0:1746142902.642468:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5181 00000100:00100000:1.0:1746142902.642475:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32078:x1830962867118336:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142902.642667:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32078:x1830962867118336:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 192us (367us total) trans 8589936435 rc 0/0 00000100:00100000:1.0:1746142902.642675:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5181 00000100:00100000:0.0:1746142902.643299:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.644654:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.644700:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867118848 00000100:00100000:1.0:1746142902.644706:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867118848 00000100:00100000:1.0:1746142902.644735:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5182 00000100:00100000:1.0:1746142902.644741:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:32085:x1830962867118848:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142902.644831:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:32085:x1830962867118848:12345-192.168.204.50@tcp:35:cat.0 Request processed in 89us (177us total) trans 8589936437 rc 0/0 00000100:00100000:1.0:1746142902.644837:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5182 00000100:00100000:0.0:1746142902.646017:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.646099:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.646119:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867119104 00000100:00100000:1.0:1746142902.646123:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867119104 00000100:00100000:1.0:1746142902.646150:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13597 00000100:00100000:1.0:1746142902.646156:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+35:2003:x1830962867119104:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.646164:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.646172:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067ccb7f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89953 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.646204:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867713408:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142902.646266:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.647053:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867713408:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142902.647070:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067ccb7f5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89953 expref: 36 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.647079:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067ccb7f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89953 expref: 36 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.647086:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77a00, rc 0) 00000100:00100000:1.0:1746142902.647113:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+35:2003:x1830962867119104:12345-192.168.204.50@tcp:101:cat.0 Request processed in 957us (1014us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142902.647121:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13597 00000100:00100000:0.0:1746142902.656071:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867119232 00000100:00100000:0.0:1746142902.656077:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867119232 00000100:00100000:0.0:1746142902.656114:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867119360 00000100:00100000:0.0:1746142902.656115:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867119360 00000100:00100000:0.0:1746142902.656138:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13598 00000100:00100000:0.0:1746142902.656144:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+35:2006:x1830962867119232:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142902.656159:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.656173:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d951400/0x2fa243e067ccb7fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8995a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.656210:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867713664:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142902.656351:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.661248:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.661611:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867119744 00000100:00100000:0.0:1746142902.661666:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867119744 00000100:00100000:1.0:1746142902.661719:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.661780:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14303 00000100:00100000:0.0:1746142902.661786:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4008050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32091:x1830962867119744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142902.661799:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.661808:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8996f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.661856:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.661865:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.661873:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.661884:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.661889:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.661914:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.661974:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067ccb834 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662122:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067ccb834 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662129:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067ccb834 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142902.662140:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142902.662200:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662205:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662210:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662215:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662220:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d950800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142902.662222:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662227:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662235:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142902.662237:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142902.662240:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662244:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccb81f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662270:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662275:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662282:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662286:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d951c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142902.662288:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662292:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662298:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4400) 00010000:00010000:0.0:1746142902.662299:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142902.662301:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662305:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067ccb82d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142902.662333:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccb811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8996f expref: 49 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.662342:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067ccb834 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8996f expref: 48 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.662347:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142902.662349:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142902.662351:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950000, rc 0) 00000100:00100000:0.0:1746142902.662775:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4008050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32091:x1830962867119744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 988us (1451us total) trans 8589936438 rc 0/0 00000100:00100000:0.0:1746142902.662782:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14303 00000100:00100000:0.0:1746142902.664702:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.665076:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.665093:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867120128 00000100:00100000:1.0:1746142902.665098:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867120128 00010000:00010000:1.0:1746142902.665116:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2800/0x2fa243e067ccb7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89945 expref: 29 pid: 7231 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.665142:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6059 00000100:00100000:1.0:1746142902.665147:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867120128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.665156:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.665160:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2800/0x2fa243e067ccb7e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89945 expref: 29 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.665167:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2800/0x2fa243e067ccb7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89945 expref: 29 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.665181:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2800/0x2fa243e067ccb7e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89945 expref: 29 pid: 7231 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.665192:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142902.665195:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142902.665201:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142902.665205:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.665421:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.665435:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.665482:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.665494:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867120768 00000100:00100000:0.0:1746142902.665496:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867120768 00000100:00100000:0.0:1746142902.665522:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 748 00000100:00100000:0.0:1746142902.665527:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867120768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.665534:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.665542:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067ccb834 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8996f expref: 48 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.665551:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142902.665553:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.665567:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867120768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 40us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.665572:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 748 00000100:00100000:1.0:1746142902.665649:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867120128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 501us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.665655:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6059 00000100:00100000:1.0:1746142902.665672:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867120640 00000100:00100000:1.0:1746142902.665674:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867120640 00000100:00100000:1.0:1746142902.665688:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5183 00000100:00100000:1.0:1746142902.665692:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32091:x1830962867120640:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142902.665768:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32091:x1830962867120640:12345-192.168.204.50@tcp:35:cat.0 Request processed in 69us (326us total) trans 8589936440 rc 0/0 00000100:00100000:1.0:1746142902.665773:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5183 00000100:00100000:0.0:1746142902.669454:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:0.0:1746142902.675082:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841078 is committed 00000001:00080000:0.0:1746142902.675093:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841077 is committed 00000001:00080000:0.0:1746142902.675112:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841071 is committed 00000001:00080000:0.0:1746142902.675254:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841037 is committed 00000100:00100000:0.0:1746142902.676981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.677074:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.677075:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867121024 00000100:00100000:1.0:1746142902.677083:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867121024 00010000:00010000:1.0:1746142902.677110:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 23 pid: 9580 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.677133:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6061 00000100:00100000:1.0:1746142902.677140:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867121024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.677149:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.677166:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 23 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.677176:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 23 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.677192:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccb7c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3964927) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8993e expref: 23 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.677213:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.677215:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.677221:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccb80a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89968 expref: 7 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.677228:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccb80a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89968 expref: 7 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.677253:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccb80a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89968 expref: 7 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.677262:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867714432:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.678274:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.679941:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867714432:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.679957:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.680000:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2006:x1830962867121024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2859us (3024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.680008:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6061 00000100:00100000:0.0:1746142902.681232:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.681256:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.681278:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.681312:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.681327:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867121408 00000100:00100000:0.0:1746142902.681330:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867121408 00010000:00010000:0.0:1746142902.681349:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3fe00/0x2fa243e067ccb769 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ff expref: 15 pid: 9580 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746142902.681367:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867121280 00000100:00100000:0.0:1746142902.681369:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867121280 00010000:00010000:0.0:1746142902.681382:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccb6cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89896 expref: 48 pid: 11943 timeout: 776 lvb_type: 1 00000100:00100000:0.0:1746142902.681394:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867121792 00000100:00100000:0.0:1746142902.681396:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867121792 00000100:00100000:1.0:1746142902.681402:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6062 00010000:00010000:0.0:1746142902.681402:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800981a1200/0x2fa243e067ccb6c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8988f expref: 36 pid: 11943 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.681408:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867121408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142902.681413:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6063 00010000:00010000:1.0:1746142902.681417:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142902.681417:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867121280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.681422:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.681429:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3fe00/0x2fa243e067ccb769 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ff expref: 15 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.681429:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccb6cf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89896 expref: 48 pid: 11943 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.681438:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccb6cf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89896 expref: 48 pid: 11943 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.681449:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd3fe00/0x2fa243e067ccb769 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ff expref: 15 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.681466:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3fe00/0x2fa243e067ccb769 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898ff expref: 15 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.681476:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.681497:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867121408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.681502:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6062 00010000:00010000:0.0:1746142902.681609:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccb6cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89896 expref: 48 pid: 11943 timeout: 776 lvb_type: 1 00010000:00010000:0.0:1746142902.681889:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.681891:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.681922:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.681928:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.681952:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.681968:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867714944:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142902.682123:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.687731:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.688790:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867714944:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.688802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142902.688802:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.688818:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867121280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7400us (7561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.688824:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6063 00000100:00100000:1.0:1746142902.696753:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.701164:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.701294:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.705086:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.710441:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.716293:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867715328:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142902.716311:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.716358:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867123072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5618us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.716367:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6065 00000100:00100000:1.0:1746142902.716709:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.717020:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867123200 00000100:00100000:0.0:1746142902.717026:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867123200 00010000:00010000:0.0:1746142902.717051:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.717079:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6066 00000100:00100000:0.0:1746142902.717085:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+38:2005:x1830962867123200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.717097:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746142902.717111:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142902 -> 1746142903 00002000:00010000:0.0:1746142902.717113:0:13297:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142902 -> 1746142903 00010000:00010000:0.0:1746142902.717118:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.717129:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.717153:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb850 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1257472->1535999) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89984 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.717167:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.717169:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.717175:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 48 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.717182:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 48 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.717208:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 48 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.717219:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867715456:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142902.717262:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.722972:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.723004:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.723027:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.723055:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.724917:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4071 00000100:00100000:1.0:1746142902.724925:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2006:x1830962867124224:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142902.747012:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2006:x1830962867124224:12345-192.168.204.50@tcp:3:cat.0 Request processed in 22081us (23949us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142902.747023:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4071 00002000:00100000:0.0:1746142902.747033:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088d62300 x1830962867124224/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142902.747041:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62300 with x1830962867124224 ext(1048576->2097151) 00002000:00010000:0.0:1746142902.747046:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d62300 00000100:00100000:0.0:1746142902.787620:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.789383:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.789415:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.789431:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867124736 00000100:00100000:0.0:1746142902.789435:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867124736 00000100:00100000:0.0:1746142902.789457:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867124992 00000100:00100000:0.0:1746142902.789459:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867124992 00000100:00100000:0.0:1746142902.789472:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13605 00000100:00100000:0.0:1746142902.789477:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+37:2005:x1830962867124736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142902.789486:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.789494:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb899a0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.789508:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.789520:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.789526:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 38 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.789538:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 38 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.789548:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710cc00, rc 0) 00000100:00100000:0.0:1746142902.789584:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+38:2005:x1830962867124736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 107us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.789590:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13605 00000100:00100000:0.0:1746142902.789602:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13606 00000100:00100000:0.0:1746142902.789606:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867124992:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142902.789612:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.789618:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb899ae expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.789628:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.789629:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.789633:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 50 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.789641:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 50 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.789647:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710d600, rc 0) 00000100:00100000:0.0:1746142902.789660:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867124992:12345-192.168.204.50@tcp:101:cat.0 Request processed in 53us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.789664:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13606 00000100:00100000:0.0:1746142902.789687:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.789698:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867124864 00000100:00100000:0.0:1746142902.789700:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867124864 00000100:00100000:0.0:1746142902.789713:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13607 00000100:00100000:0.0:1746142902.789717:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2005:x1830962867124864:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142902.789723:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142902.789730:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb899a7 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.789739:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.789741:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.789744:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a7 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.789753:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a7 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142902.789758:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710d400, rc 0) 00000100:00100000:0.0:1746142902.789770:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867124864:12345-192.168.204.50@tcp:101:cat.0 Request processed in 53us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.789775:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13607 00000100:00100000:0.0:1746142902.791122:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.796674:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.796732:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867125248 00000100:00100000:0.0:1746142902.796740:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867125248 00000100:00100000:0.0:1746142902.797428:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 749 00000100:00100000:0.0:1746142902.797437:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867125248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.797449:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.797469:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0e00/0x2fa243e067ccb87a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89999 expref: 50 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.797490:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142902.797494:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142902.797535:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867125248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142902.797541:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 749 00000100:00100000:0.0:1746142902.802466:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.802503:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.825089:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.834458:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.834500:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.834528:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.834549:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867126144 00000100:00100000:1.0:1746142902.834559:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867126144 00010000:00010000:1.0:1746142902.834582:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8981f expref: 39 pid: 11943 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.834599:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867126016 00000100:00100000:1.0:1746142902.834601:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867126016 00010000:00010000:1.0:1746142902.834609:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3ea00/0x2fa243e067ccb762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898f8 expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.834619:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867126272 00000100:00100000:1.0:1746142902.834620:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867126272 00010000:00010000:1.0:1746142902.834627:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 50 pid: 1853 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.834638:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6067 00000100:00100000:1.0:1746142902.834643:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+39:2005:x1830962867126144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.834652:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.834665:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8981f expref: 39 pid: 11943 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.834673:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8981f expref: 39 pid: 11943 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.834689:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067ccb5cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8981f expref: 39 pid: 11943 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.834702:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.834716:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+38:2005:x1830962867126144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.834721:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6067 00000100:00100000:1.0:1746142902.834752:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6068 00000100:00100000:1.0:1746142902.834756:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867126016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.834761:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.834766:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3ea00/0x2fa243e067ccb762 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898f8 expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.834773:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd3ea00/0x2fa243e067ccb762 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898f8 expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.834781:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3ea00/0x2fa243e067ccb762 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898f8 expref: 14 pid: 9580 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.834787:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.834796:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867126016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 39us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.834800:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6068 00000100:00100000:1.0:1746142902.834806:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6069 00000100:00100000:1.0:1746142902.834809:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867126272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.834813:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.834817:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 50 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.834824:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 50 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.834832:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094714e00/0x2fa243e067ccb5b7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8980a expref: 50 pid: 1853 timeout: 776 lvb_type: 0 00010000:00010000:1.0:1746142902.834838:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.834839:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.834844:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.834851:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.834871:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.834880:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867715968:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.834927:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.842014:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.842735:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867715968:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.842751:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.842790:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867126272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7978us (8260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.842800:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6069 00000100:00100000:0.0:1746142902.849377:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.849933:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.857340:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.857394:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867127168 00000100:00100000:1.0:1746142902.857401:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867127168 00002000:00100000:1.0:1746142902.857433:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800924f5500 x1830962867127168/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.857442:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f5500 with x1830962867127168 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.857446:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f5500 00000100:00100000:1.0:1746142902.857469:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4077 00000100:00100000:1.0:1746142902.857475:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867127168:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.864577:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867127168:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7093us (7235us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142902.864589:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4077 00002000:00100000:1.0:1746142902.864598:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800924f5500 x1830962867127168/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/440 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142902.864606:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f5500 with x1830962867127168 ext(4194304->5033983) 00002000:00010000:1.0:1746142902.864611:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f5500 00000100:00100000:0.0:1746142902.872071:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.872104:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.872190:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867127296 00000100:00100000:1.0:1746142902.872197:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867127296 00000100:00100000:1.0:1746142902.872229:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867127424 00000100:00100000:1.0:1746142902.872231:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867127424 00000100:00100000:1.0:1746142902.872245:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13610 00000100:00100000:1.0:1746142902.872251:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867127296:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.872265:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.872279:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2b600/0x2fa243e067ccb8ab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb899c3 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.872319:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867716224:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142902.872388:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.872407:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13611 00000100:00100000:1.0:1746142902.872412:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32094:x1830962867127424:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142902.872418:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.872424:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb899ca expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.872438:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.872450:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 52 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.872456:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.872458:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142902.872461:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [4026368->4194303] (req 4026368->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 52 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.872476:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 52 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.872486:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 52 pid: 1397 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.872493:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867716352:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142902.872530:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142902.872538:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 37 pid: 9580 timeout: 776 lvb_type: 0 00000100:00100000:1.0:1746142902.872545:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867716480:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142902.872558:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.874178:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867716224:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142902.874193:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a2b600/0x2fa243e067ccb8ab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899c3 expref: 51 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.874201:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2b600/0x2fa243e067ccb8ab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899c3 expref: 51 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142902.874220:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b600, rc 0) 00000100:00100000:1.0:1746142902.874246:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867127296:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1995us (2181us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142902.874251:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13610 00000100:00100000:0.0:1746142902.881488:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.882236:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867127552 00000100:00100000:1.0:1746142902.882243:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867127552 00010000:00010000:1.0:1746142902.882275:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 50 pid: 1397 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.882300:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6070 00000100:00100000:1.0:1746142902.882306:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867127552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.882321:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.882338:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 50 pid: 1397 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.882347:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 50 pid: 1397 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.882364:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009710d600/0x2fa243e067ccb88f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ae expref: 50 pid: 1397 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.882390:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.882427:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867127552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 120us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.882433:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6070 00000100:00100000:0.0:1746142902.882952:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867127808 00000100:00100000:0.0:1746142902.882955:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867127808 00010000:00010000:0.0:1746142902.882971:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00000100:00100000:0.0:1746142902.882995:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6071 00000100:00100000:0.0:1746142902.883002:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+38:2006:x1830962867127808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142902.883010:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142902.883017:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.883024:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.883038:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0c00/0x2fa243e067ccb85e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89992 expref: 38 pid: 9580 timeout: 776 lvb_type: 0 00010000:00010000:0.0:1746142902.883051:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.883052:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142902.883060:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.883067:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142902.883094:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142902.883105:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867716608:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142902.883225:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867127680 00000100:00100000:1.0:1746142902.883232:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867127680 00000100:00100000:1.0:1746142902.883253:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13612 00000100:00100000:1.0:1746142902.883258:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867127680:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142902.883270:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142902.883278:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067ccb8b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb899d1 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142902.883305:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867716736:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142902.883307:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86540 going to sleep for 11 seconds 00000100:00100000:1.0:1746142902.883325:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142902.884646:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.885311:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.885333:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867128192 00000100:00100000:0.0:1746142902.885336:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867128192 00002000:00100000:0.0:1746142902.885358:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (4026368->4030463) req@ffff8800924f7480 x1830962867128192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/0 e 0 to 0 dl 1746142913 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142902.885364:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7480 with x1830962867128192 ext(4026368->4030463) 00002000:00010000:0.0:1746142902.885368:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f7480 00000100:00100000:0.0:1746142902.885391:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4078 00000100:00100000:0.0:1746142902.885396:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+53:2004:x1830962867128192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142902.885535:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867716608:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142902.885545:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.885567:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+37:2006:x1830962867127808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2564us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.885574:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6071 00000100:00100000:0.0:1746142902.885859:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2004:x1830962867128192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 457us (543us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142902.885864:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4078 00002000:00100000:0.0:1746142902.885868:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (4026368->4030463) req@ffff8800924f7480 x1830962867128192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:53/0 lens 488/4536 e 0 to 0 dl 1746142913 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142902.885875:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7480 with x1830962867128192 ext(4026368->4030463) 00002000:00010000:0.0:1746142902.885878:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f7480 00000100:00100000:0.0:1746142902.898466:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.912277:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142902.912369:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867128448 00000100:00100000:1.0:1746142902.912376:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867128448 00010000:00010000:1.0:1746142902.912404:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a7 expref: 24 pid: 1397 timeout: 776 lvb_type: 1 00000100:00100000:1.0:1746142902.913342:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6072 00000100:00100000:1.0:1746142902.913352:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867128448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142902.913364:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142902.913383:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a7 expref: 24 pid: 1397 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.913456:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a7 expref: 24 pid: 1397 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.913474:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccb896 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a7 expref: 24 pid: 1397 timeout: 776 lvb_type: 1 00010000:00010000:1.0:1746142902.913503:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142902.913546:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867128448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 196us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142902.913553:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6072 00000100:00100000:0.0:1746142902.927033:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.933331:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142902.939725:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.022769:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.026131:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.026177:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.029155:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.035469:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.038241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.038281:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867130112 00000100:00100000:1.0:1746142903.038287:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867130112 00002000:00100000:1.0:1746142903.038329:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1925120->2056191) req@ffff8800924f5f80 x1830962867130112/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.038338:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f5f80 with x1830962867130112 ext(1925120->2056191) 00010000:00010000:1.0:1746142903.038344:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 37 pid: 9580 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.038355:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 37 pid: 9580 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.038360:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924f5f80 00000100:00100000:1.0:1746142903.038376:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1266 00000100:00100000:1.0:1746142903.038382:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+37:2006:x1830962867130112:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142903.043705:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+39:2006:x1830962867130112:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 5309us (5454us total) trans 17179873816 rc 0/0 00000100:00100000:1.0:1746142903.043716:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1266 00002000:00100000:1.0:1746142903.043726:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1925120->2056191) req@ffff8800924f5f80 x1830962867130112/t17179873816(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/448 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.043736:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f5f80 with x1830962867130112 ext(1925120->2056191) 00010000:00010000:1.0:1746142903.043745:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 39 pid: 9580 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.043758:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccb89d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1925120->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899b5 expref: 39 pid: 9580 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.043765:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924f5f80 00000100:00100000:0.0:1746142903.044914:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.044937:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.044967:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.045766:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.049841:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867130880 00000100:00100000:1.0:1746142903.049847:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867130880 00002000:00100000:1.0:1746142903.049874:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009734b100 x1830962867130880/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.049883:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734b100 with x1830962867130880 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.049887:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734b100 00000100:00100000:1.0:1746142903.049923:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4080 00000100:00100000:1.0:1746142903.049930:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867130880:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.057469:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.060877:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867130880:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10941us (11075us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142903.060886:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4080 00002000:00100000:1.0:1746142903.060895:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009734b100 x1830962867130880/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.060917:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734b100 with x1830962867130880 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.060921:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734b100 00000100:00100000:0.0:1746142903.072877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.072941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.073020:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867131264 00000100:00100000:1.0:1746142903.073028:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867131264 00000100:00100000:0.0:1746142903.073051:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:1.0:1746142903.073063:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dc63100 x1830962867131264/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.073073:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63100 with x1830962867131264 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.073077:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc63100 00000100:00100000:0.0:1746142903.073090:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.073096:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867131520 00000100:00100000:1.0:1746142903.073099:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867131520 00000100:00100000:0.0:1746142903.073102:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867132032 00000100:00100000:0.0:1746142903.073105:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867132032 00002000:00100000:1.0:1746142903.073109:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc60380 x1830962867131520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.073114:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60380 with x1830962867131520 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.073117:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc60380 00002000:00100000:0.0:1746142903.073117:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4026367) req@ffff88012dc61c00 x1830962867132032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.073123:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61c00 with x1830962867132032 ext(2097152->4026367) 00002000:00010000:0.0:1746142903.073125:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61c00 00000100:00100000:1.0:1746142903.073133:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4081 00000100:00100000:1.0:1746142903.073139:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867131264:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.073546:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4082 00000100:00100000:0.0:1746142903.073553:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867131520:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142903.073688:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4084 00000100:00100000:1.0:1746142903.073693:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2004:x1830962867131776:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142903.087558:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867131264:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14410us (14681us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142903.087569:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4081 00002000:00100000:1.0:1746142903.087579:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dc63100 x1830962867131264/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.087588:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63100 with x1830962867131264 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.087592:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc63100 00000100:00100000:1.0:1746142903.090106:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867132288 00000100:00100000:1.0:1746142903.090113:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867132288 00000100:00100000:1.0:1746142903.090161:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14307 00000100:00100000:1.0:1746142903.090168:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32111:x1830962867132288:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.090188:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.090203:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b600/0x2fa243e067ccb91b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a17 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.090258:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090268:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090277:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090287:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090292:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090296:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090369:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccb930 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090380:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccb930 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090386:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccb930 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142903.090393:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142903.090446:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090451:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090456:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090462:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090467:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2ae00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.090470:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090475:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090484:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142903.090486:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.090489:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090494:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067ccb922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090533:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090539:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090543:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090547:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2b800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.090550:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090554:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090560:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3000) 00010000:00010000:1.0:1746142903.090562:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.090564:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090569:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.090597:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b600/0x2fa243e067ccb91b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a17 expref: 55 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.090606:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccb930 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a17 expref: 54 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.090612:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.090615:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142903.090617:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a800, rc 0) 00000100:00100000:1.0:1746142903.090646:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32111:x1830962867132288:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 479us (886us total) trans 8589936445 rc 0/0 00000100:00100000:1.0:1746142903.090652:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14307 00000100:00100000:1.0:1746142903.101644:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2004:x1830962867131776:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27942us (28583us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142903.101656:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4084 00002000:00100000:1.0:1746142903.101666:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012dc61500 x1830962867131776/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.101674:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61500 with x1830962867131776 ext(2097152->4194303) 00002000:00010000:1.0:1746142903.101679:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc61500 00000100:00100000:0.0:1746142903.106795:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.111186:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.111238:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.111387:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867132544 00000100:00100000:0.0:1746142903.111395:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867132544 00000100:00100000:0.0:1746142903.111441:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13622 00000100:00100000:0.0:1746142903.111447:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962867132544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.111459:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.111474:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130600a00/0x2fa243e067ccb93e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a1e expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142903.111523:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867718144:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.111938:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.113424:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867718144:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.113437:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130600a00/0x2fa243e067ccb93e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a1e expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.113445:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130600a00/0x2fa243e067ccb93e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a1e expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.113461:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600a00, rc 0) 00000100:00100000:1.0:1746142903.113475:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962867132544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2029us (2237us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.113479:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13622 00000100:00100000:1.0:1746142903.117478:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867132800 00000100:00100000:1.0:1746142903.117487:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867132800 00000100:00100000:1.0:1746142903.117540:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13623 00000100:00100000:1.0:1746142903.117547:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+7:32107:x1830962867132800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.117562:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.117576:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a2c expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.117599:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.117605:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.117607:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.117610:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.117636:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.117646:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 22 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.117656:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867718400:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.117731:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.120180:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.120252:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.120279:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867133056 00000100:00100000:0.0:1746142903.120285:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867133056 00002000:00100000:0.0:1746142903.120320:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4759552->5033983) req@ffff88012dc62a00 x1830962867133056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.120330:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc62a00 with x1830962867133056 ext(4759552->5033983) 00010000:00010000:0.0:1746142903.120338:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 23 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.120349:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 23 pid: 1852 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746142903.120355:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc62a00 00000100:00100000:0.0:1746142903.120381:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867133184 00000100:00100000:0.0:1746142903.120384:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867133184 00002000:00100000:0.0:1746142903.120398:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4759551) req@ffff88012dc63480 x1830962867133184/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.120404:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63480 with x1830962867133184 ext(4194304->4759551) 00010000:00010000:0.0:1746142903.120408:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 24 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.120421:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 24 pid: 1852 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746142903.120426:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc63480 00000100:00100000:0.0:1746142903.120439:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1267 00000100:00100000:0.0:1746142903.120445:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962867133056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.120682:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1268 00000100:00100000:0.0:1746142903.120688:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867133184:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142903.121239:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867718400:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.121261:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.121278:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b800, rc 0) 00000100:00100000:1.0:1746142903.121304:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+8:32107:x1830962867132800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3756us (3987us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.121310:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13623 00000100:00100000:1.0:1746142903.130423:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867133056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9969us (10240us total) trans 0 rc 274432/274432 00000100:00100000:1.0:1746142903.130433:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1267 00002000:00100000:1.0:1746142903.130444:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4759552->5033983) req@ffff88012dc62a00 x1830962867133056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 274432/274432 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.130452:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc62a00 with x1830962867133056 ext(4759552->5033983) 00010000:00010000:1.0:1746142903.130461:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 27 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.130473:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccb8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4759551) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899df expref: 27 pid: 1852 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.130479:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc62a00 00000100:00100000:0.0:1746142903.134637:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.134749:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867133312 00000100:00100000:1.0:1746142903.134756:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867133312 00000100:00100000:1.0:1746142903.134804:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13624 00000100:00100000:1.0:1746142903.134811:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867133312:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.134825:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.134838:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2a200/0x2fa243e067ccb953 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a33 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.134884:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867718528:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.134981:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.143484:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867718528:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.143532:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2a200/0x2fa243e067ccb953 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a33 expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.143547:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a200/0x2fa243e067ccb953 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a33 expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.143584:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a200, rc 0) 00000100:00100000:1.0:1746142903.144265:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867133312:12345-192.168.204.50@tcp:101:cat.0 Request processed in 9452us (9634us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.144272:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13624 00000100:00100000:0.0:1746142903.150805:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.150945:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867133440 00000100:00100000:1.0:1746142903.150952:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867133440 00000100:00100000:1.0:1746142903.150990:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13625 00000100:00100000:1.0:1746142903.150996:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32104:x1830962867133440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.151009:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.151020:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a3a expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.151038:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.151040:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.151043:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a3a expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.151056:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a3a expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.151064:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2bc00, rc 0) 00000100:00100000:1.0:1746142903.151770:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32104:x1830962867133440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 772us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.151776:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13625 00000100:00100000:0.0:1746142903.155463:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.158556:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.162113:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.166712:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.183221:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.183235:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.183263:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.183319:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867134464 00000100:00100000:0.0:1746142903.183326:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867134464 00010000:00010000:0.0:1746142903.183347:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89803 expref: 8 pid: 11943 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.183365:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867134592 00000100:00100000:0.0:1746142903.183366:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867134592 00010000:00010000:0.0:1746142903.183374:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e0 expref: 27 pid: 1853 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.183386:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6076 00000100:00100000:0.0:1746142903.183391:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867134464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.183401:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.183414:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89803 expref: 8 pid: 11943 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.183423:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89803 expref: 8 pid: 11943 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.183653:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6078 00000100:00100000:1.0:1746142903.183660:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867134592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.183667:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.184212:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccb5b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89803 expref: 8 pid: 11943 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.184233:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142903.184254:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962867134464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 863us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.184259:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6076 00010000:00010000:1.0:1746142903.184775:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e0 expref: 26 pid: 1853 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.184784:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e0 expref: 26 pid: 1853 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.184794:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccb563 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897e0 expref: 26 pid: 1853 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.184806:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.184808:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.184813:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccb961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->585727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a41 expref: 25 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.184819:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccb961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->585727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a41 expref: 25 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.184843:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccb961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->585727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a41 expref: 25 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.184853:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867719296:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142903.184897:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.191141:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.191189:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.192392:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13628 00000100:00100000:0.0:1746142903.192400:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+7:32109:x1830962867134848:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142903.192408:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.192417:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a4f expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.192432:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.192441:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a3a expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.192446:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.192448:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.192450:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2461696->3145727] (req 2461696->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.192474:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a3a expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.192484:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a3a expref: 25 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.192495:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867719424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.192592:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.192601:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.192609:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867719552:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.193042:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86540 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.193664:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867719296:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142903.193676:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.193708:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867134592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10048us (10442us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.193716:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6078 00000100:00100000:0.0:1746142903.194726:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.194764:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142903.195470:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccb95a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a3a expref: 24 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.195836:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867719424:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.196127:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867719552:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.196143:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2461696->3145727] (req 2461696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.196150:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601200, rc 0) 00000100:00100000:1.0:1746142903.196165:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:32109:x1830962867134848:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3767us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.196170:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13628 00000100:00100000:0.0:1746142903.196712:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.204189:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.204753:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6080 00000100:00100000:0.0:1746142903.204761:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867135488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.204772:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.204787:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.204802:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.205000:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccb94c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a2c expref: 8 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.205024:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.205026:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.205032:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 7 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.205038:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 7 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.205364:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 7 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.205376:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867719808:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142903.205584:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.206870:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.207275:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867719808:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142903.207284:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142903.207287:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.207309:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867135488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2550us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.207342:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6080 00000100:00100000:0.0:1746142903.213955:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.213992:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867136128 00000100:00100000:1.0:1746142903.213999:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867136128 00010000:00010000:1.0:1746142903.214029:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 28 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.214066:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6081 00000100:00100000:1.0:1746142903.214073:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867136128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.214084:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142903.214101:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 28 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.214111:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 28 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.214129:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccb8b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899ca expref: 28 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.214155:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.214157:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.214163:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 7 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.214169:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 7 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.214195:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 7 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.214205:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867719936:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142903.214279:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.218027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.221356:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867719936:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142903.221372:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.221408:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867136128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7336us (7461us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.221416:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6081 00000100:00100000:0.0:1746142903.227430:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.227478:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.227680:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4090 00000100:00100000:1.0:1746142903.227689:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867136768:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142903.234804:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867136768:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7108us (7373us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142903.234815:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4090 00002000:00100000:1.0:1746142903.234825:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880098191880 x1830962867136768/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.234834:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191880 with x1830962867136768 ext(3145728->4194303) 00002000:00010000:1.0:1746142903.234839:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191880 00000100:00100000:0.0:1746142903.246710:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.248032:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867137024 00000100:00100000:1.0:1746142903.248042:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867137024 00000100:00100000:1.0:1746142903.248094:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13629 00000100:00100000:1.0:1746142903.248101:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:32109:x1830962867137024:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.248117:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.248132:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccb976 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a56 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.248156:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.248162:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.248164:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.248167:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccb976 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2158591] (req 2097152->2158591) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a56 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.248192:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.248203:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.248213:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867720064:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.248290:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.248457:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.249534:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867720064:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.249553:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccb976 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2158591] (req 2097152->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a56 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.249565:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0600, rc 0) 00000100:00100000:1.0:1746142903.249591:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32109:x1830962867137024:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1490us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.249597:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13629 00000100:00100000:0.0:1746142903.253591:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.253644:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.253862:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867137280 00000100:00100000:1.0:1746142903.253871:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867137280 00010000:00010000:1.0:1746142903.253933:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.253970:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6082 00000100:00100000:1.0:1746142903.253978:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867137280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.253991:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142903.254010:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.254024:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.254044:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471fe00/0x2fa243e067ccb968 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a48 expref: 9 pid: 9580 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.254063:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.254065:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.254071:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccb976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a56 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.254078:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccb976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a56 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.254108:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccb976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2158591) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a56 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.254119:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867720320:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142903.254185:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.262224:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.262373:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867720320:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142903.262388:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.262403:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867137280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8428us (8822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.262409:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6082 00000100:00100000:0.0:1746142903.265495:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.268261:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.268987:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867138048 00000100:00100000:1.0:1746142903.268996:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867138048 00000100:00100000:1.0:1746142903.269046:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14308 00000100:00100000:1.0:1746142903.269053:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:32114:x1830962867138048:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142903.269072:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.269087:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1c00/0x2fa243e067ccb98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a6b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.269148:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269162:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269171:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269181:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269186:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269191:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269244:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269253:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 27 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.269259:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.269286:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 27 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.269295:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 27 pid: 10924 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.269306:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867720576:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.270218:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.271582:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.271619:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.271753:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867720576:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.271771:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142903.273733:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.273947:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867138560 00000100:00100000:1.0:1746142903.273953:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867138560 00010000:00010000:1.0:1746142903.273977:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 29 pid: 10924 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.274006:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6083 00000100:00100000:1.0:1746142903.274013:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867138560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.274023:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142903.274028:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 29 pid: 10924 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.274036:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 29 pid: 10924 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.274052:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccb826 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89976 expref: 29 pid: 10924 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.274071:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.274075:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274083:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274089:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274113:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142903.274124:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274130:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142903.274164:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142903.274167:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142903.274178:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274186:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274193:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274198:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274203:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274211:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274216:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ed1200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.274219:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274224:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274230:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142903.274232:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.274236:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274239:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1200/0x2fa243e067ccb992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274248:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274252:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274256:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274259:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ed1400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.274261:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274266:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274275:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3200) 00010000:00010000:1.0:1746142903.274276:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.274278:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274282:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1400/0x2fa243e067ccb999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.274306:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1c00/0x2fa243e067ccb98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a6b expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.274315:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccb9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a6b expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.274320:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.274321:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142903.274323:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1600, rc 0) 00000100:00100000:1.0:1746142903.274343:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:32114:x1830962867138048:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5292us (6088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.274349:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14308 00000100:00100000:1.0:1746142903.274370:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867138560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 358us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.274375:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6083 00000100:00100000:0.0:1746142903.277878:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.278639:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.278662:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.278687:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.278709:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.278771:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867138944 00000100:00100000:1.0:1746142903.278775:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867138944 00000100:00100000:1.0:1746142903.278832:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867139200 00000100:00100000:1.0:1746142903.278834:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867139200 00000100:00100000:0.0:1746142903.278946:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867138816 00000100:00100000:0.0:1746142903.278950:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867138816 00000100:00100000:1.0:1746142903.279246:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13633 00000100:00100000:0.0:1746142903.279284:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13635 00000100:00100000:0.0:1746142903.279289:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867138688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142903.279296:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.279309:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974d2000/0x2fa243e067ccb9ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a79 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142903.279349:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867720832:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.279712:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867138944:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142903.279722:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.279730:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb9ca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89a87 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.279741:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.279742:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.279748:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb9ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a87 expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.279757:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb9ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a87 expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.279764:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1000, rc 0) 00000100:00100000:1.0:1746142903.279780:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867138944:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 528us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.279786:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13633 00000100:00100000:0.0:1746142903.279850:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.281957:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867720832:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.281971:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d2000/0x2fa243e067ccb9ae lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a79 expref: 10 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.281979:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d2000/0x2fa243e067ccb9ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a79 expref: 10 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.281997:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2000, rc 0) 00000100:00100000:1.0:1746142903.282015:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867138688:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2726us (4145us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.282019:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13635 00000100:00100000:1.0:1746142903.286163:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.288970:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.293478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.299681:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.300495:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867139840 00000100:00100000:1.0:1746142903.300521:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867139840 00010000:00010000:1.0:1746142903.300555:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccb9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a9c expref: 16 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.300598:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6085 00000100:00100000:1.0:1746142903.300606:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867139840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.300624:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142903.300629:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccb9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a9c expref: 16 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.300639:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccb9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a9c expref: 16 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.300664:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccb9d8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a9c expref: 16 pid: 7231 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.300690:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.300695:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccb9ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.300702:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccb9ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.300714:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccb9ed lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142903.300731:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.301564:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867139840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 958us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.301573:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6085 00000100:00100000:0.0:1746142903.304836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.304871:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.304926:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.305018:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867140096 00000100:00100000:1.0:1746142903.305026:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867140096 00000100:00100000:1.0:1746142903.305056:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867139968 00000100:00100000:1.0:1746142903.305057:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867139968 00000100:00100000:1.0:1746142903.305066:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867140224 00000100:00100000:1.0:1746142903.305068:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867140224 00000100:00100000:1.0:1746142903.305081:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13638 00000100:00100000:1.0:1746142903.305087:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867140096:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142903.305102:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.305116:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed1c00/0x2fa243e067ccb9f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ab1 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.305159:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867721472:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.305219:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.305239:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13639 00000100:00100000:1.0:1746142903.305244:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867139968:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142903.305250:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.305257:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccb9fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89aaa expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.305277:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867721600:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.305296:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.308755:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867721472:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.308783:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed1c00/0x2fa243e067ccb9f4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ab1 expref: 10 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.308796:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed1c00/0x2fa243e067ccb9f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ab1 expref: 10 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.308819:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1c00, rc 0) 00000100:00100000:1.0:1746142903.309136:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867140096:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4048us (4305us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.309142:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13638 00000100:00100000:1.0:1746142903.309175:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867721600:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.309187:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccb9fb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89aaa expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.309195:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccb9fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89aaa expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.309201:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0800, rc 0) 00000100:00100000:1.0:1746142903.309234:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867139968:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3989us (4361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.309239:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13639 00000100:00100000:0.0:1746142903.312489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.318434:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867140736 00000100:00100000:0.0:1746142903.318434:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867140608 00000100:00100000:1.0:1746142903.318441:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867140736 00000100:00100000:0.0:1746142903.318441:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867140608 00000100:00100000:0.0:1746142903.318468:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867140992 00000100:00100000:0.0:1746142903.318470:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867140992 00000100:00100000:1.0:1746142903.318546:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867140864 00000100:00100000:1.0:1746142903.318550:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867140864 00000100:00100000:0.0:1746142903.318554:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13641 00000100:00100000:0.0:1746142903.318562:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867140608:12345-192.168.204.50@tcp:1:lfs.0 00000100:00100000:1.0:1746142903.318567:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13642 00000100:00100000:1.0:1746142903.318572:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867140736:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142903.318596:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318596:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3400/0x2fa243e067ccba1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.318610:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccb8f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899f4 expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318610:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccb961 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->585727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a41 expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318617:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.318618:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb9c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a80 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.318618:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142903.318621:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3400/0x2fa243e067ccba1e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.318624:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130a00/0x2fa243e067ccb914 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a10 expref: 7 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.318630:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.318631:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.318633:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318649:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccb961 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->585727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a41 expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.318650:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096130a00/0x2fa243e067ccb914 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a10 expref: 7 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318657:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccb961 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->585727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a41 expref: 23 pid: 9580 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.318658:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096130a00/0x2fa243e067ccb914 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a10 expref: 7 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.318666:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867721856:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.318667:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867721984:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142903.318724:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.318742:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13644 00000100:00100000:0.0:1746142903.318748:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867140864:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142903.318763:0:1852:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318773:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 26 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318779:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb9ca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a87 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.318786:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.318790:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.318791:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.318793:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318805:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.318811:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746142903.318817:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867722240:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.318843:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb9c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a80 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.318844:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb9ca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a87 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.318850:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06a00/0x2fa243e067ccb9c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a80 expref: 12 pid: 11421 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.318857:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccb9ca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a87 expref: 12 pid: 11943 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746142903.318863:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867722368:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142903.318869:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867722496:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.318884:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccb8f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899f4 expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.318892:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccb8f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899f4 expref: 26 pid: 1852 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.318895:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 26 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.318917:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 26 pid: 9580 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.318923:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867722624:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142903.318925:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867722752:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.318941:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.318944:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.318967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.319019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.322029:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.337219:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867722240:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.337696:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867721984:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.337705:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867722368:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.337712:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867722624:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.337733:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.337752:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867722496:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.337769:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867141760 00000100:00100000:1.0:1746142903.337772:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867141760 00000100:00100000:0.0:1746142903.340271:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867142272 00000100:00100000:0.0:1746142903.340278:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867142272 00010000:00010000:0.0:1746142903.340297:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b9 expref: 26 pid: 1852 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746142903.345471:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6090 00000100:00100000:0.0:1746142903.345482:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867142272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.345497:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.345529:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b9 expref: 26 pid: 1852 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.345541:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b9 expref: 26 pid: 1852 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.345560:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098444400/0x2fa243e067ccb6f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb898b9 expref: 26 pid: 1852 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.345575:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142903.345611:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867142272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 133us (6691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.345616:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6090 00010000:00010000:1.0:1746142903.346468:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746142903.346498:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867142784 00000100:00100000:1.0:1746142903.346510:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867142784 00002000:00100000:1.0:1746142903.346529:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2461696->3145727) req@ffff880097349f80 x1830962867142784/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.346537:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349f80 with x1830962867142784 ext(2461696->3145727) 00010000:00010000:1.0:1746142903.346542:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 7 pid: 9578 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.346550:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 7 pid: 9578 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.346555:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097349f80 00000100:00100000:1.0:1746142903.346565:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1271 00000100:00100000:1.0:1746142903.346568:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962867142784:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:1.0:1746142903.346668:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccb857 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8998b expref: 26 pid: 9580 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.346679:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867722752:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.346695:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.346714:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6091 00000100:00100000:1.0:1746142903.346718:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962867141760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.346726:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142903.346736:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746142903.346742:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746142903.346754:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009710cc00/0x2fa243e067ccb888 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb899a0 expref: 7 pid: 1397 timeout: 777 lvb_type: 1 00010000:00010000:1.0:1746142903.346761:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.346762:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.346765:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346771:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346783:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.346795:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+6:2006:x1830962867141760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (9184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.346799:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6091 00010000:00010000:1.0:1746142903.346812:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346817:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346832:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346838:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346843:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346848:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d3e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142903.346851:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346856:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346863:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.346867:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccba33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.346891:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867140864:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 28144us (28480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.346896:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13644 00010000:00010000:0.0:1746142903.348850:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348857:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348867:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348873:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348878:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348882:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b2a1800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142903.348884:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348893:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348920:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.348925:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccba25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142903.348954:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867140736:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 30382us (31435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.348959:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13642 00000100:00100000:0.0:1746142903.361928:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.364088:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867142784:12345-192.168.204.50@tcp:4:cat.0 Request processed in 17513us (25208us total) trans 21474841081 rc 0/0 00000100:00100000:1.0:1746142903.364097:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1271 00002000:00100000:1.0:1746142903.364106:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2461696->3145727) req@ffff880097349f80 x1830962867142784/t21474841081(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/448 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.364115:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349f80 with x1830962867142784 ext(2461696->3145727) 00010000:00010000:1.0:1746142903.364122:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 8 pid: 9578 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.364132:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccb96f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2461696->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89a4f expref: 8 pid: 9578 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.364138:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097349f80 00000100:00100000:0.0:1746142903.369715:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.369784:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.373103:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.380567:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.381860:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.389245:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867144320 00000100:00100000:0.0:1746142903.389251:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867144320 00000100:00100000:0.0:1746142903.389422:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5189 00000100:00100000:0.0:1746142903.389430:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:32114:x1830962867144320:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1746142903.390703:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:32114:x1830962867144320:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 1270us (1522us total) trans 8589936452 rc 0/0 00000100:00100000:0.0:1746142903.390711:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5189 00000100:00100000:0.0:1746142903.393140:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.393315:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867144576 00000100:00100000:1.0:1746142903.393322:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867144576 00000100:00100000:1.0:1746142903.393354:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14314 00000100:00100000:1.0:1746142903.393361:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:32120:x1830962867144576:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.393377:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.393392:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed0600/0x2fa243e067ccba6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89acd expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.393466:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccba72 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.393477:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccba72 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.393486:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccba72 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142903.393507:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142903.394714:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed0600/0x2fa243e067ccba6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89acd expref: 31 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.394849:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1600/0x2fa243e067ccba72 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89acd expref: 30 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.394858:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.394860:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746142903.394863:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1600, rc 0) 00000100:00100000:1.0:1746142903.395252:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:32120:x1830962867144576:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1890us (2115us total) trans 8589936453 rc 0/0 00000100:00100000:1.0:1746142903.395260:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14314 00000100:00100000:0.0:1746142903.397125:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.397151:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.397178:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.397190:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.397792:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13648 00000100:00100000:1.0:1746142903.397799:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867144832:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.397807:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.397820:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89adb expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142903.397838:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406b7, atime: 0x681406b6, ctime: 0x681406b7, blocks: 0x808 00010000:00010000:1.0:1746142903.397852:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.397855:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.397861:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.397872:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.397881:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0a00, rc 0) 00000100:00100000:1.0:1746142903.397925:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867144832:12345-192.168.204.50@tcp:101:cat.0 Request processed in 127us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.397930:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13648 00000100:00100000:1.0:1746142903.397941:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13649 00000100:00100000:1.0:1746142903.397945:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867144960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.397950:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.397956:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ae2 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142903.397963:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406b7, atime: 0x681406b6, ctime: 0x681406b7, blocks: 0x800 00010000:00010000:1.0:1746142903.397969:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.397970:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.397973:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae2 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.397980:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae2 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.397985:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0c00, rc 0) 00000100:00100000:1.0:1746142903.397998:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867144960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 53us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.398002:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13649 00000100:00100000:1.0:1746142903.398009:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13650 00000100:00100000:1.0:1746142903.398013:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867145088:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.398017:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.398022:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ae9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142903.398031:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406b6, atime: 0x681406b6, ctime: 0x681406b6, blocks: 0x808 00010000:00010000:1.0:1746142903.398036:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.398037:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.398040:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.398047:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.398053:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0800, rc 0) 00000100:00100000:1.0:1746142903.398065:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867145088:12345-192.168.204.50@tcp:101:cat.0 Request processed in 52us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.398069:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13650 00000100:00100000:0.0:1746142903.398146:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.398190:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.398255:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13652 00000100:00100000:0.0:1746142903.398261:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867145344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.398268:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.398275:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89af7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142903.398285:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406b7, atime: 0x681406b7, ctime: 0x681406b7, blocks: 0x1008 00010000:00010000:0.0:1746142903.398292:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.398294:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.398298:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.398306:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.398312:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:0.0:1746142903.398331:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867145344:12345-192.168.204.50@tcp:101:cat.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.398336:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13652 00000100:00100000:0.0:1746142903.406869:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.406930:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.406945:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.406965:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.408494:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867145600 00000100:00100000:1.0:1746142903.408513:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867145600 00002000:00100000:1.0:1746142903.408554:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012d4c2300 x1830962867145600/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.408563:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2300 with x1830962867145600 ext(0->1048575) 00002000:00010000:1.0:1746142903.408568:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c2300 00000100:00100000:1.0:1746142903.408858:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867145856 00000100:00100000:1.0:1746142903.408861:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867145856 00002000:00100000:1.0:1746142903.408874:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012d4c3800 x1830962867145856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.408886:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c3800 with x1830962867145856 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.408888:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c3800 00000100:00100000:0.0:1746142903.410072:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4096 00000100:00100000:0.0:1746142903.410079:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867146112:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.420474:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.420708:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867146624 00000100:00100000:1.0:1746142903.420716:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867146624 00000100:00100000:1.0:1746142903.420771:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14315 00000100:00100000:1.0:1746142903.420779:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:32127:x1830962867146624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.420798:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.420813:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067ccbaaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89afe expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.420871:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.420882:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.420891:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.420929:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.420935:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.420941:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421013:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccbabf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421025:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccbabf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421031:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccbabf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142903.421038:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142903.421089:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421094:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421099:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421105:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421109:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b2a1e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.421113:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421118:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421127:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142903.421130:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.421133:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421137:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421154:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421158:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421162:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421166:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096131400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.421168:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421172:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421177:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3300) 00010000:00010000:1.0:1746142903.421180:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.421182:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421185:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccbab8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.421213:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067ccbaaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89afe expref: 58 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.421222:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccbabf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89afe expref: 57 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.421228:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.421230:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142903.421232:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130a00, rc 0) 00000100:00100000:1.0:1746142903.421262:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:32127:x1830962867146624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 484us (796us total) trans 8589936454 rc 0/0 00000100:00100000:1.0:1746142903.421268:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14315 00000100:00100000:0.0:1746142903.438076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.439364:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867146752 00000100:00100000:1.0:1746142903.439374:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867146752 00000100:00100000:1.0:1746142903.439435:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13653 00000100:00100000:1.0:1746142903.439442:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:32120:x1830962867146752:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.439458:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.439473:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b05 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.439531:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.439539:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.439541:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.439544:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 13 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.439569:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.439579:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 13 pid: 1854 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746142903.439590:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867723648:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.440291:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.442629:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867723648:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.442657:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.442671:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131c00, rc 0) 00000100:00100000:1.0:1746142903.442886:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+11:32120:x1830962867146752:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3423us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.442892:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13653 00000100:00100000:1.0:1746142903.443896:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.443960:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147136 00000100:00100000:0.0:1746142903.443967:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147136 00000100:00100000:0.0:1746142903.444009:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5190 00000100:00100000:0.0:1746142903.444015:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:32127:x1830962867147136:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142903.444040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.444224:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32127:x1830962867147136:12345-192.168.204.50@tcp:35:cat.0 Request processed in 206us (327us total) trans 8589936455 rc 0/0 00000100:00100000:0.0:1746142903.444231:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5190 00000100:00100000:0.0:1746142903.444322:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867146880 00000100:00100000:0.0:1746142903.444327:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867146880 00000100:00100000:0.0:1746142903.444360:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 752 00000100:00100000:0.0:1746142903.444367:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2005:x1830962867146880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.444378:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.444402:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccbabf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89afe expref: 58 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.444415:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142903.444419:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142903.444447:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2005:x1830962867146880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.444455:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 752 00000100:00100000:0.0:1746142903.446020:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.446115:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147264 00000100:00100000:1.0:1746142903.446120:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147264 00000100:00100000:1.0:1746142903.446827:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13654 00000100:00100000:1.0:1746142903.446835:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+11:32123:x1830962867147264:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.446848:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.446861:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbad4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b0c expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.446880:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.446885:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.446890:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.446894:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbad4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b0c expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.447022:0:1852:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1761280->2097151] (req 1761280->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.447035:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccbad4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b0c expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.447044:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1e00, rc 0) 00000100:00100000:1.0:1746142903.447077:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:32123:x1830962867147264:12345-192.168.204.50@tcp:101:cat.0 Request processed in 242us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.447082:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13654 00000100:00100000:0.0:1746142903.449049:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.449082:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.449102:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.449123:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147392 00000100:00100000:1.0:1746142903.449129:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147392 00000100:00100000:1.0:1746142903.449149:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147648 00000100:00100000:1.0:1746142903.449150:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147648 00000100:00100000:1.0:1746142903.449156:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147904 00000100:00100000:1.0:1746142903.449157:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147904 00000100:00100000:1.0:1746142903.449171:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13655 00000100:00100000:1.0:1746142903.449176:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867147392:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.449184:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.449193:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccbadb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b13 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.449206:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.449208:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.449213:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccbadb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b13 expref: 26 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.449225:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccbadb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b13 expref: 26 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.449230:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131400, rc 0) 00000100:00100000:0.0:1746142903.449313:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13657 00000100:00100000:1.0:1746142903.449314:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867147392:12345-192.168.204.50@tcp:101:cat.0 Request processed in 138us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.449317:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13655 00000100:00100000:0.0:1746142903.449320:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867147904:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.449327:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.449334:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbae9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b2f expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.449342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142903.449343:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.449344:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.449348:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbae9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b2f expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.449357:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbae9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b2f expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.449363:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b600, rc 0) 00000100:00100000:0.0:1746142903.449380:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867147904:12345-192.168.204.50@tcp:101:cat.0 Request processed in 61us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.449384:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13657 00000100:00100000:1.0:1746142903.449387:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.449396:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147520 00000100:00100000:0.0:1746142903.449398:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147520 00000100:00100000:0.0:1746142903.449412:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867147776 00000100:00100000:0.0:1746142903.449414:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867147776 00000100:00100000:1.0:1746142903.449416:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.449425:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867148032 00000100:00100000:0.0:1746142903.449426:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867148032 00000100:00100000:1.0:1746142903.449427:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13658 00000100:00100000:1.0:1746142903.449431:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867147520:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142903.449435:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13659 00010000:00010000:1.0:1746142903.449436:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142903.449439:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867147776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.449441:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b1a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.449444:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.449449:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.449450:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.449450:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b000/0x2fa243e067ccbaf7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b28 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.449452:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b1a expref: 29 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.449458:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b1a expref: 29 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.449458:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.449462:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800987ffc00, rc 0) 00010000:00010000:0.0:1746142903.449465:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b000/0x2fa243e067ccbaf7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b28 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.449471:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b000/0x2fa243e067ccbaf7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b28 expref: 27 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142903.449474:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867147520:12345-192.168.204.50@tcp:101:cat.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.449477:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13658 00010000:00010000:0.0:1746142903.449480:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b000, rc 0) 00000100:00100000:1.0:1746142903.449485:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13660 00000100:00100000:1.0:1746142903.449487:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867148032:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.449490:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.449494:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800987ff400/0x2fa243e067ccbafe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b36 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142903.449496:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867147776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 56us (108us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142903.449514:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13659 00010000:00010000:1.0:1746142903.449516:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.449517:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.449520:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800987ff400/0x2fa243e067ccbafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b36 expref: 29 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.449526:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800987ff400/0x2fa243e067ccbafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b36 expref: 29 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.449530:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800987ff400, rc 0) 00000100:00100000:1.0:1746142903.449539:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867148032:12345-192.168.204.50@tcp:101:cat.0 Request processed in 52us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.449543:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13660 00000100:00100000:0.0:1746142903.451969:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867148160 00000100:00100000:0.0:1746142903.451976:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867148160 00010000:00010000:0.0:1746142903.451998:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 12 pid: 1854 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746142903.452019:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6099 00000100:00100000:0.0:1746142903.452025:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867148160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.452034:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.452050:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 12 pid: 1854 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.452060:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 12 pid: 1854 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.452075:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccba95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae9 expref: 12 pid: 1854 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.452086:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.452087:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.452092:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.452100:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.452126:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.452136:0:13297:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbacd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1761280->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b05 expref: 11 pid: 1852 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.452146:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867723904:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142903.452225:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.462230:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.465973:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.466008:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.466046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.466303:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4099 00000100:00100000:1.0:1746142903.466312:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867149056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.473188:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.474611:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.489077:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.489156:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.489851:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867149056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23541us (23842us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142903.489860:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4099 00002000:00100000:1.0:1746142903.489864:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012d4c3100 x1830962867149056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.489870:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c3100 with x1830962867149056 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.489873:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c3100 00000100:00100000:0.0:1746142903.495644:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.495813:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867150080 00000100:00100000:1.0:1746142903.495820:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867150080 00002000:00100000:1.0:1746142903.495855:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2236416->2240511) req@ffff88012d4c0e00 x1830962867150080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.495864:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0e00 with x1830962867150080 ext(2236416->2240511) 00002000:00010000:1.0:1746142903.495868:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c0e00 00000100:00100000:1.0:1746142903.495896:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4101 00000100:00100000:1.0:1746142903.496061:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867150080:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142903.496184:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867150080:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 125us (546us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142903.496190:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4101 00002000:00100000:1.0:1746142903.496196:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2236416->2240511) req@ffff88012d4c0e00 x1830962867150080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.496202:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0e00 with x1830962867150080 ext(2236416->2240511) 00002000:00010000:1.0:1746142903.496204:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c0e00 00000100:00100000:0.0:1746142903.500396:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.507882:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.508640:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.508698:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867150592 00000100:00100000:0.0:1746142903.508701:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867150592 00002000:00100000:0.0:1746142903.508722:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e51b100 x1830962867150592/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.508729:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e51b100 with x1830962867150592 ext(1048576->2097151) 00002000:00010000:0.0:1746142903.508733:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e51b100 00000100:00100000:0.0:1746142903.508743:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4102 00000100:00100000:0.0:1746142903.508747:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867150592:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142903.524310:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.539478:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.539546:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.539597:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13664 00000100:00100000:0.0:1746142903.539602:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32127:x1830962867151104:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.539689:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.539695:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbb1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b52 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.539705:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0200/0x2fa243e067ccbb05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b3d expref: 11 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.539711:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142903.539713:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142903.539716:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccbb1a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b52 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.539738:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0200/0x2fa243e067ccbb05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b3d expref: 11 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.539751:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0200/0x2fa243e067ccbb05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2240511) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b3d expref: 11 pid: 9578 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.539758:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867724544:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142903.539854:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.542755:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.542791:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.543818:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.546038:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.547292:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.547331:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.592175:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.592228:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.600003:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.600051:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.600297:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1277 00000100:00100000:0.0:1746142903.600304:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867152896:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.621637:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.623740:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.625891:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.643095:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.646043:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.646057:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867154560 00000100:00100000:0.0:1746142903.646065:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867154560 00000100:00100000:1.0:1746142903.646100:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13668 00000100:00100000:1.0:1746142903.646107:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867154560:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.646118:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.646131:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccbb36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b6e expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.646152:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccbb36 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b6e expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.646161:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccbb36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b6e expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.646181:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:1.0:1746142903.646210:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867154560:12345-192.168.204.50@tcp:101:cat.0 Request processed in 104us (172us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.646215:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13668 00000100:00100000:0.0:1746142903.667720:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.667762:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.669435:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.670022:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867154816 00000100:00100000:1.0:1746142903.670026:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867154816 00000100:00100000:1.0:1746142903.670060:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13669 00000100:00100000:1.0:1746142903.670067:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867154816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.670082:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.670096:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccbb3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b7c expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.670122:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccbb3d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b7c expref: 15 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.670136:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067ccbb3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b7c expref: 15 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.670147:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:1.0:1746142903.670185:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867154816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 119us (2473us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.670191:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13669 00000100:00100000:1.0:1746142903.670204:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13670 00000100:00100000:1.0:1746142903.670208:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867154688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.670214:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.670219:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccbb44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b75 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.670248:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867725568:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.670290:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746142903.676820:0:11421:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142902 -> 1746142904 00000100:00100000:1.0:1746142903.676846:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867725568:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.676878:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccbb44 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b75 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.676890:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccbb44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b75 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.676929:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74600, rc 0) 00000100:00100000:1.0:1746142903.676969:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867154688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6759us (9205us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.676977:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13670 00000100:00100000:0.0:1746142903.682825:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.685377:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.685488:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867155456 00000100:00100000:1.0:1746142903.685502:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867155456 00000100:00100000:1.0:1746142903.685548:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13671 00000100:00100000:1.0:1746142903.685554:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867155456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.685568:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.685582:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067ccbb4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b83 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.685606:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067ccbb4b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b83 expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.685615:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75000/0x2fa243e067ccbb4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b83 expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.685639:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75000, rc 0) 00000100:00100000:1.0:1746142903.685680:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867155456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 126us (310us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.685685:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13671 00000100:00100000:0.0:1746142903.696009:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867155584 00000100:00100000:0.0:1746142903.696017:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867155584 00000100:00100000:0.0:1746142903.696059:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13672 00000100:00100000:0.0:1746142903.696066:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867155584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.696079:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.696100:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccbb52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b8a expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.696123:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccbb52 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b8a expref: 29 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.696132:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8600/0x2fa243e067ccbb52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b8a expref: 29 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.696145:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8600, rc 0) 00000100:00100000:0.0:1746142903.696174:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867155584:12345-192.168.204.50@tcp:101:cat.0 Request processed in 109us (378us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142903.696179:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13672 00000100:00100000:1.0:1746142903.699364:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867155712 00000100:00100000:1.0:1746142903.699372:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867155712 00000100:00100000:1.0:1746142903.699400:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867155840 00000100:00100000:1.0:1746142903.699402:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867155840 00000100:00100000:1.0:1746142903.699427:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13673 00000100:00100000:1.0:1746142903.699474:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867155712:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.699492:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.699515:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccbb59 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89b91 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.699558:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867725696:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.699619:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.702448:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867725696:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.702479:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccbb59 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b91 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.702490:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccbb59 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b91 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.702523:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75600, rc 0) 00000100:00100000:1.0:1746142903.702569:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867155712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3134us (3255us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.702575:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13673 00000100:00100000:0.0:1746142903.704254:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.704292:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.704469:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13676 00000100:00100000:1.0:1746142903.704475:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867156096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.704505:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.704511:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75a00/0x2fa243e067ccbb6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ba6 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.704530:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75a00/0x2fa243e067ccbb6e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ba6 expref: 16 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.704541:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75a00/0x2fa243e067ccbb6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ba6 expref: 16 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.704548:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75a00, rc 0) 00000100:00100000:1.0:1746142903.704575:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867156096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 100us (283us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.704580:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13676 00000100:00100000:0.0:1746142903.712745:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.720789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.723550:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142903.724611:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724617:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142903.724656:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142903.724659:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142903.724674:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724681:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724690:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724696:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724700:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724706:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724711:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc07a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142903.724713:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724718:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724725:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142903.724728:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142903.724730:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724733:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccbb7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724744:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724749:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724753:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724756:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc06200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142903.724758:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724762:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724767:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736e00) 00010000:00010000:0.0:1746142903.724768:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142903.724770:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724774:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc06200/0x2fa243e067ccbb83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.724799:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0200/0x2fa243e067ccbb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bad expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.724810:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bad expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.724816:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142903.724818:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142903.724820:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07000, rc 0) 00000100:00100000:0.0:1746142903.724844:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:32132:x1830962867156224:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 11516us (12106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.724850:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14316 00000100:00100000:0.0:1746142903.728017:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.728057:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.728086:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.728388:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.728458:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867157120 00000100:00100000:0.0:1746142903.728461:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867157120 00000100:00100000:1.0:1746142903.728488:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867157376 00000100:00100000:1.0:1746142903.728491:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867157376 00000100:00100000:0.0:1746142903.728568:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13677 00000100:00100000:0.0:1746142903.728576:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867157120:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1746142903.728604:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13678 00000100:00100000:1.0:1746142903.728609:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867156864:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142903.728809:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.728817:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccbb98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89bc9 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142903.728851:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867726080:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142903.728891:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f86180 going to sleep for 11 seconds 00010000:00010000:1.0:1746142903.728932:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.728940:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89bbb expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.728949:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.728950:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.728954:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.728962:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.728969:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74800, rc 0) 00000100:00100000:1.0:1746142903.729092:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867156864:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 482us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.729098:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13678 00000100:00100000:0.0:1746142903.729132:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.729295:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.732466:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867157632 00000100:00100000:0.0:1746142903.732474:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867157632 00000100:00100000:0.0:1746142903.732523:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14317 00000100:00100000:0.0:1746142903.732672:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:32134:x1830962867157632:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142903.732695:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.732711:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d8a00/0x2fa243e067ccbbbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89bde expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.732793:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.732805:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bad expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.732811:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.732839:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bad expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.732848:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07000/0x2fa243e067ccbb8a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bad expref: 16 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:0.0:1746142903.732857:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867726208:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142903.733473:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.733809:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867726080:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142903.733831:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccbb98 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bc9 expref: 8 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.733841:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d8800/0x2fa243e067ccbb98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bc9 expref: 8 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.733863:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8800, rc 0) 00000100:00100000:0.0:1746142903.733914:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867157120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5323us (5840us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142903.733920:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13677 00000100:00100000:0.0:1746142903.735379:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867726208:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142903.735393:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.735952:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142903.735958:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142903.735970:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142903.736052:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d8a00/0x2fa243e067ccbbbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bde expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.736061:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bde expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.736067:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142903.736069:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142903.736071:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d9000, rc 0) 00000100:00100000:0.0:1746142903.736097:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+32:32134:x1830962867157632:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3568us (3826us total) trans 8589936458 rc 0/0 00000100:00100000:0.0:1746142903.736102:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14317 00000100:00100000:0.0:1746142903.737585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.739385:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.739431:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867158144 00000100:00100000:1.0:1746142903.739436:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867158144 00000100:00100000:1.0:1746142903.739473:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14319 00000100:00100000:1.0:1746142903.739479:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:32132:x1830962867158144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142903.739490:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.739523:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccbbd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89bec expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.739575:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739583:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739591:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739600:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739605:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739704:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739776:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccbbec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739784:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccbbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739789:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccbbec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142903.739796:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142903.739851:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739857:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739861:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739866:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739871:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.739873:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739879:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739887:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142903.739889:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.739892:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739896:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75c00/0x2fa243e067ccbbde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739971:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739980:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739984:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739988:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.739990:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.739994:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.740002:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3100) 00010000:00010000:1.0:1746142903.740004:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.740006:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.740011:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccbbe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.740048:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccbbd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bec expref: 20 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.740060:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccbbec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bec expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.740066:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.740067:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142903.740069:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74c00, rc 0) 00000100:00100000:1.0:1746142903.740108:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:32132:x1830962867158144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 628us (726us total) trans 8589936459 rc 0/0 00000100:00100000:1.0:1746142903.740115:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14319 00000100:00100000:0.0:1746142903.746105:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.746346:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.754890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.754944:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867158656 00000100:00100000:1.0:1746142903.754951:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867158656 00000100:00100000:1.0:1746142903.754994:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14320 00000100:00100000:1.0:1746142903.755002:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:32132:x1830962867158656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142903.755020:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.755034:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067ccbc08 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c01 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.755105:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.755116:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bde expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.755121:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 4/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.755142:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bde expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.755150:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bde expref: 31 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.755159:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867726464:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.755227:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.762008:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142903.762387:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9000/0x2fa243e067ccbbc2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bde expref: 31 pid: 7231 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.762405:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867726464:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.762418:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762425:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762429:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762442:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762448:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762453:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762458:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.762461:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762466:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762474:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.762476:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142903.762478:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762483:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccbc0f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.762521:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067ccbc08 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c01 expref: 20 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.762527:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75a00/0x2fa243e067ccbc08 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c01 expref: 20 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.762534:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75a00, rc 0) 00000100:00100000:1.0:1746142903.762552:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:32132:x1830962867158656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7552us (7670us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.762558:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14320 00000100:00100000:0.0:1746142903.767335:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.789930:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.790004:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867159296 00000100:00100000:1.0:1746142903.790012:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867159296 00000100:00100000:1.0:1746142903.790062:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14321 00000100:00100000:1.0:1746142903.790069:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32138:x1830962867159296:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.790090:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.790104:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccbc16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c08 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.790160:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790170:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790179:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790189:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790194:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790198:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790269:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccbc2b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790277:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccbc2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790282:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccbc2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142903.790290:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142903.790343:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790348:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790353:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790358:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790362:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.790365:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790370:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790378:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142903.790381:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.790384:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790388:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccbc1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790400:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790405:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790409:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790413:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142903.790414:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790419:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790424:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3300) 00010000:00010000:1.0:1746142903.790425:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142903.790427:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790431:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccbc24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142903.790460:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccbc16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c08 expref: 61 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.790470:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccbc2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c08 expref: 60 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.790475:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142903.790477:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142903.790479:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74600, rc 0) 00000100:00100000:1.0:1746142903.790533:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+60:32138:x1830962867159296:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 464us (641us total) trans 8589936461 rc 0/0 00000100:00100000:1.0:1746142903.790538:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14321 00000100:00100000:0.0:1746142903.853265:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.853346:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.860348:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.860381:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.860407:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.860439:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.860457:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867159552 00000100:00100000:1.0:1746142903.860460:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867159552 00000100:00100000:0.0:1746142903.860474:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867159808 00000100:00100000:0.0:1746142903.860476:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867159808 00000100:00100000:0.0:1746142903.860504:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867160064 00000100:00100000:0.0:1746142903.860506:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867160064 00000100:00100000:1.0:1746142903.860508:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 872 00000100:00100000:1.0:1746142903.860514:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+5:2005:x1830962867159808:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142903.860517:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 873 00000100:00100000:0.0:1746142903.860520:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962867159552:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:1.0:1746142903.860568:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+5:2005:x1830962867159808:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.860568:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962867159552:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.860573:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 872 00000100:00100000:0.0:1746142903.860576:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 873 00000100:00100000:0.0:1746142903.873127:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.873174:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.873393:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13686 00000100:00100000:0.0:1746142903.873399:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867160320:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.873407:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.873413:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9800/0x2fa243e067ccbc40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c16 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.873428:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9800/0x2fa243e067ccbc40 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c16 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.873435:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9800/0x2fa243e067ccbc40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c16 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142903.873454:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d9800, rc 0) 00000100:00100000:0.0:1746142903.873471:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867160320:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (297us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142903.873476:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13686 00000100:00100000:1.0:1746142903.889591:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.921968:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867160704 00000100:00100000:0.0:1746142903.921976:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867160704 00000100:00100000:0.0:1746142903.922014:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867160832 00000100:00100000:0.0:1746142903.922017:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867160832 00000100:00100000:0.0:1746142903.922038:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13688 00000100:00100000:0.0:1746142903.922046:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867160704:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142903.922060:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142903.922074:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccbc4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c24 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.923701:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867726848:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142903.923844:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.927792:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867160576:12345-192.168.204.50@tcp:4:cat.0 Request processed in 29163us (30687us total) trans 21474841084 rc 0/0 00000100:00100000:0.0:1746142903.927808:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1278 00002000:00100000:0.0:1746142903.927820:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1302528->2097151) req@ffff88012e678700 x1830962867160576/t21474841084(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/448 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.927829:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678700 with x1830962867160576 ext(1302528->2097151) 00010000:00010000:0.0:1746142903.927837:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccbb13 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b4b expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.927851:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccbb13 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1302528->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b4b expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746142903.927858:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e678700 00000100:00100000:1.0:1746142903.928508:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867726848:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142903.928531:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccbc4e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c24 expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.928542:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccbc4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c24 expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.928554:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d9200, rc 0) 00000100:00100000:1.0:1746142903.928588:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867160704:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6543us (8367us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142903.928594:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13688 00000100:00100000:0.0:1746142903.929988:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.933015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.937302:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.937348:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867161344 00000100:00100000:1.0:1746142903.937355:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867161344 00000100:00100000:1.0:1746142903.937399:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13690 00000100:00100000:1.0:1746142903.937405:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32138:x1830962867161344:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.937419:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.937432:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c32 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.937453:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.937459:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.937465:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800987ff400/0x2fa243e067ccbafe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b36 expref: 29 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.937469:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.937470:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.937473:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->2752511] (req 2097152->2752511) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.937507:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800987ff400/0x2fa243e067ccbafe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b36 expref: 29 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.937516:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800987ff400/0x2fa243e067ccbafe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b36 expref: 29 pid: 11943 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746142903.937525:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727104:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.937600:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.937607:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 11 pid: 1853 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746142903.937613:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727232:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.937633:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142903.937639:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 9 pid: 1854 timeout: 777 lvb_type: 1 00000100:00100000:1.0:1746142903.937645:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.937655:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.941258:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.944956:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727104:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142903.944969:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.944971:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727232:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.944977:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727360:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.944998:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->2752511] (req 2097152->2752511) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.945016:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75600, rc 0) 00000100:00100000:1.0:1746142903.945050:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32138:x1830962867161344:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7644us (7755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.945057:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13690 00000100:00100000:0.0:1746142903.946891:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.950441:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.950467:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.950482:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.950505:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867162368 00000100:00100000:1.0:1746142903.950510:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867162368 00002000:00100000:1.0:1746142903.950532:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088f18000 x1830962867162368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.950539:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18000 with x1830962867162368 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.950542:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18000 00000100:00100000:1.0:1746142903.950554:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4114 00000100:00100000:1.0:1746142903.950557:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867162368:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.950836:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867162240 00000100:00100000:0.0:1746142903.950840:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867162240 00010000:00010000:0.0:1746142903.950857:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 10 pid: 1854 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746142903.950883:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867161728 00000100:00100000:0.0:1746142903.950886:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867161728 00010000:00010000:0.0:1746142903.950895:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 12 pid: 1853 timeout: 777 lvb_type: 1 00000100:00100000:0.0:1746142903.951072:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6112 00000100:00100000:0.0:1746142903.951078:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867162240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.951087:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.951102:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 10 pid: 1854 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.951112:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 10 pid: 1854 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.951130:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccbaa3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89af7 expref: 10 pid: 1854 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.951147:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142903.951178:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867162240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142903.951184:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6112 00000100:00100000:0.0:1746142903.951196:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6113 00000100:00100000:0.0:1746142903.951200:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867161728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142903.951206:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142903.951212:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 12 pid: 1853 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.951220:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 12 pid: 1853 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.951231:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccbb91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bd7 expref: 12 pid: 1853 timeout: 777 lvb_type: 1 00010000:00010000:0.0:1746142903.951243:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.951245:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142903.951250:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.951257:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142903.951280:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142903.951290:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867727488:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142903.951339:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142903.959390:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867727488:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142903.959407:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.959945:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867161728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8742us (9475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.959957:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6113 00000100:00100000:0.0:1746142903.960186:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.962194:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867162368:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11631us (11705us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142903.962203:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4114 00002000:00100000:1.0:1746142903.962209:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088f18000 x1830962867162368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.962216:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18000 with x1830962867162368 ext(1048576->2097151) 00002000:00010000:1.0:1746142903.962220:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18000 00000100:00100000:0.0:1746142903.966385:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.966427:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.966440:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867162752 00000100:00100000:1.0:1746142903.966448:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867162752 00000100:00100000:1.0:1746142903.966509:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13692 00000100:00100000:1.0:1746142903.966516:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+9:32134:x1830962867162752:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142903.966531:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.966543:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092732600/0x2fa243e067ccbc6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c40 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.966565:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.966572:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.966574:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142903.966577:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732600/0x2fa243e067ccbc6a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3776512->4194303] (req 3776512->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c40 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.966603:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.966618:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 27 pid: 12211 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.966629:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727616:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142903.966695:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.967919:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.968592:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867727616:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142903.968613:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092732600/0x2fa243e067ccbc6a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3776512->4194303] (req 3776512->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c40 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.968624:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732600, rc 0) 00000100:00100000:1.0:1746142903.968652:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:32134:x1830962867162752:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2136us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.968657:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13692 00000100:00100000:0.0:1746142903.969559:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.969582:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867163264 00000100:00100000:0.0:1746142903.969588:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867163264 00002000:00100000:0.0:1746142903.969623:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2752511) req@ffff88009734bb80 x1830962867163264/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.969631:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734bb80 with x1830962867163264 ext(2097152->2752511) 00010000:00010000:0.0:1746142903.969638:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 28 pid: 12211 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.969650:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 28 pid: 12211 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746142903.969655:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734bb80 00000100:00100000:0.0:1746142903.969669:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867163392 00000100:00100000:0.0:1746142903.969672:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867163392 00002000:00100000:0.0:1746142903.969682:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009809ed80 x1830962867163392/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 504/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.969687:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ed80 with x1830962867163392 ext(2097152->3145727) 00010000:00010000:0.0:1746142903.969691:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 30 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.969697:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 30 pid: 1397 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746142903.969702:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809ed80 00000100:00100000:1.0:1746142903.970125:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1279 00000100:00100000:0.0:1746142903.970383:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1280 00000100:00100000:1.0:1746142903.970385:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867163264:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142903.970392:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867163392:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142903.971324:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.971357:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.971557:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1281 00000100:00100000:1.0:1746142903.971567:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867163648:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.975964:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867163392:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5560us (6395us total) trans 21474841085 rc 0/0 00000100:00100000:0.0:1746142903.975978:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1280 00002000:00100000:0.0:1746142903.975990:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009809ed80 x1830962867163392/t21474841085(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 504/448 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.976001:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ed80 with x1830962867163392 ext(2097152->3145727) 00010000:00010000:0.0:1746142903.976013:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 34 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:0.0:1746142903.976027:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 34 pid: 1397 timeout: 777 lvb_type: 0 00002000:00010000:0.0:1746142903.976033:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809ed80 00000100:00100000:1.0:1746142903.977757:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867163648:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6182us (6427us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746142903.977767:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1281 00002000:00100000:1.0:1746142903.977775:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2265088->2928639) req@ffff88009809d180 x1830962867163648/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/440 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.977790:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d180 with x1830962867163648 ext(2265088->2928639) 00010000:00010000:1.0:1746142903.977798:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.977809:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.977814:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809d180 00000100:00100000:1.0:1746142903.980160:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867163264:12345-192.168.204.50@tcp:4:cat.0 Request processed in 9769us (11208us total) trans 17179873819 rc 0/0 00000100:00100000:1.0:1746142903.980170:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1279 00002000:00100000:1.0:1746142903.980181:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2752511) req@ffff88009734bb80 x1830962867163264/t17179873819(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:54/0 lens 488/448 e 0 to 0 dl 1746142914 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142903.980190:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734bb80 with x1830962867163264 ext(2097152->2752511) 00010000:00010000:1.0:1746142903.980199:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 32 pid: 12211 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.980211:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccbc5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2752511) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c32 expref: 32 pid: 12211 timeout: 777 lvb_type: 0 00002000:00010000:1.0:1746142903.980217:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734bb80 00000100:00100000:0.0:1746142903.983382:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.983425:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.983589:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867164160 00000100:00100000:1.0:1746142903.983593:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867164160 00010000:00010000:1.0:1746142903.983611:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142903.983697:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6114 00000100:00100000:1.0:1746142903.983704:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867164160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142903.983713:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142903.983729:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.983738:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.983753:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d2200/0x2fa243e067ccbb21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2265087) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b59 expref: 32 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142903.983772:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.983774:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.983779:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52800/0x2fa243e067ccbc71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c47 expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.983786:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea52800/0x2fa243e067ccbc71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c47 expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.983870:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea52800/0x2fa243e067ccbc71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c47 expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142903.983881:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867727872:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142903.984036:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142903.984472:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.985359:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867727872:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142903.985370:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142903.985394:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867164160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1691us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.985400:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6114 00000100:00100000:0.0:1746142903.986659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.988247:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.988362:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867164800 00000100:00100000:0.0:1746142903.988366:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867164800 00002000:00100000:0.0:1746142903.988382:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (3776512->3780607) req@ffff880088f1b100 x1830962867164800/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/0 e 0 to 0 dl 1746142914 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.988388:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1b100 with x1830962867164800 ext(3776512->3780607) 00002000:00010000:0.0:1746142903.988391:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f1b100 00000100:00100000:0.0:1746142903.988403:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4117 00000100:00100000:0.0:1746142903.988408:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867164800:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142903.988484:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867164800:12345-192.168.204.50@tcp:3:cat.0 Request processed in 75us (237us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142903.988503:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4117 00002000:00100000:0.0:1746142903.988509:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (3776512->3780607) req@ffff880088f1b100 x1830962867164800/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:54/0 lens 488/4536 e 0 to 0 dl 1746142914 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142903.988521:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1b100 with x1830962867164800 ext(3776512->3780607) 00002000:00010000:0.0:1746142903.988524:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f1b100 00000100:00100000:1.0:1746142903.990077:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.999294:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142903.999341:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142903.999578:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13696 00000100:00100000:1.0:1746142903.999586:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:32141:x1830962867165184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142903.999594:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142903.999604:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89c55 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.999617:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.999618:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142903.999623:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.999636:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142903.999644:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0600, rc 0) 00000100:00100000:1.0:1746142903.999678:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+11:32141:x1830962867165184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142903.999683:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13696 00000100:00100000:0.0:1746142904.001270:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.003216:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.004504:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.004535:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.004887:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867165824 00000100:00100000:1.0:1746142904.004890:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867165824 00010000:00010000:1.0:1746142904.004921:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d3800/0x2fa243e067ccbb2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b67 expref: 31 pid: 1397 timeout: 777 lvb_type: 0 00000100:00100000:1.0:1746142904.004949:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6117 00000100:00100000:1.0:1746142904.004954:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867165824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.004961:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.004969:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800971d3800/0x2fa243e067ccbb2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b67 expref: 31 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142904.004977:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d3800/0x2fa243e067ccbb2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b67 expref: 31 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142904.004989:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d3800/0x2fa243e067ccbb2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b67 expref: 31 pid: 1397 timeout: 777 lvb_type: 0 00010000:00010000:1.0:1746142904.005000:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.005016:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867165824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 61us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.005022:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6117 00000100:00100000:0.0:1746142904.007375:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.007663:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.010304:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867165696:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5545us (5765us total) trans 17179873820 rc 0/0 00000100:00100000:0.0:1746142904.010312:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1283 00002000:00100000:0.0:1746142904.010318:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (3776512->4194303) req@ffff88011e13ea00 x1830962867165696/t17179873820(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/448 e 0 to 0 dl 1746142915 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142904.010325:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ea00 with x1830962867165696 ext(3776512->4194303) 00010000:00010000:0.0:1746142904.010331:0:29475:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092732600/0x2fa243e067ccbc6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3776512->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c40 expref: 15 pid: 12211 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.010341:0:29475:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092732600/0x2fa243e067ccbc6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3776512->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c40 expref: 15 pid: 12211 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746142904.010347:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e13ea00 00000100:00100000:0.0:1746142904.014854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.018158:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.021021:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.022271:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.023210:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.038620:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.039845:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.041728:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.049367:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.055562:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.062155:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.063721:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.067370:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.071024:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.071423:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867169024 00000100:00100000:1.0:1746142904.071431:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867169024 00002000:00100000:1.0:1746142904.071464:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880096095f80 x1830962867169024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.071472:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096095f80 with x1830962867169024 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.071476:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096095f80 00000100:00100000:1.0:1746142904.071535:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4125 00000100:00100000:1.0:1746142904.071542:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867169024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142904.079567:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867169024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8018us (8540us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142904.079578:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4125 00002000:00100000:1.0:1746142904.079587:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880096095f80 x1830962867169024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.079595:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096095f80 with x1830962867169024 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.079600:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096095f80 00000100:00100000:0.0:1746142904.091650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.094015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.128211:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746142904.128227:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867729792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746142904.128284:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746142904.128644:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746142904.128918:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867729792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746142904.157171:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.165837:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.169679:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.170164:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867169920 00000100:00100000:1.0:1746142904.170170:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867169920 00010000:00010000:1.0:1746142904.170309:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbcb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4714496->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c86 expref: 18 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.170343:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6122 00000100:00100000:1.0:1746142904.170350:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867169920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.170361:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.170379:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbcb0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4714496->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c86 expref: 18 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.170388:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbcb0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4714496->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c86 expref: 18 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.170411:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbcb0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4714496->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c86 expref: 18 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.170438:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.170476:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867169920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.170482:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6122 00000100:00100000:0.0:1746142904.171791:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.175382:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.175424:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867170304 00000100:00100000:1.0:1746142904.175430:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867170304 00002000:00100000:1.0:1746142904.175454:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2899968->2904063) req@ffff880096097480 x1830962867170304/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.175460:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096097480 with x1830962867170304 ext(2899968->2904063) 00002000:00010000:1.0:1746142904.175463:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096097480 00000100:00100000:1.0:1746142904.175567:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4126 00000100:00100000:1.0:1746142904.175574:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867170304:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142904.175668:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867170304:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 95us (288us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142904.175673:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4126 00002000:00100000:1.0:1746142904.175678:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2899968->2904063) req@ffff880096097480 x1830962867170304/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.175684:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096097480 with x1830962867170304 ext(2899968->2904063) 00002000:00010000:1.0:1746142904.175687:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096097480 00000100:00100000:0.0:1746142904.177096:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.198176:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.202822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.202853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.202889:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.202929:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867170944 00000100:00100000:1.0:1746142904.202933:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867170816 00000100:00100000:0.0:1746142904.202936:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867170944 00000100:00100000:1.0:1746142904.202937:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867170816 00010000:00010000:0.0:1746142904.202963:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1400/0x2fa243e067ccbbad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bc2 expref: 11 pid: 12211 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.202986:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867171072 00000100:00100000:0.0:1746142904.202988:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867171072 00010000:00010000:1.0:1746142904.203094:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccbae2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b21 expref: 32 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.203094:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae2 expref: 13 pid: 1854 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.203113:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6125 00000100:00100000:0.0:1746142904.203118:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867171072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142904.203124:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6126 00010000:00010000:0.0:1746142904.203124:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142904.203130:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867170816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.203131:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae2 expref: 13 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.203137:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.203138:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae2 expref: 13 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.203146:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccbae2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b21 expref: 32 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.203149:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0c00/0x2fa243e067ccba8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ae2 expref: 13 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.203154:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccbae2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b21 expref: 32 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.203162:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142904.203168:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccbae2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b21 expref: 32 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.203180:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.203182:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.203187:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccbce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca2 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.203190:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867171072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 73us (301us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142904.203194:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccbce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca2 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.203195:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6125 00010000:00010000:1.0:1746142904.203221:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccbce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca2 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.203230:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867730688:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142904.204359:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.204697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.204768:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867730688:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142904.204782:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.204810:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867170816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1681us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.204818:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6126 00000100:00100000:0.0:1746142904.216327:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.216374:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.216526:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13706 00000100:00100000:0.0:1746142904.216534:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867171584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142904.216543:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142904.216556:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6e00/0x2fa243e067ccbcef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89cb0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.216593:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096097800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867730816:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142904.217376:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.227138:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.227173:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.227200:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867171712 00000100:00100000:1.0:1746142904.227206:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867171712 00010000:00010000:1.0:1746142904.227236:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccbc63 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c39 expref: 34 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.227256:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867171840 00000100:00100000:1.0:1746142904.227258:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867171840 00010000:00010000:1.0:1746142904.227266:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccbc47 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c1d expref: 16 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.227279:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6127 00000100:00100000:1.0:1746142904.227285:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867171712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.227295:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.227311:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccbc63 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c39 expref: 34 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.227320:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccbc63 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c39 expref: 34 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.227344:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.227377:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867171712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.227382:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6127 00000100:00100000:1.0:1746142904.227417:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6128 00000100:00100000:1.0:1746142904.227421:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867171840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.227427:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.227432:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccbc47 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c1d expref: 16 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.227440:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccbc47 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c1d expref: 16 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.227450:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.227451:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.227457:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.227464:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.227500:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.227511:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f18a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867731200:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142904.227555:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.230441:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f18a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867731200:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142904.230457:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.230507:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867171840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3084us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.230515:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6128 00000100:00100000:0.0:1746142904.233437:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.243025:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.243072:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.262060:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.266807:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.274768:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.282652:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.301083:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.302531:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.302561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.302585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.302691:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13709 00000100:00100000:1.0:1746142904.302698:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867173632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.302706:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.302717:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ccc expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.302737:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.302739:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.302746:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 19 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.302759:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 19 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.302768:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:1.0:1746142904.302796:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867173632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.302801:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13709 00000100:00100000:1.0:1746142904.302816:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13710 00000100:00100000:1.0:1746142904.302820:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867173504:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.302826:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.302832:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccbd12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89cc5 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.302854:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867731712:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142904.302884:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867173248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19994us (20238us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142904.302890:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4132 00002000:00100000:1.0:1746142904.302912:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880096095180 x1830962867173248/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.302919:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096095180 with x1830962867173248 ext(2097152->4194303) 00002000:00010000:1.0:1746142904.302923:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096095180 00000100:00100000:1.0:1746142904.302943:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.305220:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867731712:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142904.305247:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccbd12 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cc5 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.305258:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccbd12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cc5 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.305270:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83400, rc 0) 00000100:00100000:1.0:1746142904.305301:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867173504:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2480us (2739us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142904.305308:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13710 00000100:00100000:0.0:1746142904.306552:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.307782:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867173888 00000100:00100000:1.0:1746142904.307793:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867173888 00002000:00100000:1.0:1746142904.307835:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1466367) req@ffff880135d73480 x1830962867173888/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.307850:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d73480 with x1830962867173888 ext(1048576->1466367) 00010000:00010000:1.0:1746142904.307864:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 31 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.307876:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 31 pid: 9578 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746142904.307883:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d73480 00000100:00100000:1.0:1746142904.307935:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1286 00000100:00100000:1.0:1746142904.307942:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867173888:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142904.314675:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867731968:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142904.314711:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067ccbd20 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cda expref: 34 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.314721:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067ccbd20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cda expref: 34 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.314734:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52200, rc 0) 00000100:00100000:1.0:1746142904.314780:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867174016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6077us (6216us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142904.314786:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13712 00000100:00100000:1.0:1746142904.318332:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867173888:12345-192.168.204.50@tcp:4:cat.0 Request processed in 10390us (11780us total) trans 21474841088 rc 0/0 00000100:00100000:1.0:1746142904.318340:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1286 00002000:00100000:1.0:1746142904.318345:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1466367) req@ffff880135d73480 x1830962867173888/t21474841088(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/448 e 0 to 0 dl 1746142915 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.318352:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d73480 with x1830962867173888 ext(1048576->1466367) 00010000:00010000:1.0:1746142904.318358:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.318366:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccbcf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1466367) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca9 expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00002000:00010000:1.0:1746142904.318371:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d73480 00000100:00100000:0.0:1746142904.320349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.320415:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867174528 00000100:00100000:1.0:1746142904.320421:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867174528 00002000:00100000:1.0:1746142904.320449:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880135d72a00 x1830962867174528/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.320457:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d72a00 with x1830962867174528 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.320461:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d72a00 00000100:00100000:1.0:1746142904.320474:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4133 00000100:00100000:1.0:1746142904.320480:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867174528:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142904.326874:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867174272:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8889us (9170us total) trans 17179873821 rc 0/0 00000100:00100000:0.0:1746142904.326884:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1287 00002000:00100000:0.0:1746142904.326895:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1810432->2097151) req@ffff88012d4c0700 x1830962867174272/t17179873821(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/448 e 0 to 0 dl 1746142915 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142904.326929:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0700 with x1830962867174272 ext(1810432->2097151) 00010000:00010000:0.0:1746142904.326938:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccbce8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca2 expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.326948:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccbce8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ca2 expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00002000:00010000:0.0:1746142904.326954:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d4c0700 00000100:00100000:1.0:1746142904.329405:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867174528:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8918us (9056us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142904.329413:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4133 00002000:00100000:1.0:1746142904.329421:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880135d72a00 x1830962867174528/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.329428:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d72a00 with x1830962867174528 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.329432:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d72a00 00000100:00100000:0.0:1746142904.330967:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.331006:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.331066:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867175040 00000100:00100000:1.0:1746142904.331072:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867175040 00002000:00100000:1.0:1746142904.331100:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1175552->1179647) req@ffff880135d71f80 x1830962867175040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.331107:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d71f80 with x1830962867175040 ext(1175552->1179647) 00002000:00010000:1.0:1746142904.331111:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d71f80 00000100:00100000:1.0:1746142904.331124:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4134 00000100:00100000:1.0:1746142904.331129:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867175040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142904.331220:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867175040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 90us (212us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142904.331225:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4134 00002000:00100000:1.0:1746142904.331229:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1175552->1179647) req@ffff880135d71f80 x1830962867175040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.331236:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d71f80 with x1830962867175040 ext(1175552->1179647) 00002000:00010000:1.0:1746142904.331238:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d71f80 00000100:00100000:0.0:1746142904.332621:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.332776:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.332887:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867175168 00000100:00100000:1.0:1746142904.332892:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867175168 00000100:00100000:1.0:1746142904.332928:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867175296 00000100:00100000:1.0:1746142904.332930:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867175296 00000100:00100000:1.0:1746142904.332942:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13714 00000100:00100000:1.0:1746142904.332947:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867175168:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.332956:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.332965:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ce8 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.332978:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.332980:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.332984:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 34 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.332994:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 34 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.333001:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82e00, rc 0) 00000100:00100000:1.0:1746142904.333024:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867175168:12345-192.168.204.50@tcp:101:cat.0 Request processed in 77us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.333029:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13714 00000100:00100000:1.0:1746142904.333039:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13715 00000100:00100000:1.0:1746142904.333042:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867175296:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.333048:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.333054:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccbd35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89cef expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.333074:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867732480:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142904.333109:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.336830:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867175552 00000100:00100000:1.0:1746142904.336840:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867175552 00002000:00100000:1.0:1746142904.336876:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1208320->1212415) req@ffff88012e67b480 x1830962867175552/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.336885:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67b480 with x1830962867175552 ext(1208320->1212415) 00002000:00010000:1.0:1746142904.336889:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67b480 00000100:00100000:1.0:1746142904.336916:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4135 00000100:00100000:1.0:1746142904.336923:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867175552:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142904.337150:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867175552:12345-192.168.204.50@tcp:3:cat.0 Request processed in 226us (2736us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142904.337156:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4135 00002000:00100000:1.0:1746142904.337161:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1208320->1212415) req@ffff88012e67b480 x1830962867175552/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.337167:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67b480 with x1830962867175552 ext(1208320->1212415) 00002000:00010000:1.0:1746142904.337170:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67b480 00000100:00100000:1.0:1746142904.337311:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867732480:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142904.337549:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccbd35 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cef expref: 33 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.337561:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccbd35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cef expref: 33 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.337649:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82a00, rc 0) 00000100:00100000:1.0:1746142904.337682:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867175296:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4638us (4905us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142904.337688:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13715 00000100:00100000:0.0:1746142904.338639:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.338735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.338786:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867176064 00000100:00100000:1.0:1746142904.338788:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867176064 00002000:00100000:1.0:1746142904.338802:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1175551) req@ffff880135d73800 x1830962867176064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.338810:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d73800 with x1830962867176064 ext(1048576->1175551) 00002000:00010000:1.0:1746142904.338814:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d73800 00000100:00100000:1.0:1746142904.338834:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4137 00000100:00100000:1.0:1746142904.338837:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867176064:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142904.343697:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.343776:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867176192 00000100:00100000:1.0:1746142904.343783:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867176192 00000100:00100000:1.0:1746142904.343815:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13716 00000100:00100000:1.0:1746142904.343822:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867176192:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.343837:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.343850:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3920c00/0x2fa243e067ccbd3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89cf6 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.343890:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867732608:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142904.345317:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.345510:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867176064:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6669us (6772us total) trans 0 rc 126976/126976 00000100:00100000:1.0:1746142904.345518:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4137 00002000:00100000:1.0:1746142904.345526:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1175551) req@ffff880135d73800 x1830962867176064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 126976/126976 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.345534:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d73800 with x1830962867176064 ext(1048576->1175551) 00002000:00010000:1.0:1746142904.345538:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d73800 00000100:00100000:1.0:1746142904.347125:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867732608:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142904.347152:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3920c00/0x2fa243e067ccbd3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cf6 expref: 33 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.347164:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3920c00/0x2fa243e067ccbd3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cf6 expref: 33 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.347232:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3920c00, rc 0) 00000100:00100000:1.0:1746142904.347260:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867176192:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3438us (3569us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142904.347266:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13716 00000100:00100000:0.0:1746142904.349970:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.364449:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.387387:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.400335:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867732736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746142904.400394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.400792:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867732736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746142904.410956:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.411048:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867177088 00000100:00100000:1.0:1746142904.411056:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867177088 00000100:00080000:0.0:1746142904.411102:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746142904.411121:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14324 00000100:00100000:1.0:1746142904.411128:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+20:32168:x1830962867177088:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142904.411147:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.411162:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067ccbd43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89cfd expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.411210:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067ccbd4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411220:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067ccbd4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411228:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7600/0x2fa243e067ccbd4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411238:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6600/0x2fa243e067ccbd51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411243:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6600/0x2fa243e067ccbd51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411248:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6600/0x2fa243e067ccbd51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411297:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411303:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3920000/0x2fa243e067ccbcbe lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c8d expref: 61 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.411308:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.411312:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.411333:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.411339:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 33 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.411346:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867732864:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.411426:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3920000/0x2fa243e067ccbcbe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c8d expref: 61 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.411433:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3920000/0x2fa243e067ccbcbe lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c8d expref: 61 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.411439:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867732992:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.411457:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013132d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.412638:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088f18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867732864:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.412645:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867732992:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.412661:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142904.413881:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.414729:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.414996:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5197 00000100:00100000:1.0:1746142904.415003:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4853850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+62:16318:x1830962867177600:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142904.415817:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4853850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+63:16318:x1830962867177600:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 813us (1088us total) trans 8589936467 rc 0/0 00000100:00100000:1.0:1746142904.415823:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5197 00000100:00100000:1.0:1746142904.416327:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867733504:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.416357:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.416377:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3765:1830962867734016:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.416394:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.416410:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746142904.416415:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3765:1830962867733376:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.416430:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.416443:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3765:1830962867733888:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.416458:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.416469:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830962867734400:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.416493:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.416513:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867734016 00000100:00100000:1.0:1746142904.416517:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867734016 00000100:00100000:1.0:1746142904.416538:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867733632 00000100:00100000:1.0:1746142904.416541:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867733632 00000100:00100000:1.0:1746142904.416549:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867733376 00000100:00100000:1.0:1746142904.416551:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867733376 00000100:00100000:1.0:1746142904.416556:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867733888 00000100:00100000:1.0:1746142904.416558:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867733888 00000100:00100000:1.0:1746142904.416566:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867733760 00000100:00100000:1.0:1746142904.416568:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867733760 00000100:00100000:1.0:1746142904.416574:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867734400 00000100:00100000:1.0:1746142904.416576:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867734400 00000100:00100000:1.0:1746142904.416583:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1746142904.416587:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3765:x1830962867734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.416612:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3765:x1830962867734016:12345-0@lo:400:kworker.0 Request processed in 25us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.416617:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1746142904.416626:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1746142904.416630:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3762:x1830962867733632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142904.416836:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1746142904.416842:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3762:x1830962867734272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142904.417447:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3762:x1830962867734272:12345-0@lo:400:kworker.0 Request processed in 604us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.417456:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1746142904.417472:0:7232:0:(service.c:3346:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1746142904.417478:0:7232:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1746142904.417502:0:7235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867733248 00000100:00100000:0.0:1746142904.417505:0:7235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867733248 00000100:00100000:0.0:1746142904.417522:0:7235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1746142904.417526:0:7235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867733248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142904.417550:0:7235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867733248:12345-0@lo:400:kworker.0 Request processed in 24us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.417635:0:7235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1746142904.417723:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.417749:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.417763:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867177728 00000100:00100000:0.0:1746142904.417766:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867177728 00010000:00010000:0.0:1746142904.417781:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3920000/0x2fa243e067ccbcbe lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c8d expref: 63 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.417797:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867177856 00000100:00100000:0.0:1746142904.417799:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867177856 00000100:00100000:1.0:1746142904.418504:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3762:x1830962867733632:12345-0@lo:400:kworker.0 Request processed in 1872us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.418515:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1746142904.418545:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3765:1830962867733376:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.418554:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3765:1830962867733888:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.418562:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3765:1830962867734400:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.418570:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867733504:0@lo:400:kworker.0 00000100:00100000:1.0:1746142904.418578:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3765:1830962867734016:0@lo:400:kworker.0 00010000:00010000:0.0:1746142904.418992:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 35 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.419267:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6133 00000100:00100000:0.0:1746142904.419275:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+35:2006:x1830962867177856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.419282:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.419286:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 35 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.419635:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 35 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.419650:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbcd3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c94 expref: 35 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.419659:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.419662:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.419669:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.419675:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.419739:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.419756:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867177856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 483us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.419762:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6133 00000100:00100000:0.0:1746142904.422211:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.422308:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.422334:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.423259:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867178240 00000100:00100000:0.0:1746142904.423262:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867178240 00000100:00100000:0.0:1746142904.423280:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13720 00000100:00100000:0.0:1746142904.423284:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867178240:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142904.423290:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142904.423297:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d12 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.423307:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.423310:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.423314:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142904.423323:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142904.423329:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445c00, rc 0) 00000100:00100000:0.0:1746142904.423635:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867178240:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 348us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.423640:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13720 00000100:00100000:0.0:1746142904.426200:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.432177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.432249:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867178752 00000100:00100000:1.0:1746142904.432256:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867178752 00010000:00010000:1.0:1746142904.432284:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cfd expref: 23 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.432318:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6134 00000100:00100000:1.0:1746142904.432325:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+23:2006:x1830962867178752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.432336:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.432341:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cfd expref: 23 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.432350:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cfd expref: 23 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.432374:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccbd58 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cfd expref: 23 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.432398:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.432402:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccbd82 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.432410:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccbd82 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.432415:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0600/0x2fa243e067ccbd82 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.432432:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.432462:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+22:2006:x1830962867178752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.432468:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6134 00000100:00100000:0.0:1746142904.436103:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.440553:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.442604:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142904.442756:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccbadb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b13 expref: 31 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.442767:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.442768:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.442771:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.442795:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccbadb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b13 expref: 31 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.442805:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccbadb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b13 expref: 31 pid: 1852 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.442817:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867734912:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.442895:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067ccbba6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bb4 expref: 8 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.442922:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067ccbba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bb4 expref: 8 pid: 9579 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.442930:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867735040:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.442966:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccba80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ad4 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.442974:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccba80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ad4 expref: 17 pid: 1397 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.442985:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867735168:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.443001:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.443566:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.443600:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867179520 00000100:00100000:0.0:1746142904.443604:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867179520 00000100:00100000:2.0:1746142904.443688:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.444038:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867179776 00000100:00100000:0.0:1746142904.444041:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867179776 00000100:00100000:0.0:1746142904.444061:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13723 00000100:00100000:0.0:1746142904.444066:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867179520:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142904.444086:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccbdb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.444095:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.444105:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142904.444111:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 32 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142904.444116:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.444117:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.444119:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccbdb3 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.444135:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 32 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142904.444141:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 32 pid: 12211 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.444149:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130375880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867735296:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.444190:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13724 00010000:00010000:0.0:1746142904.444193:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142904.444200:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867179776:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142904.444201:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 12 pid: 1852 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.444208:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867735424:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.444216:0:9579:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.444224:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbcfd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cb7 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.444229:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.444231:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142904.444236:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 12 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.444237:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.444242:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746142904.444242:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130374700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867735552:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.444243:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.444245:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.444254:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00010000:00010000:2.0:1746142904.444257:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.444268:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 17 pid: 1852 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.444275:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867735680:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.444302:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.444309:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 9 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.444317:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867735808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.444341:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbcfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cb7 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.444348:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbcfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cb7 expref: 31 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.444355:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088f1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867735936:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.444372:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.444397:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.444467:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867179392 00000100:00100000:1.0:1746142904.444471:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867179392 00000100:00100000:1.0:1746142904.444557:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13725 00000100:00100000:1.0:1746142904.444563:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867179392:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142904.444579:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.444588:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.444595:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 13 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.444601:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b1a expref: 32 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.444605:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.444607:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.444609:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.444622:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b1a expref: 32 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.444633:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b1a expref: 32 pid: 11943 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746142904.444640:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092432300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867736064:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.444667:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 13 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.444673:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 13 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746142904.444679:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867736192:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.444694:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.444700:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 12 pid: 1854 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746142904.444706:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867736320:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.444715:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.445050:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.445062:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867179648 00000100:00100000:2.0:1746142904.445065:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867179648 00000100:00100000:0.0:1746142904.445067:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.445084:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867179904 00000100:00100000:2.0:1746142904.445085:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867179904 00000100:00100000:2.0:1746142904.445326:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13727 00000100:00100000:2.0:1746142904.445331:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867179904:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142904.445345:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445354:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067ccbc8d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c63 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445360:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0800/0x2fa243e067ccbd6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d19 expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.445366:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 12 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445372:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445378:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445383:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142904.445384:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142904.445386:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 8/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445401:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445412:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 12 pid: 12211 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.445419:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736576:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.445455:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445462:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 32 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.445470:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736704:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.445506:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 12 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445514:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 12 pid: 9580 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.445520:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736832:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.445542:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0800/0x2fa243e067ccbd6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d19 expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.445549:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0800/0x2fa243e067ccbd6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d19 expref: 14 pid: 12211 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.445561:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.445583:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067ccbc8d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c63 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.445590:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067ccbc8d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c63 expref: 32 pid: 9580 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.445598:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e518000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867737088:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.445611:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.446819:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.446848:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.446896:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867180032 00000100:00100000:1.0:1746142904.446916:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867180032 00000100:00100000:2.0:1746142904.446922:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867734912:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.446932:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867735040:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.446934:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067ccbba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bb4 expref: 11 pid: 9579 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.446940:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867735168:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.446959:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.446967:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6136 00000100:00100000:1.0:1746142904.446972:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867180032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.446979:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.446987:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067ccbba6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bb4 expref: 11 pid: 9579 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.447025:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067ccbba6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bb4 expref: 11 pid: 9579 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.447110:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067ccbba6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bb4 expref: 11 pid: 9579 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.447123:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.447140:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867180032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 168us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.447146:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6136 00000100:00100000:0.0:1746142904.447402:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.447455:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867180288 00000100:00100000:1.0:1746142904.447458:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867180288 00010000:00010000:1.0:1746142904.447469:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccba80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ad4 expref: 18 pid: 1397 timeout: 778 lvb_type: 1 00000100:00100000:1.0:1746142904.447496:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6137 00000100:00100000:1.0:1746142904.447501:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867180288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.447507:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142904.447511:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130375880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867735296:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.447514:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccba80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ad4 expref: 18 pid: 1397 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.447521:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccba80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ad4 expref: 18 pid: 1397 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.447532:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccba80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ad4 expref: 18 pid: 1397 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.447539:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.447540:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.447544:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.447549:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.447565:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142904.447575:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447580:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.447583:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867180288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.447587:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6137 00010000:00010000:2.0:1746142904.447589:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447594:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447598:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447601:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142904.447603:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447607:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447613:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.447616:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c881200/0x2fa243e067ccbdac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.447645:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867179264:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 4949us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.447649:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13722 00000100:00100000:2.0:1746142904.453070:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867735424:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.453082:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867735552:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142904.453085:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142904.453104:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccbdb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.453129:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e51bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736576:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.453138:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e51aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736704:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142904.453141:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.453145:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e518380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736832:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.453161:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867181312 00000100:00100000:2.0:1746142904.453166:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867181312 00000100:00100000:2.0:1746142904.453178:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e51a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867736960:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.453186:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e518000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867737088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.453201:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746142904.453241:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1175552->1212415) req@ffff8800949d3b80 x1830962867181312/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.453249:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3b80 with x1830962867181312 ext(1175552->1212415) 00010000:00010000:2.0:1746142904.453256:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccbd19 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cd3 expref: 17 pid: 12211 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.453265:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccbd19 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cd3 expref: 17 pid: 12211 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746142904.453271:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949d3b80 00000100:00100000:2.0:1746142904.453295:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1288 00000100:00100000:2.0:1746142904.453302:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867181312:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142904.453334:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092432300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867736064:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.453341:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867736192:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.453347:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867736320:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.453363:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.453378:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867181056 00000100:00100000:1.0:1746142904.453380:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867181056 00010000:00010000:1.0:1746142904.453394:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 13 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.453409:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6138 00000100:00100000:1.0:1746142904.453414:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867181056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.453584:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.453599:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 13 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.453608:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 13 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.453623:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52c00/0x2fa243e067ccbd27 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce1 expref: 13 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.453634:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.453653:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867181056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 239us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.453659:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6138 00000100:00100000:2.0:1746142904.455867:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.455917:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.455955:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.455968:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.455980:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.455990:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.456005:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867180416 00000100:00100000:0.0:1746142904.456010:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867180416 00010000:00010000:0.0:1746142904.456029:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 33 pid: 12211 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.456043:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867180672 00000100:00100000:0.0:1746142904.456045:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867180672 00010000:00010000:0.0:1746142904.456053:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 15 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.456064:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867180928 00000100:00100000:0.0:1746142904.456066:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867180928 00010000:00010000:0.0:1746142904.456073:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 19 pid: 1852 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.456080:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867181440 00000100:00100000:0.0:1746142904.456081:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867181440 00010000:00010000:0.0:1746142904.456087:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800987ffc00/0x2fa243e067ccbaf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89b1a expref: 34 pid: 11943 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.456095:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6139 00000100:00100000:0.0:1746142904.456100:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867180416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.456109:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142904.456119:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867181696 00010000:00010000:0.0:1746142904.456121:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 34 pid: 12211 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.456122:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867181696 00010000:00010000:0.0:1746142904.456130:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 35 pid: 12211 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456131:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 35 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.456141:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867180544 00000100:00100000:2.0:1746142904.456142:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867180544 00010000:00010000:0.0:1746142904.456146:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82e00/0x2fa243e067ccbd2e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ce8 expref: 35 pid: 12211 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456148:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 16 pid: 1852 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.456156:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6140 00000100:00100000:2.0:1746142904.456160:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867180672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.456165:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142904.456166:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.456173:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 16 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456180:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 16 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456190:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccbb9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bbb expref: 16 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:0.0:1746142904.456192:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867180416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.456197:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6139 00010000:00010000:2.0:1746142904.456200:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.456209:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6141 00000100:00100000:2.0:1746142904.456211:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867180672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.456213:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867180928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142904.456218:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6140 00010000:00010000:0.0:1746142904.456218:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.456226:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 21 pid: 1852 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.456233:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 21 pid: 1852 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.456244:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbd04 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ccc expref: 21 pid: 1852 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.456251:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.456263:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867180928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.456269:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6141 00000100:00100000:0.0:1746142904.456277:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6143 00000100:00100000:0.0:1746142904.456280:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867181696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.456285:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.456290:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.456297:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.456306:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4600/0x2fa243e067ccbc78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c4e expref: 33 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.456313:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.456323:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867181696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 43us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.456328:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6143 00000100:00100000:0.0:1746142904.456336:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6144 00000100:00100000:0.0:1746142904.456339:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867180544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.456345:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.456350:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 15 pid: 1852 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.456357:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 15 pid: 1852 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.456366:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1e00/0x2fa243e067ccbd5f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d04 expref: 15 pid: 1852 timeout: 778 lvb_type: 1 00010000:00010000:0.0:1746142904.456373:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.456375:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.456378:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccbdb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.456386:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccbdb3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.456402:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.456415:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867180544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.456420:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6144 00000100:00100000:0.0:1746142904.456446:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.456473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.456522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.456542:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.456557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.456581:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.456668:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867181952 00000100:00100000:2.0:1746142904.456670:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867181952 00010000:00010000:2.0:1746142904.456679:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 13 pid: 1854 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.456688:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867182080 00000100:00100000:2.0:1746142904.456689:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867182080 00010000:00010000:2.0:1746142904.456696:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 14 pid: 9580 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.456704:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6145 00000100:00100000:2.0:1746142904.456709:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867180800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.456713:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.456720:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 9 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456728:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 9 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456738:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccbd74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d12 expref: 9 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.456750:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.456765:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6146 00000100:00100000:1.0:1746142904.456771:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867181184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.456777:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142904.456779:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867180800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (332us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142904.456784:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbcfd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cb7 expref: 31 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.456786:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6145 00000100:00100000:2.0:1746142904.456795:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6147 00010000:00010000:1.0:1746142904.456796:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbcfd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cb7 expref: 31 pid: 9578 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.456800:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867181568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.456805:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.456806:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbcfd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cb7 expref: 31 pid: 9578 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.456810:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 14 pid: 12211 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.456814:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.456816:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 14 pid: 12211 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.456816:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.456818:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.456824:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.456825:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0600/0x2fa243e067ccbc86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c55 expref: 14 pid: 12211 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.456831:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142904.456836:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.456843:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867181568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.456846:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867181184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 77us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.456848:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6147 00000100:00100000:1.0:1746142904.456851:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6146 00000100:00100000:2.0:1746142904.456855:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6148 00000100:00100000:1.0:1746142904.456858:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6149 00000100:00100000:2.0:1746142904.456859:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867181952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142904.456861:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867182080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.456864:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.456865:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.456869:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 12 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.456870:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 12 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.456876:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 12 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.456876:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 12 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.456886:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52a00/0x2fa243e067ccbc94 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89c6a expref: 12 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.456888:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0a00/0x2fa243e067ccba87 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89adb expref: 12 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:1.0:1746142904.456893:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142904.456895:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.456896:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.456914:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.456920:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867182080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (337us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142904.456921:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.456924:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6149 00010000:00010000:2.0:1746142904.456932:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142904.456937:0:9579:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.456944:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867181952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (385us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142904.456944:0:9579:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.456948:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6148 00010000:00010000:1.0:1746142904.456953:0:9579:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.456959:0:9579:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.456964:0:9579:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.456968:0:9579:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093af8a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142904.456970:0:9579:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.456976:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867181312:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3676us (3835us total) trans 21474841089 rc 0/0 00010000:00010000:1.0:1746142904.456980:0:9579:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.456982:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1288 00010000:00010000:1.0:1746142904.456988:0:9579:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746142904.456989:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1175552->1212415) req@ffff8800949d3b80 x1830962867181312/t21474841089(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/448 e 0 to 0 dl 1746142915 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746142904.456993:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093af8a00/0x2fa243e067ccbdba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746142904.456997:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3b80 with x1830962867181312 ext(1175552->1212415) 00010000:00010000:2.0:1746142904.457002:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccbd19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cd3 expref: 18 pid: 12211 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.457009:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccbd19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1175552->1212415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89cd3 expref: 18 pid: 12211 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746142904.457015:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949d3b80 00000100:00100000:1.0:1746142904.457016:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867179776:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 12821us (13328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.457020:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13724 00010000:00010000:1.0:1746142904.457034:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457040:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457050:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457057:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457062:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457070:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bc29000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142904.457072:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457077:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457085:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.457090:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccbdc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.457121:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867179392:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 12558us (12723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.457126:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13725 00000100:00100000:0.0:1746142904.457365:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142904.457671:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457678:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457687:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457692:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457697:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457703:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009873f800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142904.457705:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457711:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457723:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.457732:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbdcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.457814:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867179904:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 12483us (12745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.457820:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13727 00000100:00100000:0.0:1746142904.459347:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142904.459805:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459812:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459824:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459830:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459836:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459841:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea52e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142904.459843:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459849:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459858:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.459864:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52e00/0x2fa243e067ccbdc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.460110:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962867179648:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 14988us (15059us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.460117:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13726 00000100:00100000:0.0:1746142904.462346:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.462507:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867182592 00000100:00100000:2.0:1746142904.462514:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867182592 00000100:00100000:2.0:1746142904.462555:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14327 00000100:00100000:2.0:1746142904.462561:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+23:32168:x1830962867182592:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1746142904.462600:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746142904.462618:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccbbec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89bec expref: 23 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462635:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccbbd0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89be5 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462643:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.462646:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142904.462665:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142904.462674:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8982d expref: 61 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462685:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462690:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462696:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067ccb3b8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f9 expref: 61 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462701:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462710:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 61 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462717:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142904.462741:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 61 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.462754:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 61 pid: 10924 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.462765:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e518000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737216:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.463197:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.463209:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.463216:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737344:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.463523:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067ccb3b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f9 expref: 61 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.463531:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067ccb3b8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f9 expref: 61 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.463538:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e518380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737472:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.463563:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.463570:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 33 pid: 10924 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.463576:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737600:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.463597:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.463603:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 33 pid: 10924 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.463610:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e51bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737728:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.463631:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8982d expref: 61 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.463637:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880400/0x2fa243e067ccb5f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8982d expref: 61 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.463642:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.463655:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.464172:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746142904.464181:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867737984:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746142904.464204:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.464392:0:9266:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867737984 00000100:00100000:2.0:1746142904.464396:0:9266:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867737984 00000100:00100000:2.0:1746142904.464415:0:9266:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1746142904.464419:0:9266:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3764:x1830962867737984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746142904.464437:0:9266:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445650432 avail 1316188160 00000100:00100000:2.0:1746142904.464459:0:9266:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3764:x1830962867737984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.464463:0:9266:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1746142904.464556:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867737984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746142904.464749:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.464767:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e518000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737216:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.464818:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867182848 00000100:00100000:1.0:1746142904.464821:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867182848 00000100:00100000:1.0:1746142904.464844:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5198 00000100:00100000:1.0:1746142904.464849:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+62:16986:x1830962867182848:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142904.464994:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+63:16986:x1830962867182848:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 144us (244us total) trans 8589936470 rc 0/0 00000100:00100000:1.0:1746142904.465000:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5198 00000100:00100000:2.0:1746142904.465051:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e51a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867737344:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.466895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.467331:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.467359:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867183104 00000100:00100000:2.0:1746142904.467365:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867183104 00000100:00100000:2.0:1746142904.467388:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5199 00000100:00100000:2.0:1746142904.467394:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+34:16318:x1830962867183104:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142904.467534:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+35:16318:x1830962867183104:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 139us (642us total) trans 8589936471 rc 0/0 00000100:00100000:2.0:1746142904.467540:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5199 00000100:00100000:1.0:1746142904.467729:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.467746:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867183488 00000100:00100000:0.0:1746142904.467750:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867183488 00010000:00010000:0.0:1746142904.467766:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 35 pid: 10924 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.467770:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.467801:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867183360 00000100:00100000:0.0:1746142904.467803:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867183360 00000100:00100000:1.0:1746142904.467804:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867183232 00000100:00100000:1.0:1746142904.467807:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867183232 00010000:00010000:0.0:1746142904.467813:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 36 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.467819:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067ccb3b8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb896f9 expref: 63 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.467826:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6153 00000100:00100000:0.0:1746142904.467831:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+36:2004:x1830962867183488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142904.467836:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6154 00010000:00010000:0.0:1746142904.467839:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142904.467840:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+36:2005:x1830962867183360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.467843:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 36 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.467846:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.467849:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 36 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.467855:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 36 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.467866:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 36 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.467882:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f800/0x2fa243e067ccb651 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89857 expref: 36 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.467966:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccb2f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8967b expref: 35 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.467966:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.467970:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.467978:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.467998:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867183488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.468004:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6153 00010000:00010000:1.0:1746142904.468057:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.468060:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142904.468064:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.468081:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867183360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 240us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.468086:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6154 00000100:00100000:0.0:1746142904.468239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.468273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.468386:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6157 00000100:00100000:0.0:1746142904.468391:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+63:2006:x1830962867183744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.468396:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.468399:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 63 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.468405:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 62 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.468674:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1c00/0x2fa243e067ccb539 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb897bd expref: 61 pid: 10924 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.468685:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.468687:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.468690:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.468700:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.468702:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+60:2006:x1830962867183744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 312us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.468706:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6157 00000100:00100000:0.0:1746142904.468713:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867183872 00000100:00100000:0.0:1746142904.468715:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867183872 00010000:00010000:0.0:1746142904.468721:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.468729:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6158 00000100:00100000:0.0:1746142904.468733:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+33:2006:x1830962867183872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142904.468738:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142904.468741:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.468748:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.468757:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097794800/0x2fa243e067ccb47c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89754 expref: 33 pid: 7231 timeout: 778 lvb_type: 0 00010000:00010000:0.0:1746142904.468764:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.468767:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.468773:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.468778:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142904.468792:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142904.468820:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867183872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.468826:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6158 00010000:00010000:2.0:1746142904.468883:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142904.468889:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000040:00080000:2.0:1746142904.469212:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].560, 88 off56984 00000004:00080000:2.0:1746142904.469218:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468318147ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469246:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].623, 88 off62624 00000004:00080000:2.0:1746142904.469250:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468349871ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469460:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].624, 88 off62712 00000004:00080000:2.0:1746142904.469465:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468564660ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469500:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].561, 88 off57072 00000004:00080000:2.0:1746142904.469503:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468603321ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469520:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].562, 88 off57160 00000004:00080000:2.0:1746142904.469523:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468623301ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469531:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].625, 88 off62800 00000004:00080000:2.0:1746142904.469533:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468633670ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469661:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].626, 88 off62888 00000004:00080000:2.0:1746142904.469665:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468764818ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469683:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].563, 88 off57248 00000004:00080000:2.0:1746142904.469686:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468785980ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469696:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].627, 88 off62976 00000004:00080000:2.0:1746142904.469699:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468798983ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469780:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].565, 88 off57432 00000004:00080000:2.0:1746142904.469784:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468883767ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469794:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].628, 88 off63064 00000004:00080000:2.0:1746142904.469796:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468896703ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469864:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].566, 88 off57520 00000004:00080000:2.0:1746142904.469868:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468968293ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469880:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].629, 88 off63152 00000004:00080000:2.0:1746142904.469882:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678468982603ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469889:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].567, 88 off57608 00000004:00080000:2.0:1746142904.469892:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678468992090ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.469920:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].630, 88 off63240 00000004:00080000:2.0:1746142904.469924:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678469024016ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469933:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].631, 88 off63328 00000004:00080000:2.0:1746142904.469935:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678469035008ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.469947:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].568, 88 off57696 00000004:00080000:2.0:1746142904.469949:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678469049665ns, next at 629431245375ns, rc = 0 00000100:00100000:1.0:1746142904.471600:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867738624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.471634:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.471654:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.471667:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.471682:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.471694:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.471706:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1746142904.471710:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867738752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.471722:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.471732:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739392:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746142904.471742:0:7230:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800949d1880 reply state ffff88009a970000 transno 8589936472 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:1.0:1746142904.471745:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746142904.471755:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6e00/0x2fa243e067ccbdd6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00000100:00100000:1.0:1746142904.471755:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739904:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746142904.471763:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.471765:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746142904.471767:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.471768:0:7230:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746142904.471783:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738624 00000100:00100000:1.0:1746142904.471784:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739264 00000100:00100000:2.0:1746142904.471788:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738624 00000100:00100000:1.0:1746142904.471788:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739264 00000100:00100000:1.0:1746142904.471810:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739776 00000100:00100000:1.0:1746142904.471811:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739776 00000100:00100000:0.0:1746142904.471865:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738752 00000100:00100000:0.0:1746142904.471869:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738752 00000100:00100000:2.0:1746142904.472140:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739392 00000100:00100000:1.0:1746142904.472140:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739904 00000100:00100000:2.0:1746142904.472143:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739392 00000100:00100000:1.0:1746142904.472143:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739904 00000100:00100000:1.0:1746142904.472152:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738368 00000100:00100000:1.0:1746142904.472153:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738368 00000100:00100000:2.0:1746142904.472155:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738496 00000100:00100000:2.0:1746142904.472156:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738496 00000100:00100000:1.0:1746142904.472163:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13728 00000100:00100000:1.0:1746142904.472169:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3764:x1830962867739264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.472269:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3764:x1830962867739264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (601us total) trans 21474841090 rc 0/0 00000100:00100000:0.0:1746142904.472274:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739136 00000100:00100000:0.0:1746142904.472277:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739136 00000100:00100000:1.0:1746142904.472373:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13728 00000100:00100000:2.0:1746142904.472375:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739648 00000100:00100000:2.0:1746142904.472378:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739648 00000100:00100000:1.0:1746142904.472386:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738112 00000100:00100000:2.0:1746142904.472387:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738240 00000100:00100000:1.0:1746142904.472388:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738112 00000100:00100000:2.0:1746142904.472389:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738240 00000100:00100000:2.0:1746142904.472397:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739008 00000100:00100000:1.0:1746142904.472397:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867738880 00000100:00100000:2.0:1746142904.472399:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739008 00000100:00100000:1.0:1746142904.472399:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867738880 00000100:00100000:1.0:1746142904.472407:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13729 00000100:00100000:1.0:1746142904.472412:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867738624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.472474:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867738624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (839us total) trans 17179873822 rc 0/0 00000100:00100000:1.0:1746142904.472490:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13729 00000100:00100000:1.0:1746142904.472501:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13730 00000100:00100000:1.0:1746142904.472506:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867739776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.472555:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867739776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (859us total) trans 17179873823 rc 0/0 00000100:00100000:1.0:1746142904.472559:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13730 00000100:00100000:1.0:1746142904.472568:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13731 00000100:00100000:1.0:1746142904.472572:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867738752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.472619:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867738752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (896us total) trans 21474841091 rc 0/0 00000100:00100000:1.0:1746142904.472624:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13731 00000100:00100000:1.0:1746142904.472633:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13732 00000100:00100000:1.0:1746142904.472637:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867739904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.472645:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13733 00000100:00100000:0.0:1746142904.472652:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867739392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.472687:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867739904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (919us total) trans 21474841092 rc 0/0 00000100:00100000:1.0:1746142904.472692:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13732 00000100:00100000:1.0:1746142904.472702:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13734 00000100:00100000:1.0:1746142904.472706:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3763:x1830962867738368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.472752:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867738368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (831us total) trans 21474841093 rc 0/0 00000100:00100000:1.0:1746142904.472756:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13734 00000100:00100000:1.0:1746142904.472765:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13735 00000100:00100000:1.0:1746142904.472768:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3763:x1830962867738496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.472792:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867739392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (1045us total) trans 21474841094 rc 0/0 00000100:00100000:0.0:1746142904.472798:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13733 00000100:00100000:0.0:1746142904.472808:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13736 00000100:00100000:0.0:1746142904.472812:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867739648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.472814:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867738496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (725us total) trans 17179873824 rc 0/0 00000100:00100000:1.0:1746142904.472819:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13735 00000100:00100000:1.0:1746142904.472828:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13737 00000100:00100000:1.0:1746142904.472832:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3763:x1830962867738112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.472893:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867738112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (652us total) trans 17179873826 rc 0/0 00000100:00100000:1.0:1746142904.472913:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13737 00000100:00100000:1.0:1746142904.472924:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13738 00000100:00100000:1.0:1746142904.472928:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3763:x1830962867738240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.472980:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867738240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (721us total) trans 21474841095 rc 0/0 00000100:00100000:1.0:1746142904.472985:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13738 00000100:00100000:1.0:1746142904.472994:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867739520 00000100:00100000:1.0:1746142904.472996:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867739520 00000100:00100000:1.0:1746142904.473004:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867740032 00000100:00100000:1.0:1746142904.473006:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867740032 00000100:00100000:1.0:1746142904.473012:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13739 00000100:00100000:1.0:1746142904.473016:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867738880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142904.473036:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142904.473039:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142904.473041:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142904.473043:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142904.473045:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:1.0:1746142904.473066:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867738880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (789us total) trans 21474841096 rc 0/0 00000100:00100000:0.0:1746142904.473067:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867739648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 255us (852us total) trans 17179873825 rc 0/0 00000100:00100000:1.0:1746142904.473072:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13739 00000100:00100000:0.0:1746142904.473075:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13736 00000100:00100000:1.0:1746142904.473081:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13740 00000100:00100000:1.0:1746142904.473085:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867739008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.473086:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13741 00000100:00100000:0.0:1746142904.473091:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867739136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142904.473119:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142904.473121:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.473123:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:1.0:1746142904.473125:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.473127:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00002000:00010000:0.0:1746142904.473129:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746142904.473131:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142904.473132:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142904.473134:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142904.473136:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:1.0:1746142904.473147:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3763:x1830962867739008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (853us total) trans 17179873827 rc 0/0 00000100:00100000:1.0:1746142904.473153:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13740 00000100:00100000:0.0:1746142904.473153:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3763:x1830962867739136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (958us total) trans 17179873828 rc 0/0 00000100:00100000:0.0:1746142904.473158:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13741 00000100:00100000:1.0:1746142904.473161:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13743 00000100:00100000:1.0:1746142904.473165:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867740032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.473167:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13744 00000100:00100000:0.0:1746142904.473171:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867740160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142904.473271:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:1.0:1746142904.473273:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.473275:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.473276:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.473277:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142904.473293:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867740032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (326us total) trans 17179873829 rc 0/0 00000100:00100000:1.0:1746142904.473297:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13743 00000004:00080000:1.0:1746142904.473322:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d2d80/2, rc 0, transno 21474841091 00000100:00100000:1.0:1746142904.473325:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867738752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.473331:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d0700/2, rc 0, transno 21474841094 00000100:00100000:1.0:1746142904.473334:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739392:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.473339:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d0380/2, rc 0, transno 21474841092 00000100:00100000:1.0:1746142904.473341:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739904:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.473347:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130376a00/2, rc 0, transno 17179873823 00000100:00100000:1.0:1746142904.473349:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.473355:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e518380/2, rc 0, transno 17179873822 00000100:00100000:1.0:1746142904.473357:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e518380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867738624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.473362:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d1180/2, rc 0, transno 21474841090 00000100:00100000:1.0:1746142904.473365:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867739264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.473802:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867740160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 629us (714us total) trans 17179873830 rc 0/0 00000100:00100000:0.0:1746142904.473809:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13744 00010000:00080000:2.0:1746142904.474085:0:7230:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746142904.474102:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32168:x1830962867182592:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 11540us (11758us total) trans 8589936472 rc 0/0 00000100:00100000:2.0:1746142904.474122:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14327 00000100:00100000:0.0:1746142904.475999:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.478675:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.480152:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.480238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.480266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.480313:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867184512 00000100:00100000:2.0:1746142904.480317:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867184512 00000100:00100000:2.0:1746142904.480338:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13746 00000100:00100000:2.0:1746142904.480343:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867184384:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.480350:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.480359:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880200/0x2fa243e067ccbdf9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d4a expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142904.480373:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406b7, atime: 0x681406b6, ctime: 0x681406b7, blocks: 0x808 00010000:00010000:2.0:1746142904.480384:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.480386:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.480392:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880200/0x2fa243e067ccbdf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d4a expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.480402:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c880200/0x2fa243e067ccbdf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d4a expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.480410:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880200, rc 0) 00000100:00100000:2.0:1746142904.480432:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867184384:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.480437:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13746 00000100:00100000:2.0:1746142904.480451:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13747 00000100:00100000:2.0:1746142904.480456:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867184512:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.480461:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.480619:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d51 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142904.480628:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406b8, atime: 0x681406b8, ctime: 0x681406b8, blocks: 0x800 00010000:00010000:2.0:1746142904.480636:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.480637:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.480641:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d51 expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.480649:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d51 expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.480656:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880e00, rc 0) 00000100:00100000:2.0:1746142904.480717:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867184512:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.480722:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13747 00000100:00100000:0.0:1746142904.481302:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.481331:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.481363:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.481369:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867184640 00000100:00100000:2.0:1746142904.481373:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867184640 00000100:00100000:2.0:1746142904.481387:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867184896 00000100:00100000:2.0:1746142904.481389:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867184896 00000100:00100000:0.0:1746142904.481394:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13748 00000100:00100000:0.0:1746142904.481401:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867184640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142904.481408:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142904.481410:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13750 00000100:00100000:2.0:1746142904.481415:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867184896:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142904.481416:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccbe07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d58 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.481422:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746142904.481426:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406b8, atime: 0x681406b8, ctime: 0x681406b8, blocks: 0x808 00010000:00010000:2.0:1746142904.481429:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880a00/0x2fa243e067ccbe15 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d66 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.481433:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.481435:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.481439:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d58 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746142904.481443:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406b8, atime: 0x681406b7, ctime: 0x681406b8, blocks: 0x1008 00010000:00010000:0.0:1746142904.481448:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d58 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.481450:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.481452:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.481454:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebd200, rc 0) 00010000:00010000:2.0:1746142904.481455:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880a00/0x2fa243e067ccbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d66 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.481465:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c880a00/0x2fa243e067ccbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d66 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.481471:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880a00, rc 0) 00000100:00100000:2.0:1746142904.481501:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867184896:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 85us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.481501:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867184640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.481508:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13748 00000100:00100000:2.0:1746142904.481511:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13750 00000100:00100000:0.0:1746142904.483558:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.483603:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867185024 00000100:00100000:2.0:1746142904.483608:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867185024 00000100:00100000:2.0:1746142904.483637:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13751 00000100:00100000:2.0:1746142904.483642:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867185024:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142904.483681:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.483702:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.483726:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.483738:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.483757:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.483769:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867185664 00000100:00100000:0.0:1746142904.483772:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867185664 00000100:00100000:0.0:1746142904.483786:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13753 00000100:00100000:0.0:1746142904.483791:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867185536:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142904.483874:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13755 00000100:00100000:1.0:1746142904.483881:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867185408:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142904.484075:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867185536:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 283us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.484081:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13753 00000100:00100000:0.0:1746142904.484090:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13756 00000100:00100000:0.0:1746142904.484094:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867185664:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142904.484122:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867185664:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.484127:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13756 00000100:00100000:2.0:1746142904.484372:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867185024:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 729us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.484377:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13751 00000100:00100000:1.0:1746142904.484477:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867185408:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 596us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.484490:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13755 00000100:00100000:0.0:1746142904.488398:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.489090:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.489115:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.489209:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867185792 00000100:00100000:0.0:1746142904.489211:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.489217:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867185792 00000100:00100000:0.0:1746142904.489230:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.489304:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.489346:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867186304 00000100:00100000:2.0:1746142904.489350:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867186304 00000100:00100000:2.0:1746142904.489367:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13757 00000100:00100000:1.0:1746142904.489393:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13759 00000100:00100000:1.0:1746142904.489398:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867186432:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142904.489448:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867185920:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142904.489495:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867185920:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 121us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.489501:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13757 00000100:00100000:2.0:1746142904.489513:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13761 00000100:00100000:2.0:1746142904.489518:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867186304:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142904.489548:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867186304:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 30us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.489555:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13761 00000100:00100000:1.0:1746142904.489626:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867186432:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 228us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.489632:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13759 00000100:00100000:0.0:1746142904.492108:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.492258:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867186560 00000100:00100000:1.0:1746142904.492265:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867186560 00000100:00100000:1.0:1746142904.492305:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13763 00000100:00100000:1.0:1746142904.492311:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867186560:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:1.0:1746142904.492444:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142904.492447:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.492449:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:1.0:1746142904.492450:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.492452:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746142904.492509:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867186560:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 197us (407us total) trans 17179873831 rc 0/0 00000100:00100000:1.0:1746142904.492515:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13763 00000100:00100000:0.0:1746142904.494046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.494365:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867186688 00000100:00100000:1.0:1746142904.494371:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867186688 00000100:00100000:1.0:1746142904.494407:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13764 00000100:00100000:1.0:1746142904.494413:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867186688:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:1.0:1746142904.494541:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142904.494544:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.494546:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.494547:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.494549:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142904.494590:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867186688:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 177us (548us total) trans 21474841098 rc 0/0 00000100:00100000:1.0:1746142904.494596:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13764 00000100:00100000:0.0:1746142904.498151:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.498218:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867186944 00000100:00100000:2.0:1746142904.498225:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867186944 00000100:00100000:2.0:1746142904.498276:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4141 00000100:00100000:2.0:1746142904.498283:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867186944:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142904.498310:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.498325:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.498326:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.498331:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.498342:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.502605:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.502646:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.502683:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.502701:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867187456 00000100:00100000:1.0:1746142904.502702:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867187200 00000100:00100000:1.0:1746142904.502708:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867187200 00000100:00100000:0.0:1746142904.502708:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867187456 00000100:00100000:0.0:1746142904.503325:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867187712 00000100:00100000:0.0:1746142904.503330:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867187712 00000100:00100000:1.0:1746142904.503702:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4142 00000100:00100000:1.0:1746142904.503712:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867187456:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142904.503742:0:13318:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.503754:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.503755:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142904.503757:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4143 00010000:00010000:1.0:1746142904.503759:0:13318:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.503765:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867187200:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142904.503771:0:13318:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.503782:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.503851:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.503853:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.503856:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.503863:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.504102:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4144 00000100:00100000:0.0:1746142904.504109:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867187712:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142904.504251:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.504259:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.504261:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142904.504264:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.504273:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.504432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.505018:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.505031:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867188224 00000100:00100000:2.0:1746142904.505034:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867188224 00000100:00100000:2.0:1746142904.505056:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4146 00000100:00100000:2.0:1746142904.505060:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867188224:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142904.505074:0:20331:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccbe3f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505081:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.505082:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.505085:0:20331:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccbe3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505092:0:20331:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccbe3f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.505180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142904.505746:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505754:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505761:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505767:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142904.505771:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505778:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505791:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.505798:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c881c00/0x2fa243e067ccbe1c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.505850:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867186944:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 7567us (7706us total) trans 0 rc 1036288/1036288 00000100:00100000:2.0:1746142904.505857:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4141 00000100:00100000:1.0:1746142904.505869:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.505885:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867188736 00000100:00100000:1.0:1746142904.505888:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867188736 00000100:00100000:1.0:1746142904.505929:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4148 00000100:00100000:1.0:1746142904.505935:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962867188736:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142904.505950:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.505957:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.505958:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.505961:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.505968:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508573:0:13318:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508585:0:13318:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508591:0:13318:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508600:0:13318:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3921200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142904.508603:0:13318:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508609:0:13318:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508622:0:13318:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.508627:0:13318:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067ccbe23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.508974:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+19:2005:x1830962867187456:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 5260us (6323us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.508982:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4142 00000100:00100000:1.0:1746142904.512233:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867740288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746142904.512284:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.512500:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867740288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1746142904.515723:0:29472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.515738:0:29472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.515744:0:29472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.515749:0:29472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c880c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142904.515752:0:29472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.515758:0:29472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.515772:0:29472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.515781:0:29472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067ccbe2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.515851:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867187200:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 12084us (13251us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142904.515858:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4143 00010000:00010000:1.0:1746142904.526470:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.526494:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.526501:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.526507:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd83e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142904.526511:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.526517:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.526533:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.526538:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccbe31 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.527392:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867187712:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 23278us (24702us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142904.527402:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4144 00000100:00100000:2.0:1746142904.529161:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867740416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746142904.529206:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.529527:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867740416:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1746142904.537942:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.537950:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.537956:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538148:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538155:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538160:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538165:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea53200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142904.538167:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538173:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538181:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.538186:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53200/0x2fa243e067ccbe46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.538195:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142904.538199:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.538205:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.538214:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.538215:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867188480:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 32642us (33035us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746142904.538219:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094714600/0x2fa243e067ccbe4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.538220:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4147 00000100:00100000:1.0:1746142904.538261:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867188736:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 32325us (32391us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142904.538266:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4148 00000100:00100000:0.0:1746142904.548672:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.550283:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867188992 00000100:00100000:1.0:1746142904.550294:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867188992 00000100:00100000:1.0:1746142904.550352:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14330 00000100:00100000:1.0:1746142904.550360:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:32168:x1830962867188992:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:1.0:1746142904.550400:0:22383:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.550423:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea53000/0x2fa243e067ccbdeb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d3c expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.550452:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.550456:0:22383:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142904.550507:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.550517:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.550525:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00010000:1.0:1746142904.550606:0:22383:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800924a3100 reply state ffff88009b34a000 transno 8589936473 ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.550621:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.550625:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.550627:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746142904.550629:0:22383:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746142904.550690:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:32168:x1830962867188992:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 331us (2026us total) trans 8589936473 rc 0/0 00000100:00100000:1.0:1746142904.550696:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14330 00000100:00100000:0.0:1746142904.552629:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.552944:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867189120 00000100:00100000:2.0:1746142904.552952:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867189120 00000100:00100000:2.0:1746142904.553332:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13765 00000100:00100000:2.0:1746142904.553340:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:32168:x1830962867189120:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.553352:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.553364:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d6d expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.553386:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbdf2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d43 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.553398:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.553399:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.553402:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.553427:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbdf2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d43 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.553436:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53e00/0x2fa243e067ccbdf2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d43 expref: 11 pid: 1853 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.553446:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130374e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867740544:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.555411:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.555438:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867740544:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.555457:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.555470:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880800, rc 0) 00000100:00100000:2.0:1746142904.555517:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:32168:x1830962867189120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2177us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.555524:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13765 00000100:00100000:0.0:1746142904.555864:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.559610:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.559684:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867189376 00000100:00100000:2.0:1746142904.559691:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867189376 00000100:00100000:2.0:1746142904.559770:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13766 00000100:00100000:2.0:1746142904.559778:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:32168:x1830962867189376:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.559793:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.559808:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d74 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.559829:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c880200/0x2fa243e067ccbdf9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d4a expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.559836:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.559837:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.559840:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 14 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.559862:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c880200/0x2fa243e067ccbdf9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d4a expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.559871:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c880200/0x2fa243e067ccbdf9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d4a expref: 14 pid: 9578 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.559880:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130374e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867740800:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.560321:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.562191:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867740800:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.562215:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 14 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.562228:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881c00, rc 0) 00000100:00100000:2.0:1746142904.562275:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:32168:x1830962867189376:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2497us (2667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.562283:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13766 00000100:00100000:0.0:1746142904.563188:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.566303:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.570669:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.570755:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867189760 00000100:00100000:2.0:1746142904.570761:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867189760 00010000:00010000:2.0:1746142904.570784:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d51 expref: 14 pid: 9578 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.570811:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6161 00000100:00100000:2.0:1746142904.570818:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867189760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.570827:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.570841:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d51 expref: 14 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.570851:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d51 expref: 14 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.570868:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c880e00/0x2fa243e067ccbe00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d51 expref: 14 pid: 9578 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.570887:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.570889:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.570894:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.570923:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.570949:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.570959:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130375180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867741184:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142904.574357:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.575209:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867189888 00000100:00100000:2.0:1746142904.575216:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867189888 00000100:00100000:2.0:1746142904.575246:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13768 00000100:00100000:2.0:1746142904.575252:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:32168:x1830962867189888:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.575266:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.575279:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d82 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.575301:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccbe07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d58 expref: 11 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.575308:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.575309:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.575313:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.575334:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccbe07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d58 expref: 11 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.575345:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccbe07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d58 expref: 11 pid: 9580 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.575359:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130377b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867741312:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.575427:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.577591:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130377b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867741312:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.577615:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.577636:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880400, rc 0) 00000100:00100000:2.0:1746142904.578030:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:32168:x1830962867189888:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2776us (3676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.578037:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13768 00000100:00100000:0.0:1746142904.578893:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.582304:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.582543:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867190144 00000100:00100000:2.0:1746142904.582551:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867190144 00000100:00100000:2.0:1746142904.582602:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13769 00000100:00100000:2.0:1746142904.582609:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:32168:x1830962867190144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.582630:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.582645:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d89 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.582668:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccbe0e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d5f expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.582676:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.582677:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.582680:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d89 expref: 12 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.582709:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccbe0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d5f expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.582719:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccbe0e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d5f expref: 12 pid: 1852 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.582729:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130377b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867741568:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.582794:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.584883:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.584988:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130377b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867741568:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.585009:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d89 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.585022:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880e00, rc 0) 00000100:00100000:2.0:1746142904.585054:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:32168:x1830962867190144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2445us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.585062:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13769 00000100:00100000:0.0:1746142904.588207:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.588466:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867190400 00000100:00100000:2.0:1746142904.588472:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867190400 00000100:00100000:2.0:1746142904.588936:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13770 00000100:00100000:2.0:1746142904.588944:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:32168:x1830962867190400:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142904.588959:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.588972:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89d90 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.588999:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c880a00/0x2fa243e067ccbe15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d66 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.589006:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.589007:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.589010:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 14 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.589034:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c880a00/0x2fa243e067ccbe15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d66 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.589044:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c880a00/0x2fa243e067ccbe15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d66 expref: 14 pid: 1853 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.589053:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130377b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867741824:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.589104:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.592087:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130377b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867741824:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.592116:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 14 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.592132:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881200, rc 0) 00000100:00100000:2.0:1746142904.592184:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:32168:x1830962867190400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3240us (3982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.592191:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13770 00000100:00100000:0.0:1746142904.592251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.596450:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.596624:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867190784 00000100:00100000:2.0:1746142904.596630:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867190784 00000100:00100000:2.0:1746142904.596657:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13771 00000100:00100000:2.0:1746142904.596663:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867190784:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142904.596771:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142904.596774:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142903 -> 1746142904 00002000:00010000:2.0:1746142904.596776:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142902 -> 1746142905 00002000:00010000:2.0:1746142904.596777:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142903 -> 1746142905 00002000:00010000:2.0:1746142904.596779:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142904.596796:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867190784:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 134us (348us total) trans 17179873832 rc 0/0 00000100:00100000:2.0:1746142904.596801:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13771 00000100:00100000:2.0:1746142904.597488:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.597503:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.597519:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867190912 00000100:00100000:1.0:1746142904.597523:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867190912 00000100:00100000:2.0:1746142904.597529:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.597778:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867190656 00000100:00100000:1.0:1746142904.597782:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867190656 00000100:00100000:1.0:1746142904.597796:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867191168 00000100:00100000:1.0:1746142904.597797:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867191168 00000100:00100000:1.0:1746142904.597808:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13772 00000100:00100000:1.0:1746142904.597813:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867190912:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142904.597875:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142904.597878:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.597879:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142904 -> 1746142905 00002000:00010000:1.0:1746142904.597881:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142904 -> 1746142905 00002000:00010000:1.0:1746142904.597883:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746142904.598297:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867190912:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 482us (821us total) trans 17179873833 rc 0/0 00000100:00100000:1.0:1746142904.598303:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13772 00000100:00100000:2.0:1746142904.598395:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.598811:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.598823:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867191296 00000100:00100000:1.0:1746142904.598826:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867191296 00000100:00100000:1.0:1746142904.598841:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13776 00000100:00100000:1.0:1746142904.598845:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867191296:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142904.598880:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142904.598881:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.598883:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142903 -> 1746142905 00002000:00010000:1.0:1746142904.598884:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142904 -> 1746142905 00002000:00010000:1.0:1746142904.598886:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746142904.598924:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867191296:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 79us (115us total) trans 17179873834 rc 0/0 00000100:00100000:1.0:1746142904.598931:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13776 00000100:00100000:0.0:1746142904.601795:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.602157:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867191552 00000100:00100000:2.0:1746142904.602164:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867191552 00000100:00100000:2.0:1746142904.602194:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5200 00000100:00100000:2.0:1746142904.602200:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:32168:x1830962867191552:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:2.0:1746142904.602244:0:7233:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x55:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067ccbd9e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d2e expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.602275:0:7233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067ccbe85 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142904.602284:0:7233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbddd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d35 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.602294:0:7233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067ccbe85 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142904.602317:0:7233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbddd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d35 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.602326:0:7233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52600/0x2fa243e067ccbddd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d35 expref: 10 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.602336:0:7233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7233:1830962867742080:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.602415:0:7233:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130102e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.605439:0:7233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7233:1830962867742080:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.605458:0:7233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067ccbe85 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00000100:00100000:0.0:1746142904.607375:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142904.607930:0:7233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067ccbe85 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142904.607938:0:7233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067ccbe85 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00000040:00080000:2.0:1746142904.608152:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].569, 88 off57784 00000004:00080000:2.0:1746142904.608157:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607257163ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608184:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].632, 88 off63416 00000004:00080000:2.0:1746142904.608187:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607287341ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608214:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].633, 88 off63504 00000004:00080000:2.0:1746142904.608217:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607316970ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608225:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].570, 88 off57872 00000004:00080000:2.0:1746142904.608228:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607328440ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608236:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].571, 88 off57960 00000004:00080000:2.0:1746142904.608238:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607338327ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608246:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].634, 88 off63592 00000004:00080000:2.0:1746142904.608248:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607348498ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608255:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].635, 88 off63680 00000004:00080000:2.0:1746142904.608257:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607357636ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608264:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].572, 88 off58048 00000004:00080000:2.0:1746142904.608266:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607366331ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608273:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].636, 88 off63768 00000004:00080000:2.0:1746142904.608275:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607375277ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608282:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].573, 88 off58136 00000004:00080000:2.0:1746142904.608285:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607384727ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608292:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].637, 88 off63856 00000004:00080000:2.0:1746142904.608294:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607393913ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608301:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].574, 88 off58224 00000004:00080000:2.0:1746142904.608303:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607403397ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608310:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].638, 88 off63944 00000004:00080000:2.0:1746142904.608313:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607412730ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608320:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].575, 88 off58312 00000004:00080000:2.0:1746142904.608322:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607422060ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142904.608329:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].639, 88 off64032 00000004:00080000:2.0:1746142904.608331:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607431617ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608338:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].640, 88 off64120 00000004:00080000:2.0:1746142904.608341:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678607440901ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142904.608348:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].576, 88 off58400 00000004:00080000:2.0:1746142904.608351:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678607451011ns, next at 629431245375ns, rc = 0 00010000:00010000:0.0:1746142904.610938:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.610947:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.610956:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.610960:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984b1600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142904.610964:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.610970:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.610983:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.610985:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142904.610988:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.610992:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccbe54 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00000100:00100000:2.0:1746142904.611119:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867742592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.611132:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867742464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.611164:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.611188:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867742976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.611203:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611216:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.611219:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867743488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611234:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867743104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.611235:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.611247:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867744000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611259:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.611264:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611272:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867743616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.611283:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.611285:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611297:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867744128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.611299:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611311:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.611312:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.611324:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611335:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742464 00000100:00100000:1.0:1746142904.611335:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611341:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742464 00000100:00100000:1.0:1746142904.611348:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.611354:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611361:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742976 00000100:00100000:2.0:1746142904.611363:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742976 00000100:00100000:1.0:1746142904.611365:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611369:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742592 00000100:00100000:2.0:1746142904.611370:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742592 00000100:00100000:1.0:1746142904.611374:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746142904.611375:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743488 00000100:00100000:2.0:1746142904.611376:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743488 00000100:00100000:1.0:1746142904.611378:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.611382:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743104 00000100:00100000:2.0:1746142904.611383:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743104 00000100:00100000:2.0:1746142904.611388:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867744000 00000100:00100000:2.0:1746142904.611389:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867744000 00000100:00100000:1.0:1746142904.611390:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611395:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743616 00000100:00100000:2.0:1746142904.611396:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743616 00000100:00100000:1.0:1746142904.611396:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.611402:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742336 00000100:00100000:2.0:1746142904.611403:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742336 00000100:00100000:1.0:1746142904.611406:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611410:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867744128 00000100:00100000:2.0:1746142904.611411:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867744128 00000100:00100000:1.0:1746142904.611411:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611417:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742848 00000100:00100000:2.0:1746142904.611418:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742848 00000100:00100000:1.0:1746142904.611423:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611424:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743360 00000100:00100000:2.0:1746142904.611426:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743360 00000100:00100000:1.0:1746142904.611428:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611433:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743872 00000100:00100000:2.0:1746142904.611435:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743872 00000100:00100000:2.0:1746142904.611439:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742208 00000100:00100000:1.0:1746142904.611439:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.611441:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742208 00000100:00100000:2.0:1746142904.611446:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867742720 00000100:00100000:2.0:1746142904.611448:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867742720 00000100:00100000:2.0:1746142904.611453:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743232 00000100:00100000:2.0:1746142904.611454:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743232 00000100:00100000:1.0:1746142904.611455:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867743744 00000100:00100000:1.0:1746142904.611458:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867743744 00000100:00100000:2.0:1746142904.611463:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13777 00000100:00100000:2.0:1746142904.611468:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867742464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.611472:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13778 00000100:00100000:1.0:1746142904.611491:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867742976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.611558:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13779 00000100:00100000:2.0:1746142904.611564:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867742592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142904.611574:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142904.611577:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.611579:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.611580:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.611582:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142904.611604:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3764:x1830962867742976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (400us total) trans 21474841103 rc 0/0 00000100:00100000:1.0:1746142904.611610:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13778 00000100:00100000:1.0:1746142904.611622:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13780 00000100:00100000:2.0:1746142904.611625:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867742592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (408us total) trans 21474841104 rc 0/0 00000100:00100000:1.0:1746142904.611627:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867743488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142904.611630:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13779 00000100:00100000:2.0:1746142904.611640:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13781 00000100:00100000:2.0:1746142904.611644:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867743104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142904.611674:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142904.611677:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.611678:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.611679:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.611681:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746142904.611700:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e548c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867743104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (439us total) trans 21474841105 rc 0/0 00000100:00100000:1.0:1746142904.611700:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867743488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (465us total) trans 17179873835 rc 0/0 00000100:00100000:2.0:1746142904.611705:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13781 00000100:00100000:1.0:1746142904.612298:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13780 00000100:00100000:0.0:1746142904.612318:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13782 00000100:00100000:0.0:1746142904.612329:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867744000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.612396:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867744000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1131us total) trans 17179873836 rc 0/0 00000100:00100000:0.0:1746142904.612401:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13782 00000100:00100000:0.0:1746142904.612410:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13783 00000100:00100000:0.0:1746142904.612414:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867743616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142904.612449:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142904.612452:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142904.612454:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142904.612455:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142904.612457:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142904.612475:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867743616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (1188us total) trans 17179873837 rc 0/0 00000100:00100000:0.0:1746142904.612494:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13783 00000100:00100000:0.0:1746142904.612503:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13784 00000100:00100000:0.0:1746142904.612506:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867742336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142904.612540:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142904.612542:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:0.0:1746142904.612543:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142904.612545:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142904.612546:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142904.612567:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867742336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (1267us total) trans 21474841106 rc 0/0 00000100:00100000:0.0:1746142904.612576:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13784 00000100:00100000:0.0:1746142904.612587:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13785 00000100:00100000:0.0:1746142904.612993:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867744128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142904.613028:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142904.613030:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142904.613031:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142904.613032:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142904.613034:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:0.0:1746142904.613051:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867744128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1739us total) trans 17179873838 rc 0/0 00000004:00080000:1.0:1746142904.613589:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d4c1500/2, rc 0, transno 17179873835 00000100:00100000:1.0:1746142904.613603:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867743488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.613613:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012e67aa00/2, rc 0, transno 17179873836 00000100:00100000:1.0:1746142904.613616:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867744000:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.613624:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938de680/2, rc 0, transno 21474841103 00000100:00100000:1.0:1746142904.613627:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867742976:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.613642:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938df100/2, rc 0, transno 21474841108 00000100:00100000:1.0:1746142904.613645:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.613651:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938dca80/2, rc 0, transno 21474841109 00000100:00100000:1.0:1746142904.613653:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742720:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.613659:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130376d80/2, rc 0, transno 17179873841 00000100:00100000:1.0:1746142904.613661:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743232:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.613669:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d4c3480/2, rc 0, transno 17179873842 00000100:00100000:1.0:1746142904.613672:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.613677:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938dc700/2, rc 0, transno 21474841106 00000100:00100000:1.0:1746142904.613679:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.613684:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938df480/2, rc 0, transno 21474841107 00000100:00100000:1.0:1746142904.613687:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867742848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.613692:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130375180/2, rc 0, transno 17179873839 00000100:00100000:1.0:1746142904.613694:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142904.613698:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d4c1180/2, rc 0, transno 17179873840 00000100:00100000:1.0:1746142904.613700:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867743872:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142904.613727:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:1.0:1746142904.613730:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.613732:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.613733:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.613735:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142904.613917:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13785 00000100:00100000:2.0:1746142904.613981:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867744256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.614018:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867742464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2550us (2854us total) trans 21474841102 rc 0/0 00000100:00100000:1.0:1746142904.614023:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13777 00000004:00080000:0.0:1746142904.614032:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938de300/2, rc 0, transno 21474841102 00000100:00100000:0.0:1746142904.614035:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867742464:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.614160:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.614260:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867744256 00000100:00100000:1.0:1746142904.614265:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867744256 00000100:00100000:1.0:1746142904.614292:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13793 00000100:00100000:1.0:1746142904.614296:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3762:x1830962867744256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.614371:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3762:x1830962867744256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (211us total) trans 17179873843 rc 0/0 00000100:00100000:1.0:1746142904.614376:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13793 00000100:00100000:0.0:1746142904.616060:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.619160:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.633266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.638673:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.638987:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867192576 00000100:00100000:1.0:1746142904.638995:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867192576 00000100:00100000:1.0:1746142904.639044:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14333 00000100:00100000:1.0:1746142904.639052:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32180:x1830962867192576:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.639072:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.639086:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3400/0x2fa243e067ccbeb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89da5 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.639161:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067ccbebd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.639172:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067ccbebd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.639180:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067ccbebd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:1.0:1746142904.639189:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142904.639266:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3400/0x2fa243e067ccbeb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89da5 expref: 31 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.639328:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067ccbebd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89da5 expref: 30 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.639335:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.639338:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746142904.639340:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2c00, rc 0) 00000100:00100000:1.0:1746142904.639437:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32180:x1830962867192576:12345-192.168.204.50@tcp:101:cat.0 Request processed in 385us (771us total) trans 8589936477 rc 0/0 00000100:00100000:1.0:1746142904.639443:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14333 00000100:00100000:0.0:1746142904.643547:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.643596:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.643826:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867192960 00000100:00100000:2.0:1746142904.643831:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867192960 00000100:00100000:2.0:1746142904.643854:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13794 00000100:00100000:2.0:1746142904.643858:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32180:x1830962867192960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.643866:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.643875:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89db3 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.643889:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 12 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.643896:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142904.643897:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142904.643915:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.643939:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 12 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.643950:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.643960:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867744384:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.644020:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.645951:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867744384:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.645972:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 31 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.645982:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322800, rc 0) 00000100:00100000:2.0:1746142904.646011:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32180:x1830962867192960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2151us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.646017:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13794 00000100:00100000:0.0:1746142904.646453:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.647540:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867193088 00000100:00100000:1.0:1746142904.647547:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867193088 00010000:00010000:1.0:1746142904.647572:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 13 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.647604:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6166 00000100:00100000:1.0:1746142904.647611:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867193088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.647620:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.647636:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 13 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.647645:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 13 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.647665:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880800/0x2fa243e067ccbe5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d6d expref: 13 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.647676:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.647677:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.647683:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.647690:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.647714:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 30 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.647724:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867744512:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142904.647781:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.648316:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.651733:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867193344 00000100:00100000:2.0:1746142904.651744:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867193344 00000100:00100000:2.0:1746142904.651810:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14335 00000100:00100000:2.0:1746142904.651818:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32181:x1830962867193344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.651839:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.651854:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322000/0x2fa243e067ccbef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89dba expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.651946:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142904.651957:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142904.651965:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142904.651974:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142904.652047:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131322000/0x2fa243e067ccbef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 12 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.652064:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.652070:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.652072:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746142904.652075:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131323e00, rc 0) 00000100:00100000:2.0:1746142904.652134:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32181:x1830962867193344:12345-192.168.204.50@tcp:101:cat.0 Request processed in 317us (3819us total) trans 8589936479 rc 0/0 00000100:00100000:2.0:1746142904.652140:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14335 00000100:00100000:2.0:1746142904.652610:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.652834:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867193600 00000100:00100000:0.0:1746142904.652838:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867193600 00002000:00100000:0.0:1746142904.652864:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8801355d3480 x1830962867193600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142904.652873:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d3480 with x1830962867193600 ext(0->1048575) 00002000:00010000:0.0:1746142904.652876:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d3480 00000100:00100000:0.0:1746142904.652917:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4149 00000100:00100000:0.0:1746142904.652923:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867193600:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142904.653766:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867744512:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142904.653785:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.653830:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867193088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6218us (7376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.653838:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6166 00000100:00100000:0.0:1746142904.655731:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.655791:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867193728 00000100:00100000:2.0:1746142904.655797:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867193728 00000100:00100000:2.0:1746142904.655828:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13795 00000100:00100000:2.0:1746142904.655834:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+17:32181:x1830962867193728:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.655846:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.655859:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89dc1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.655878:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.655880:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.655886:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.655916:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.655925:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131323600, rc 0) 00000100:00100000:2.0:1746142904.655954:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+18:32181:x1830962867193728:12345-192.168.204.50@tcp:101:cat.0 Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.655960:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13795 00000100:00100000:0.0:1746142904.662887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.662945:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.663077:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867193600:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10152us (10466us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142904.663087:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4149 00002000:00100000:0.0:1746142904.663096:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8801355d3480 x1830962867193600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142904.663104:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d3480 with x1830962867193600 ext(0->1048575) 00002000:00010000:0.0:1746142904.663110:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d3480 00000100:00100000:1.0:1746142904.663194:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867193984 00000100:00100000:1.0:1746142904.663201:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867193984 00000100:00100000:1.0:1746142904.663229:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867194240 00000100:00100000:1.0:1746142904.663231:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867194240 00000100:00100000:1.0:1746142904.663246:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14336 00000100:00100000:1.0:1746142904.663253:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32175:x1830962867193984:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142904.663282:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.663284:0:22383:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746142904.663304:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067ccbebd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89da5 expref: 30 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663323:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0e00/0x2fa243e067ccbea8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d9e expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663332:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.663336:0:22383:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142904.663345:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a400/0x2fa243e067ccbf11 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89dc8 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663379:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.663389:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b600/0x2fa243e067ccbee7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dac expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663395:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 7 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663400:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663404:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.663433:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663443:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 11 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.663452:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867744640:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.663527:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 7 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663533:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 7 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.663541:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867744768:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.663562:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b600/0x2fa243e067ccbee7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dac expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.663568:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b600/0x2fa243e067ccbee7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dac expref: 11 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.663575:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867744896:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.663589:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.663643:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867194368 00000100:00100000:2.0:1746142904.663647:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14337 00000100:00100000:0.0:1746142904.663647:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867194368 00000100:00100000:2.0:1746142904.663653:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:32176:x1830962867194240:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142904.663665:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.663667:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00000100:00100000:0.0:1746142904.663668:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14338 00010000:00010000:2.0:1746142904.663672:0:10924:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 12 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.663673:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:32181:x1830962867194368:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142904.663678:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142904.663683:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89dd6 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.663687:0:10924:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b600/0x2fa243e067ccbee7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dac expref: 12 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.663694:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.663696:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.663701:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.663705:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142904.663709:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccbf26 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89dcf expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.663712:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.663718:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.663724:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142904.663727:0:13326:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.663730:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.663735:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142904.663744:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.663752:0:10924:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.663752:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.663754:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142904.663757:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.663761:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fba00, rc 0) 00000100:00100000:0.0:1746142904.663781:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:32181:x1830962867194368:12345-192.168.204.50@tcp:101:cat.0 Request processed in 108us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.663786:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14338 00010000:00010000:2.0:1746142904.663871:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142904.665882:0:22383:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@ffff880088d62d80 x1830962867744640) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 13 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.665928:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323e00/0x2fa243e067ccbefc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dba expref: 13 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.665946:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867744640:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.665959:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867744768:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.665966:0:22383:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@ffff880088d60e00 x1830962867744896) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b600/0x2fa243e067ccbee7 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dac expref: 12 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.665974:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b600/0x2fa243e067ccbee7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dac expref: 12 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.665982:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867744896:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142904.665998:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.666001:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.666007:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.666013:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00000100:00100000:0.0:1746142904.666071:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.666247:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867194496 00000100:00100000:1.0:1746142904.666252:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867194496 00010000:00010000:1.0:1746142904.666278:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 8 pid: 7230 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.666308:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6167 00000100:00100000:1.0:1746142904.666314:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867194496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.666326:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.666330:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 8 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.666338:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 8 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.666350:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067ccbe8c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d97 expref: 8 pid: 7230 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.666358:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142904.666361:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.666367:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.666372:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142904.666378:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142904.666383:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.666395:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142904.666471:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142904.666485:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 22383 initiator: MDT0 00000004:02000000:0.0:1746142904.666527:0:22383:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000100:00100000:1.0:1746142904.667251:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867194496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 933us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.667260:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6167 00000040:00080000:0.0:1746142904.673116:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].577, 88 off58488 00000004:00080000:0.0:1746142904.673123:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672223376ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.673143:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].641, 88 off64208 00000004:00080000:0.0:1746142904.673146:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672246295ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673157:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].642, 88 off64296 00000004:00080000:0.0:1746142904.673159:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672259317ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673167:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].578, 88 off58576 00000004:00080000:0.0:1746142904.673169:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672269456ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.673177:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].579, 88 off58664 00000004:00080000:0.0:1746142904.673179:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672278960ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.673185:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].643, 88 off64384 00000004:00080000:0.0:1746142904.673188:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672288083ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673195:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].644, 88 off64472 00000004:00080000:0.0:1746142904.673198:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672297993ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673205:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].580, 88 off58752 00000004:00080000:0.0:1746142904.673207:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672307350ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.673214:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].645, 88 off64560 00000004:00080000:0.0:1746142904.673216:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672316406ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673224:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].581, 88 off58840 00000004:00080000:0.0:1746142904.673226:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672326078ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.673232:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].646, 88 off64648 00000004:00080000:0.0:1746142904.673239:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672335166ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673246:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].582, 88 off58928 00000004:00080000:0.0:1746142904.673249:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672349403ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.673257:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].647, 88 off64736 00000004:00080000:0.0:1746142904.673259:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678672359763ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.673267:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].583, 88 off59016 00000004:00080000:0.0:1746142904.673269:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678672369163ns, next at 629431245375ns, rc = 0 00000100:00100000:2.0:1746142904.673355:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.673377:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867194624 00000100:00100000:2.0:1746142904.673384:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867194624 00000100:00100000:2.0:1746142904.673415:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13796 00000100:00100000:2.0:1746142904.673421:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32180:x1830962867194624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.673434:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.673446:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ddd expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.673469:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.673489:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142904.673490:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142904.673494:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.673519:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.673531:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 15 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.673542:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867745152:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.674008:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fcc0 going to sleep for 11 seconds 00000040:00080000:0.0:1746142904.674105:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].648, 88 off64824 00000004:00080000:0.0:1746142904.674111:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678673210785ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.674250:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].649, 88 off64912 00000004:00080000:0.0:1746142904.674253:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678673353193ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.674262:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].584, 88 off59104 00000004:00080000:0.0:1746142904.674264:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678673364561ns, next at 629431245375ns, rc = 0 00000100:00100000:2.0:1746142904.675228:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867745152:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.675545:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.675566:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322000, rc 0) 00000100:00100000:2.0:1746142904.675600:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32180:x1830962867194624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2178us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.675608:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13796 00000100:00100000:0.0:1746142904.676054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.676222:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867194752 00000100:00100000:1.0:1746142904.676229:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867194752 00010000:00010000:1.0:1746142904.676251:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 16 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.676412:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6168 00000100:00100000:1.0:1746142904.676419:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867194752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142904.676430:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142904.676448:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 16 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.676458:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 16 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.676485:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccbe62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d74 expref: 16 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:1.0:1746142904.676496:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.676497:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.676502:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.676510:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.677007:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.677022:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867745280:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142904.677289:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.682412:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.682517:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867745280:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142904.682533:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142904.682564:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867194752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6146us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.682573:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6168 00000100:00100000:2.0:1746142904.682638:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867194880 00000100:00100000:2.0:1746142904.682643:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867194880 00000100:00100000:2.0:1746142904.682668:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14339 00000100:00100000:2.0:1746142904.682673:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32180:x1830962867194880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.682689:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.682703:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89de4 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.682741:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.682747:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.682760:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.682767:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.682775:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.682778:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142904.682781:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.682787:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712ac00, rc 0) 00000100:00100000:2.0:1746142904.682803:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32180:x1830962867194880:12345-192.168.204.50@tcp:101:cat.0 Request processed in 129us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.682808:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14339 00010000:00010000:0.0:1746142904.684535:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 29 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.684545:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.684547:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746142904.684550:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142904.684556:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 29 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.684563:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.684574:0:22383:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60080000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.684580:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60080000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.684585:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142904.684602:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 29 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.684612:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 29 pid: 22383 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.684622:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867746560:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142904.684657:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.684939:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867747072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.684959:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.684970:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867747584:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.684980:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.684988:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746142904.684992:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867746944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.685002:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.685010:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867747456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.685020:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.685034:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867747072 00000100:00100000:1.0:1746142904.685036:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867747072 00000100:00100000:1.0:1746142904.685049:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867747584 00000100:00100000:1.0:1746142904.685051:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867747584 00000100:00100000:1.0:1746142904.685058:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867746944 00000100:00100000:1.0:1746142904.685060:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867746944 00000100:00100000:1.0:1746142904.685067:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867747456 00000100:00100000:1.0:1746142904.685068:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867747456 00000100:00100000:1.0:1746142904.685077:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13806 00000100:00100000:1.0:1746142904.685082:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867747072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.685151:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867747072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (191us total) trans 21474841110 rc 0/0 00000100:00100000:1.0:1746142904.685156:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13806 00000100:00100000:1.0:1746142904.685165:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13807 00000100:00100000:1.0:1746142904.685169:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867747584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.685213:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867747584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (231us total) trans 21474841111 rc 0/0 00000100:00100000:1.0:1746142904.685218:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13807 00000100:00100000:1.0:1746142904.685226:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13808 00000100:00100000:1.0:1746142904.685229:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867746944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142904.685263:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:1.0:1746142904.685266:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.685268:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.685269:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.685271:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:1.0:1746142904.685285:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867746944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (282us total) trans 21474841112 rc 0/0 00000100:00100000:1.0:1746142904.685290:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13808 00000100:00100000:1.0:1746142904.685297:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13809 00000100:00100000:1.0:1746142904.685301:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867747456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142904.685332:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142904.685335:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.685336:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.685338:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.685340:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142904.685354:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867747456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (333us total) trans 21474841113 rc 0/0 00000100:00100000:1.0:1746142904.685359:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13809 00000004:00080000:1.0:1746142904.685382:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d62d80/2, rc 0, transno 21474841112 00000100:00100000:1.0:1746142904.685386:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867746944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.685392:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d60700/2, rc 0, transno 21474841113 00000100:00100000:1.0:1746142904.685394:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867747456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.685400:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61c00/2, rc 0, transno 21474841110 00000100:00100000:1.0:1746142904.685402:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867747072:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.685407:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07800/2, rc 0, transno 21474841111 00000100:00100000:1.0:1746142904.685410:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867747584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685526:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867746688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685546:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.685558:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685571:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.685581:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142904.685585:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867746816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.685606:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685617:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.685631:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867746688 00000100:00100000:0.0:1746142904.685634:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867746688 00000100:00100000:0.0:1746142904.685648:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867747200 00000100:00100000:0.0:1746142904.685649:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867747200 00000100:00100000:0.0:1746142904.685656:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867746816 00000100:00100000:0.0:1746142904.685658:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867746816 00000100:00100000:0.0:1746142904.685666:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13810 00000100:00100000:0.0:1746142904.685670:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867746688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142904.685709:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142904.685711:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:0.0:1746142904.685713:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142904.685714:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142904.685716:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142904.685735:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867746688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (188us total) trans 21474841114 rc 0/0 00000100:00100000:0.0:1746142904.685740:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13810 00000100:00100000:0.0:1746142904.685748:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867747328 00000100:00100000:0.0:1746142904.685750:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867747328 00000100:00100000:0.0:1746142904.685758:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13811 00000100:00100000:0.0:1746142904.685761:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867747200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685807:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3764:x1830962867747200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (235us total) trans 21474841115 rc 0/0 00000100:00100000:0.0:1746142904.685812:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13811 00000100:00100000:0.0:1746142904.685820:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13812 00000100:00100000:0.0:1746142904.685823:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867746816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142904.685853:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142904.685855:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:0.0:1746142904.685857:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142904.685858:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142904.685860:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142904.685875:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3764:x1830962867746816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (277us total) trans 21474841116 rc 0/0 00000100:00100000:0.0:1746142904.685879:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13812 00000100:00100000:0.0:1746142904.685887:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13813 00000100:00100000:0.0:1746142904.685890:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867747328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.685956:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3764:x1830962867747328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (337us total) trans 21474841117 rc 0/0 00000100:00100000:0.0:1746142904.685960:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13813 00000004:00080000:0.0:1746142904.685981:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61f80/2, rc 0, transno 21474841116 00000100:00100000:0.0:1746142904.685984:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867746816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142904.685989:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61500/2, rc 0, transno 21474841117 00000100:00100000:0.0:1746142904.685992:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142904.685997:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d60e00/2, rc 0, transno 21474841114 00000100:00100000:0.0:1746142904.685999:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867746688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142904.686004:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61180/2, rc 0, transno 21474841115 00000100:00100000:0.0:1746142904.686006:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.686861:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867746560:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.686888:0:22383:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.686918:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 9 pid: 13326 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.686929:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867747712:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.686983:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.688669:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867747712:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.688696:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a400/0x2fa243e067ccbf11 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 29 pid: 22383 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746142904.688713:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 28 pid: 22383 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.688719:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 28 pid: 22383 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.688742:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337b800, rc 0) 00000100:00100000:2.0:1746142904.688781:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32175:x1830962867193984:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 25528us (25902us total) trans 8589936480 rc 0/0 00000100:00100000:2.0:1746142904.688790:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14336 00000100:00100000:0.0:1746142904.689485:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.689544:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195008 00000100:00100000:2.0:1746142904.689549:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195008 00000100:00100000:2.0:1746142904.689572:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14340 00000100:00100000:2.0:1746142904.689579:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:32181:x1830962867195008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.689590:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.689601:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89deb expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.689630:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.689637:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.689644:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.689646:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142904.689648:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.689653:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712b800, rc 0) 00000100:00100000:2.0:1746142904.690238:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:32181:x1830962867195008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 659us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.690244:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14340 00000100:00100000:0.0:1746142904.690429:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.690535:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195136 00000100:00100000:2.0:1746142904.690539:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195136 00010000:00010000:2.0:1746142904.690553:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 11 pid: 13326 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.690585:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6169 00000100:00100000:2.0:1746142904.690591:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867195136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.690599:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.690603:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 11 pid: 13326 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.690612:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 11 pid: 13326 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.690625:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccbf1f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dd6 expref: 11 pid: 13326 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.690941:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.690945:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.690950:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.690954:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.691266:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867195136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 673us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.691272:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6169 00000100:00100000:0.0:1746142904.692583:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.692668:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195264 00000100:00100000:2.0:1746142904.692674:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195264 00010000:00010000:2.0:1746142904.692694:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 28 pid: 22383 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.692725:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6170 00000100:00100000:2.0:1746142904.692733:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867195264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.692742:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.692746:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 28 pid: 22383 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.692756:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 28 pid: 22383 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.692772:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccbf18 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc8 expref: 28 pid: 22383 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.692783:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.692787:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.692793:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.692799:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142904.692805:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.692829:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.692861:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867195264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.692869:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6170 00010000:00010000:0.0:1746142904.692921:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142904.692927:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00000040:00080000:0.0:1746142904.693134:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].585, 88 off59192 00000004:00080000:0.0:1746142904.693139:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692238461ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.693156:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].650, 88 off65000 00000004:00080000:0.0:1746142904.693159:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692259207ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693188:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].651, 88 off65088 00000004:00080000:0.0:1746142904.693191:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692291238ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693199:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].586, 88 off59280 00000004:00080000:0.0:1746142904.693202:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692302040ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.693209:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].587, 88 off59368 00000004:00080000:0.0:1746142904.693211:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692311126ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.693218:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].652, 88 off65176 00000004:00080000:0.0:1746142904.693221:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692320877ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693228:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].653, 88 off65264 00000004:00080000:0.0:1746142904.693230:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692330011ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693237:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].588, 88 off59456 00000004:00080000:0.0:1746142904.693239:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692338971ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.693246:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].654, 88 off65352 00000004:00080000:0.0:1746142904.693248:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692348535ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693255:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].589, 88 off59544 00000004:00080000:0.0:1746142904.693257:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692357673ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.693264:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].655, 88 off65440 00000004:00080000:0.0:1746142904.693267:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692366803ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693273:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].590, 88 off59632 00000004:00080000:0.0:1746142904.693276:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692375991ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.693740:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].657, 88 off65624 00000004:00080000:0.0:1746142904.693746:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678692845680ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.693776:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].591, 88 off59720 00000004:00080000:0.0:1746142904.693779:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678692879241ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142904.694182:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].658, 88 off65712 00000004:00080000:0.0:1746142904.694186:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678693286623ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.694210:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].659, 88 off65800 00000004:00080000:0.0:1746142904.694214:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 678693313747ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142904.694223:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].592, 88 off59808 00000004:00080000:0.0:1746142904.694226:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 678693326155ns, next at 629431245375ns, rc = 0 00000100:00100000:0.0:1746142904.701184:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.701232:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.701258:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746142904.701262:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.701275:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142904.701328:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701337:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142904.701340:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746142904.701343:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701351:0:10924:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701357:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701363:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701370:0:10924:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701375:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.701396:0:10924:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.701405:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867748352:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142904.701451:0:10924:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 26 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142904.701458:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867748480:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142904.701471:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.701893:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867749504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.701931:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.701942:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867750016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.701956:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.701964:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746142904.701968:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867749376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.701983:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.701992:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867749888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.702003:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142904.702017:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867750016 00000100:00100000:1.0:1746142904.702020:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867750016 00000100:00100000:1.0:1746142904.702035:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13815 00000100:00100000:1.0:1746142904.702040:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3764:x1830962867747968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142904.702090:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142904.702093:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.702095:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.702096:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.702098:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746142904.702115:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3764:x1830962867747968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (839us total) trans 17179873854 rc 0/0 00000100:00100000:1.0:1746142904.702122:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13815 00000100:00100000:1.0:1746142904.702131:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13818 00000100:00100000:1.0:1746142904.702136:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3765:x1830962867749120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142904.702173:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:1.0:1746142904.702175:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.702176:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.702178:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.702179:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142904.702195:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3765:x1830962867749120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (528us total) trans 17179873857 rc 0/0 00000100:00100000:1.0:1746142904.702200:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13818 00000100:00100000:1.0:1746142904.702209:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13820 00000100:00100000:1.0:1746142904.702212:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867748864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142904.702247:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:1.0:1746142904.702249:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:1.0:1746142904.702251:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.702252:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:1.0:1746142904.702253:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:1.0:1746142904.702270:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867748864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (559us total) trans 17179873859 rc 0/0 00000100:00100000:1.0:1746142904.702274:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13820 00000100:00100000:1.0:1746142904.702283:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13822 00000100:00100000:1.0:1746142904.702286:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3762:x1830962867748992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.702328:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867748992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (576us total) trans 17179873860 rc 0/0 00000100:00100000:1.0:1746142904.702333:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13822 00000100:00100000:1.0:1746142904.702342:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13824 00000100:00100000:1.0:1746142904.702346:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+33:3763:x1830962867749376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.702346:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13825 00000100:00100000:0.0:1746142904.702353:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3763:x1830962867750016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142904.702381:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:1.0:1746142904.702384:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.702385:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.702386:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.702388:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:1.0:1746142904.702405:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3763:x1830962867749376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (421us total) trans 21474841120 rc 0/0 00000100:00100000:1.0:1746142904.702409:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13824 00000004:00080000:1.0:1746142904.702431:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05880/2, rc 0, transno 21474841120 00000100:00100000:1.0:1746142904.702434:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867749376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.702445:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3763:x1830962867750016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (487us total) trans 21474841121 rc 0/0 00000100:00100000:0.0:1746142904.702450:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13825 00000004:00080000:1.0:1746142904.702453:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c06680/2, rc 0, transno 21474841119 00000100:00100000:1.0:1746142904.702456:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867749504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.702461:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c06300/2, rc 0, transno 21474841121 00000100:00100000:1.0:1746142904.702464:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867750016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.702469:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867749632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.702497:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746142904.702499:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746142904.702501:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.702503:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142904.702504:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142904.702506:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000004:00080000:0.0:1746142904.702515:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d0a80/2, rc 0, transno 17179873854 00000100:00100000:0.0:1746142904.702518:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.702527:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3765:x1830962867748736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 479us (911us total) trans 17179873855 rc 0/0 00000004:00080000:0.0:1746142904.702527:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801355d0380/2, rc 0, transno 17179873853 00000100:00100000:0.0:1746142904.702529:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867747840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142904.702532:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13816 00000100:00100000:0.0:1746142904.702536:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867750144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.702551:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.702562:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142904.702566:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867749248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.702578:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142904.702588:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867749760:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142904.702597:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142904.702598:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867749632 00000100:00100000:2.0:1746142904.702602:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867749632 00000100:00100000:1.0:1746142904.702611:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867750144 00000100:00100000:0.0:1746142904.702613:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867749248 00000100:00100000:1.0:1746142904.702614:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867750144 00000100:00100000:2.0:1746142904.702615:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867749760 00000100:00100000:0.0:1746142904.702616:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867749248 00000100:00100000:2.0:1746142904.702617:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867749760 00000100:00100000:1.0:1746142904.702626:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13827 00000100:00100000:1.0:1746142904.702630:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3764:x1830962867749632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.702634:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13828 00000100:00100000:2.0:1746142904.702639:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867750144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142904.702642:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13829 00000100:00100000:0.0:1746142904.702647:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3764:x1830962867749760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.702679:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3764:x1830962867749632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (181us total) trans 21474841122 rc 0/0 00000100:00100000:1.0:1746142904.702684:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13827 00000100:00100000:1.0:1746142904.702693:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13830 00000100:00100000:1.0:1746142904.702697:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3764:x1830962867749248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.702698:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3764:x1830962867750144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (146us total) trans 17179873861 rc 0/0 00000100:00100000:2.0:1746142904.702703:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13828 00000100:00100000:0.0:1746142904.702707:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3764:x1830962867749760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (107us total) trans 21474841123 rc 0/0 00000100:00100000:0.0:1746142904.702712:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13829 00002000:00010000:1.0:1746142904.702731:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142904.702733:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142904.702735:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142904.702736:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00000004:00080000:0.0:1746142904.702736:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07100/2, rc 0, transno 21474841123 00002000:00010000:1.0:1746142904.702738:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142904.702739:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867749760:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142904.702745:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098190380/2, rc 0, transno 17179873861 00000100:00100000:0.0:1746142904.702748:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867750144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142904.702753:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c04000/2, rc 0, transno 21474841122 00000100:00100000:1.0:1746142904.702754:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3764:x1830962867749248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (175us total) trans 21474841124 rc 0/0 00000100:00100000:0.0:1746142904.702755:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867749632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142904.702758:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13830 00000004:00080000:0.0:1746142904.702762:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c06a00/2, rc 0, transno 21474841124 00000100:00100000:0.0:1746142904.702765:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867749248:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142904.703732:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07480/2, rc 0, transno 21474841125 00000100:00100000:1.0:1746142904.703737:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867749888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142904.704377:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867748352:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.704390:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867748480:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.704414:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccbf26 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 10 pid: 10924 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746142904.704439:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.704458:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131323000, rc 0) 00000100:00100000:0.0:1746142904.704486:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.704492:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:32176:x1830962867194240:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 40839us (41546us total) trans 8589936481 rc 0/0 00000100:00100000:2.0:1746142904.704497:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14337 00000100:00100000:0.0:1746142904.704507:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195392 00000100:00100000:0.0:1746142904.704511:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195392 00000100:00100000:1.0:1746142904.704517:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.704531:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195520 00000100:00100000:0.0:1746142904.704533:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195520 00000100:00100000:1.0:1746142904.704539:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.704542:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5202 00000100:00100000:0.0:1746142904.704546:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5203 00000100:00100000:2.0:1746142904.704548:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4853450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32181:x1830962867195392:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:0.0:1746142904.704551:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32180:x1830962867195520:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:2.0:1746142904.704591:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4853450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32181:x1830962867195392:12345-192.168.204.50@tcp:49:cat.0 Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.704596:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5202 00000100:00100000:0.0:1746142904.704597:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32180:x1830962867195520:12345-192.168.204.50@tcp:49:cat.0 Request processed in 45us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.704603:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5203 00000100:00100000:2.0:1746142904.704622:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195648 00000100:00100000:2.0:1746142904.704624:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195648 00000100:00100000:2.0:1746142904.704645:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14341 00000100:00100000:2.0:1746142904.704649:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32175:x1830962867195648:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142904.704655:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.704664:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097421200/0x2fa243e067ccbf49 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89df2 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.704684:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097421200/0x2fa243e067ccbf49 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df2 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.704692:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097421200/0x2fa243e067ccbf49 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df2 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.704700:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.704702:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142904.704704:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097421200, rc 0) 00000100:00100000:2.0:1746142904.704717:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32175:x1830962867195648:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 68us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.704721:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14341 00000100:00100000:0.0:1746142904.706471:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.706613:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867195776 00000100:00100000:2.0:1746142904.706621:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867195776 00000100:00100000:2.0:1746142904.706670:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 753 00000100:00100000:2.0:1746142904.706675:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867195776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.706683:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.706697:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097421200/0x2fa243e067ccbf49 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df2 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.706708:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.706711:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.706752:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867195776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.706757:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 753 00000100:00100000:2.0:1746142904.707052:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.707959:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.708023:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867196032 00000100:00100000:2.0:1746142904.708026:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867196032 00000100:00100000:2.0:1746142904.708045:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13832 00000100:00100000:2.0:1746142904.708050:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32175:x1830962867196032:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142904.708057:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.708068:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e00 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.708084:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.708089:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142904.708102:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142904.708104:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1196032->1593343] (req 1196032->1593343) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.708119:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.708130:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 11 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.708136:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867750400:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.708196:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.708878:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.709093:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.709111:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867196288 00000100:00100000:1.0:1746142904.709142:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867196288 00000100:00100000:2.0:1746142904.709150:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867196416 00000100:00100000:2.0:1746142904.709153:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867196416 00010000:00010000:2.0:1746142904.709169:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d89 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.709191:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6171 00000100:00100000:2.0:1746142904.709197:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867196416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.709205:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.709220:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d89 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.709228:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d89 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00002000:00100000:1.0:1746142904.709236:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009ceb1c00 x1830962867196288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.709245:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1c00 with x1830962867196288 ext(0->1048575) 00002000:00010000:1.0:1746142904.709248:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb1c00 00010000:00010000:2.0:1746142904.709249:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccbe77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d89 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.709258:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.709260:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.709265:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 19 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.709266:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4150 00010000:00010000:2.0:1746142904.709272:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 19 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142904.709272:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867196288:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:2.0:1746142904.709296:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 19 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.709304:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867750528:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.709344:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.709567:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867750400:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.709579:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1196032->1593343] (req 1196032->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.709587:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097420e00, rc 0) 00000100:00100000:2.0:1746142904.709663:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32175:x1830962867196032:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1611us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.709669:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13832 00000100:00100000:0.0:1746142904.711099:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.711760:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.711827:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867196544 00000100:00100000:2.0:1746142904.711834:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867196544 00010000:00010000:2.0:1746142904.711859:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.711896:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6172 00000100:00100000:2.0:1746142904.711924:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867196544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.711934:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.711950:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.711961:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.711977:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880400/0x2fa243e067ccbe70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d82 expref: 12 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.711988:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.711990:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.711995:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.712002:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.712024:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.712034:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867750656:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.712086:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.712246:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.712427:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867750528:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.712439:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.712460:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867196416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3263us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.712466:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6171 00000100:00100000:1.0:1746142904.713409:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4152 00000100:00100000:1.0:1746142904.713417:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867197056:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142904.713502:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867197056:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 86us (1256us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142904.713508:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4152 00002000:00100000:1.0:1746142904.713513:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2482176->2486271) req@ffff88009ceb1880 x1830962867197056/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.713520:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1880 with x1830962867197056 ext(2482176->2486271) 00002000:00010000:1.0:1746142904.713524:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb1880 00000100:00100000:1.0:1746142904.714340:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867196288:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 5067us (5246us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142904.714345:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4150 00002000:00100000:1.0:1746142904.714350:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009ceb1c00 x1830962867196288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.714363:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1c00 with x1830962867196288 ext(0->1048575) 00002000:00010000:1.0:1746142904.714365:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb1c00 00000100:00100000:2.0:1746142904.714610:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867750656:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.714623:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.714640:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867196544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2719us (3545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.714646:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6172 00000100:00100000:0.0:1746142904.717596:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.717708:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867197312 00000100:00100000:2.0:1746142904.717715:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867197312 00002000:00100000:2.0:1746142904.717746:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1196032->1200127) req@ffff88009ceb3b80 x1830962867197312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.717756:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb3b80 with x1830962867197312 ext(1196032->1200127) 00002000:00010000:2.0:1746142904.717760:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb3b80 00000100:00100000:2.0:1746142904.717785:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4153 00000100:00100000:2.0:1746142904.717791:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867197312:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.717930:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867197312:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 138us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142904.717936:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4153 00002000:00100000:2.0:1746142904.717942:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1196032->1200127) req@ffff88009ceb3b80 x1830962867197312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.717949:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb3b80 with x1830962867197312 ext(1196032->1200127) 00002000:00010000:2.0:1746142904.717952:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb3b80 00000100:00100000:0.0:1746142904.720002:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.720368:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867197568 00000100:00100000:1.0:1746142904.720455:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867197568 00002000:00100000:1.0:1746142904.720496:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2809856->2813951) req@ffff88009ceb0e00 x1830962867197568/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.720505:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0e00 with x1830962867197568 ext(2809856->2813951) 00002000:00010000:1.0:1746142904.720509:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb0e00 00000100:00100000:1.0:1746142904.720539:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4154 00000100:00100000:1.0:1746142904.720546:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867197568:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142904.720651:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867197568:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 106us (654us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142904.720658:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4154 00002000:00100000:1.0:1746142904.720664:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2809856->2813951) req@ffff88009ceb0e00 x1830962867197568/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.720671:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0e00 with x1830962867197568 ext(2809856->2813951) 00002000:00010000:1.0:1746142904.720673:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb0e00 00000100:00100000:2.0:1746142904.720947:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867196800:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7890us (9186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.720953:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4151 00002000:00100000:2.0:1746142904.720958:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009ceb1f80 x1830962867196800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.720965:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1f80 with x1830962867196800 ext(1048576->2097151) 00002000:00010000:2.0:1746142904.720968:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1f80 00000100:00100000:0.0:1746142904.724671:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.724716:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.724888:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867197824 00000100:00100000:2.0:1746142904.724896:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867197824 00002000:00100000:2.0:1746142904.724959:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1589248->1593343) req@ffff88009ceb1500 x1830962867197824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.724969:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1500 with x1830962867197824 ext(1589248->1593343) 00002000:00010000:2.0:1746142904.724973:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb1500 00000100:00100000:2.0:1746142904.725004:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4155 00000100:00100000:2.0:1746142904.725011:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867197824:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.725119:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867197824:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 107us (454us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142904.725125:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4155 00002000:00100000:2.0:1746142904.725130:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1589248->1593343) req@ffff88009ceb1500 x1830962867197824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.725136:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1500 with x1830962867197824 ext(1589248->1593343) 00002000:00010000:2.0:1746142904.725139:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb1500 00000100:00100000:3.0:1746142904.725207:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867197952 00000100:00100000:3.0:1746142904.725231:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13833 00000100:00100000:3.0:1746142904.725236:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32181:x1830962867197952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142904.725244:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.725258:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e07 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.725275:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.725277:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.725284:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 10 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.725297:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 10 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.725305:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3dc00, rc 0) 00000100:00100000:3.0:1746142904.725326:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:32181:x1830962867197952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 91us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.725331:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13833 00000100:00100000:0.0:1746142904.729330:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.729421:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.729595:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867198208 00000100:00100000:2.0:1746142904.729602:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867198208 00000100:00100000:2.0:1746142904.729639:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5204 00000100:00100000:2.0:1746142904.729646:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32176:x1830962867198208:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142904.729827:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32176:x1830962867198208:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 180us (502us total) trans 8589936482 rc 0/0 00000100:00100000:2.0:1746142904.729837:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5204 00000100:00100000:3.0:1746142904.729893:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867198336 00000100:00100000:3.0:1746142904.729896:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867198336 00000100:00100000:3.0:1746142904.729935:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13834 00000100:00100000:3.0:1746142904.729940:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32180:x1830962867198336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142904.729948:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.729959:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e0e expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.729978:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 14 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.729989:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142904.729990:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142904.729993:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.730014:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 14 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.730024:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 14 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.730033:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867750784:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142904.730077:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.732002:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.732190:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867750784:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142904.732226:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.732239:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c600, rc 0) 00000100:00100000:3.0:1746142904.732276:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32180:x1830962867198336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2335us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.732282:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13834 00000100:00100000:0.0:1746142904.732336:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867198592 00000100:00100000:0.0:1746142904.732341:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867198592 00000100:00100000:0.0:1746142904.732368:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5205 00000100:00100000:0.0:1746142904.732373:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32175:x1830962867198592:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142904.732490:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32175:x1830962867198592:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 117us (494us total) trans 8589936483 rc 0/0 00000100:00100000:0.0:1746142904.732495:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5205 00000100:00100000:0.0:1746142904.733255:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.733464:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.733546:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867198720 00000100:00100000:2.0:1746142904.733551:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867198720 00010000:00010000:2.0:1746142904.733573:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 15 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.733603:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6173 00000100:00100000:2.0:1746142904.733610:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867198720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.733619:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.733634:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 15 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.733645:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 15 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.733663:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009873f800/0x2fa243e067ccbe69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d7b expref: 15 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.733673:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.733675:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.733680:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.733693:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.733715:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.733727:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867750912:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.733794:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.734828:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867198976 00000100:00100000:1.0:1746142904.734834:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867198976 00002000:00100000:1.0:1746142904.734862:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096073100 x1830962867198976/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.734875:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073100 with x1830962867198976 ext(1048576->2097151) 00002000:00010000:1.0:1746142904.734879:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096073100 00000100:00100000:1.0:1746142904.734933:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4156 00000100:00100000:1.0:1746142904.734940:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867198976:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.738311:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867750912:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.738332:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.738372:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867198720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4762us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.738381:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6173 00000100:00100000:2.0:1746142904.742415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.742564:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867199232 00000100:00100000:0.0:1746142904.742572:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867199232 00002000:00100000:0.0:1746142904.742606:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098191f80 x1830962867199232/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142904.742614:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191f80 with x1830962867199232 ext(1048576->2097151) 00002000:00010000:0.0:1746142904.742619:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098191f80 00000100:00100000:0.0:1746142904.742651:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4157 00000100:00100000:0.0:1746142904.742659:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867199232:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142904.743769:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.744037:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867199488 00000100:00100000:3.0:1746142904.744043:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867199488 00002000:00100000:3.0:1746142904.744067:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880091c04380 x1830962867199488/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 504/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.744082:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04380 with x1830962867199488 ext(1048576->2097151) 00002000:00010000:3.0:1746142904.744085:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c04380 00000100:00100000:3.0:1746142904.744099:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4158 00000100:00100000:3.0:1746142904.744105:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867199488:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.745953:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867198976:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 11008us (12483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.745962:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4156 00002000:00100000:2.0:1746142904.745970:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096073100 x1830962867198976/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.745978:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073100 with x1830962867198976 ext(1048576->2097151) 00002000:00010000:2.0:1746142904.745981:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096073100 00000100:00100000:2.0:1746142904.751332:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867199232:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 8667us (8915us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.751342:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4157 00002000:00100000:2.0:1746142904.751352:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880098191f80 x1830962867199232/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.751361:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191f80 with x1830962867199232 ext(1048576->2097151) 00002000:00010000:2.0:1746142904.751365:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098191f80 00000100:00100000:0.0:1746142904.753644:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.753942:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867199616 00000100:00100000:3.0:1746142904.753953:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867199616 00000100:00100000:3.0:1746142904.754002:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13835 00000100:00100000:3.0:1746142904.754009:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:32181:x1830962867199616:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142904.754022:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.754036:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e15 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.754055:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.754056:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.754061:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.754073:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.754081:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d400, rc 0) 00000100:00100000:3.0:1746142904.754115:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:32181:x1830962867199616:12345-192.168.204.50@tcp:101:cat.0 Request processed in 106us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.754403:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13835 00000100:00100000:3.0:1746142904.754948:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867199488:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 10841us (11182us total) trans 0 rc 651264/651264 00000100:00100000:3.0:1746142904.754956:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4158 00002000:00100000:3.0:1746142904.754963:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880091c04380 x1830962867199488/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 504/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 651264/651264 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.754971:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04380 with x1830962867199488 ext(1048576->2097151) 00002000:00010000:3.0:1746142904.754975:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c04380 00000100:00100000:0.0:1746142904.762875:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.763027:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867199872 00000100:00100000:3.0:1746142904.763034:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867199872 00002000:00100000:3.0:1746142904.763072:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096073b80 x1830962867199872/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.763082:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073b80 with x1830962867199872 ext(1048576->2097151) 00002000:00010000:3.0:1746142904.763086:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096073b80 00000100:00100000:3.0:1746142904.763115:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4159 00000100:00100000:3.0:1746142904.763122:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867199872:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142904.768724:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.768764:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.768787:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200000 00000100:00100000:3.0:1746142904.768795:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200000 00000100:00100000:3.0:1746142904.768826:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200128 00000100:00100000:3.0:1746142904.768828:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200128 00000100:00100000:2.0:1746142904.768832:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13836 00000100:00100000:2.0:1746142904.768841:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867200000:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142904.768855:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13837 00010000:00010000:2.0:1746142904.768855:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142904.768860:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867200128:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142904.768867:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.768869:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097421600/0x2fa243e067ccbf73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e1c expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.768875:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccbf7a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e23 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142904.768930:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867751040:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142904.768930:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867751168:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142904.768996:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.769526:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00010000:00010000:3.0:1746142904.771966:0:11421:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142904.771992:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867751040:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142904.772030:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccbf7a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e23 expref: 32 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142904.772040:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccbf7a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e23 expref: 32 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142904.772058:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3cc00, rc 0) 00000100:00100000:3.0:1746142904.772088:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867200128:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3228us (3324us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142904.772095:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13837 00000100:00100000:3.0:1746142904.773157:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867199872:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 10032us (10285us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142904.773164:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4159 00002000:00100000:3.0:1746142904.773172:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096073b80 x1830962867199872/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.773181:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073b80 with x1830962867199872 ext(1048576->2097151) 00002000:00010000:3.0:1746142904.773185:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096073b80 00002000:00010000:2.0:1746142904.773417:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142904 -> 1746142905 00000100:00100000:2.0:1746142904.773432:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867751168:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142904.773451:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097421600/0x2fa243e067ccbf73 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e1c expref: 33 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.773462:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097421600/0x2fa243e067ccbf73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e1c expref: 33 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.773483:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097421600, rc 0) 00000100:00100000:2.0:1746142904.773504:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867200000:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4666us (4789us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142904.773510:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13836 00000100:00100000:0.0:1746142904.778435:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.778539:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.778597:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200256 00000100:00100000:3.0:1746142904.778606:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200256 00000100:00100000:2.0:1746142904.778617:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200384 00000100:00100000:2.0:1746142904.778621:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200384 00000100:00100000:3.0:1746142904.778658:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13838 00000100:00100000:3.0:1746142904.778666:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:32181:x1830962867200256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142904.778682:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.778697:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e2a expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.778721:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.778729:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142904.778730:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142904.778734:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.778758:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.778768:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 32 pid: 9580 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.779123:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867751296:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142904.779529:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.779934:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13839 00000100:00100000:0.0:1746142904.779943:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32180:x1830962867200384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142904.779951:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142904.780045:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e31 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.780092:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.780098:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142904.780099:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142904.780102:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.780118:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.780127:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 20 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:0.0:1746142904.780135:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867751424:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142904.780327:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142904.782880:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867751296:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142904.782881:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096070e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867751424:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142904.782917:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.782931:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6200, rc 0) 00010000:00010000:3.0:1746142904.782932:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.782940:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d200, rc 0) 00000100:00100000:0.0:1746142904.782975:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32180:x1830962867200384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3033us (4434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142904.782983:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13839 00000100:00100000:3.0:1746142904.783183:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:32181:x1830962867200256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4517us (4754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.783189:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13838 00000100:00100000:0.0:1746142904.783797:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.783836:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.784421:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200512 00000100:00100000:3.0:1746142904.784428:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200512 00000100:00100000:2.0:1746142904.784429:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200640 00000100:00100000:2.0:1746142904.784432:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200640 00002000:00100000:3.0:1746142904.784456:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1196032->1593343) req@ffff880096070e00 x1830962867200512/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.784456:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2482176->2813951) req@ffff880096071880 x1830962867200640/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.784466:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070e00 with x1830962867200512 ext(1196032->1593343) 00002000:00100000:2.0:1746142904.784470:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071880 with x1830962867200640 ext(2482176->2813951) 00010000:00010000:3.0:1746142904.784472:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 33 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.784489:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 20 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.784490:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 33 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.784495:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 20 pid: 11421 timeout: 778 lvb_type: 0 00002000:00010000:3.0:1746142904.784497:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096070e00 00002000:00010000:2.0:1746142904.784500:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096071880 00000100:00100000:3.0:1746142904.784798:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1289 00000100:00100000:3.0:1746142904.784805:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867200512:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142904.784805:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1290 00000100:00100000:2.0:1746142904.784810:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867200640:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142904.795630:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867200640:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 10812us (11786us total) trans 21474841126 rc 0/0 00000100:00100000:2.0:1746142904.795641:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1290 00002000:00100000:2.0:1746142904.795653:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2482176->2813951) req@ffff880096071880 x1830962867200640/t21474841126(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/448 e 0 to 0 dl 1746142915 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.795661:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071880 with x1830962867200640 ext(2482176->2813951) 00010000:00010000:2.0:1746142904.795670:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.795680:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746142904.795686:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096071880 00000100:00100000:2.0:1746142904.798768:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867200512:12345-192.168.204.50@tcp:4:cat.0 Request processed in 13955us (14964us total) trans 21474841127 rc 0/0 00000100:00100000:2.0:1746142904.798780:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1289 00002000:00100000:2.0:1746142904.798790:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1196032->1593343) req@ffff880096070e00 x1830962867200512/t21474841127(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/448 e 0 to 0 dl 1746142915 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.798799:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070e00 with x1830962867200512 ext(1196032->1593343) 00010000:00010000:2.0:1746142904.798808:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 35 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.798819:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 35 pid: 9580 timeout: 778 lvb_type: 0 00002000:00010000:2.0:1746142904.798826:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096070e00 00000100:00100000:0.0:1746142904.801453:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.801506:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200768 00000100:00100000:2.0:1746142904.801512:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200768 00010000:00010000:2.0:1746142904.801540:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.801778:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6174 00000100:00100000:2.0:1746142904.801785:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867200768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.801795:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.801809:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.801818:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.801841:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf4d200/0x2fa243e067ccbf50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2813951) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89df9 expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.801854:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.801856:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.801860:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.801867:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.801890:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.801913:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867751552:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.801973:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.802466:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.802637:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867200896 00000100:00100000:3.0:1746142904.802641:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867200896 00010000:00010000:3.0:1746142904.802655:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 35 pid: 9580 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.802678:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6175 00000100:00100000:3.0:1746142904.802682:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867200896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142904.802688:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142904.802695:0:11911:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142904 -> 1746142905 00010000:00010000:3.0:1746142904.802699:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 35 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.802706:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 35 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.802718:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccbf57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1196032->1593343) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e00 expref: 35 pid: 9580 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.802737:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.802738:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.802742:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.802748:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.802765:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142904.802772:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867751680:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142904.803436:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.804777:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867751552:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.804793:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142904.804832:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867200768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3047us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.804840:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6174 00000100:00100000:3.0:1746142904.806190:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867751680:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142904.806218:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.806240:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867200896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3558us (3775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.806247:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6175 00000100:00100000:0.0:1746142904.806774:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.807150:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867201152 00000100:00100000:2.0:1746142904.807156:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867201152 00002000:00100000:2.0:1746142904.807187:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096071500 x1830962867201152/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.807200:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071500 with x1830962867201152 ext(2097152->3145727) 00002000:00010000:2.0:1746142904.807204:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096071500 00000100:00100000:2.0:1746142904.807218:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4160 00000100:00100000:2.0:1746142904.807224:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867201152:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142904.808393:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.808409:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867201408 00000100:00100000:0.0:1746142904.808413:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867201408 00002000:00100000:0.0:1746142904.808430:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880096071c00 x1830962867201408/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142904.808438:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071c00 with x1830962867201408 ext(1048576->2097151) 00002000:00010000:0.0:1746142904.808441:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096071c00 00000100:00100000:0.0:1746142904.808452:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4161 00000100:00100000:0.0:1746142904.808457:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867201408:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.814398:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096071c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867201408:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 5934us (6000us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.814409:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4161 00002000:00100000:2.0:1746142904.814419:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880096071c00 x1830962867201408/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.814634:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071c00 with x1830962867201408 ext(1048576->2097151) 00002000:00010000:2.0:1746142904.814640:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096071c00 00000100:00100000:2.0:1746142904.816214:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867201152:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8984us (9435us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.816222:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4160 00002000:00100000:2.0:1746142904.816228:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096071500 x1830962867201152/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.816236:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071500 with x1830962867201152 ext(2097152->3145727) 00002000:00010000:2.0:1746142904.816239:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096071500 00000100:00100000:0.0:1746142904.819263:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.819523:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867201536 00000100:00100000:3.0:1746142904.819531:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867201536 00000100:00100000:3.0:1746142904.819577:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13840 00000100:00100000:3.0:1746142904.819585:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32180:x1830962867201536:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142904.819600:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.819614:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e38 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.819637:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.819644:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142904.819645:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142904.819648:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.819673:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.819683:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 13 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.819693:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867751808:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142904.820362:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.820405:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.820412:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.820427:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867201664 00000100:00100000:1.0:1746142904.820430:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867201664 00000100:00100000:1.0:1746142904.820446:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867201792 00000100:00100000:1.0:1746142904.820448:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867201792 00000100:00100000:1.0:1746142904.820460:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13841 00000100:00100000:1.0:1746142904.820465:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867201664:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142904.820467:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13842 00010000:00010000:1.0:1746142904.820483:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142904.820484:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867201792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142904.820489:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.820492:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e3f expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142904.820494:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d950800/0x2fa243e067ccbf9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e46 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.820503:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.820504:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.820509:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142904.820514:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867751936:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142904.820519:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.820527:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2f600, rc 0) 00000100:00100000:0.0:1746142904.820535:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142904.820543:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867201664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.820551:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13841 00000100:00100000:3.0:1746142904.821932:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867751808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142904.821965:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.821980:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d000, rc 0) 00000100:00100000:3.0:1746142904.822005:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32180:x1830962867201536:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2420us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.822010:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13840 00010000:00010000:1.0:1746142904.822220:0:1397:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 13 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:1.0:1746142904.822240:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096072a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867751936:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142904.822243:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142904.822257:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d950800/0x2fa243e067ccbf9d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e46 expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.822265:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d950800/0x2fa243e067ccbf9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e46 expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142904.822281:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950800, rc 0) 00000100:00100000:1.0:1746142904.822299:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867201792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1827us (1886us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142904.822305:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13842 00000100:00100000:3.0:1746142904.822361:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867201920 00000100:00100000:3.0:1746142904.822366:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867201920 00010000:00010000:3.0:1746142904.822451:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 14 pid: 11943 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.822491:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6176 00000100:00100000:3.0:1746142904.822498:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867201920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142904.822506:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142904.822518:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 14 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.822526:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 14 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.822539:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881200/0x2fa243e067ccbe7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89d90 expref: 14 pid: 11943 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.822560:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.822561:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.822566:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.822577:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.822739:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142904.822748:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867752064:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142904.823315:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142904.825102:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867752064:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142904.825131:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.825160:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867201920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2663us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.825168:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6176 00000100:00100000:0.0:1746142904.827646:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.828044:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867202176 00000100:00100000:2.0:1746142904.828052:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867202176 00002000:00100000:2.0:1746142904.828086:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096072a00 x1830962867202176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.828095:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072a00 with x1830962867202176 ext(2097152->3145727) 00002000:00010000:2.0:1746142904.828099:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096072a00 00000100:00100000:2.0:1746142904.828116:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4162 00000100:00100000:2.0:1746142904.828123:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867202176:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142904.829206:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.829523:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867202560 00000100:00100000:1.0:1746142904.829528:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867202560 00002000:00100000:1.0:1746142904.829551:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096073480 x1830962867202560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.829559:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073480 with x1830962867202560 ext(2097152->4194303) 00002000:00010000:1.0:1746142904.829563:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096073480 00000100:00100000:2.0:1746142904.829645:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.829813:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867202688 00000100:00100000:0.0:1746142904.829817:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867202688 00002000:00100000:0.0:1746142904.829833:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880098190e00 x1830962867202688/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142904.829873:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4163 00000100:00100000:3.0:1746142904.829882:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867202560:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:0.0:1746142904.830174:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098190e00 with x1830962867202688 ext(3145728->4194303) 00002000:00010000:0.0:1746142904.830177:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098190e00 00000100:00100000:0.0:1746142904.830197:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4164 00000100:00100000:0.0:1746142904.830203:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867202688:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142904.837812:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867202176:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9681us (10163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.837822:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4162 00002000:00100000:2.0:1746142904.837831:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096072a00 x1830962867202176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.837840:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072a00 with x1830962867202176 ext(2097152->3145727) 00002000:00010000:2.0:1746142904.837845:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096072a00 00000100:00100000:2.0:1746142904.844100:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867202688:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13887us (14444us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.844110:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4164 00002000:00100000:2.0:1746142904.844121:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880098190e00 x1830962867202688/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.844129:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098190e00 with x1830962867202688 ext(3145728->4194303) 00002000:00010000:2.0:1746142904.844135:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098190e00 00000100:00100000:0.0:1746142904.844976:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.845604:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867202816 00000100:00100000:1.0:1746142904.845611:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867202816 00000100:00100000:1.0:1746142904.845653:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13843 00000100:00100000:1.0:1746142904.845660:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:32181:x1830962867202816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142904.845673:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142904.845687:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e4d expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.845707:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.845708:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142904.845714:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 12 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.845728:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 12 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142904.845736:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2f000, rc 0) 00000100:00100000:1.0:1746142904.845777:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:32181:x1830962867202816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 117us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142904.845782:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13843 00000100:00100000:3.0:1746142904.848629:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867202560:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18740us (19417us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142904.848638:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4163 00002000:00100000:3.0:1746142904.848646:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096073480 x1830962867202560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.848654:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073480 with x1830962867202560 ext(2097152->4194303) 00002000:00010000:3.0:1746142904.848659:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096073480 00000100:00100000:0.0:1746142904.856082:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.856745:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867203200 00000100:00100000:3.0:1746142904.856754:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867203200 00002000:00100000:3.0:1746142904.856794:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012c0e0380 x1830962867203200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.856804:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0380 with x1830962867203200 ext(2097152->4194303) 00002000:00010000:3.0:1746142904.856808:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e0380 00000100:00100000:3.0:1746142904.856840:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4165 00000100:00100000:3.0:1746142904.856847:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867203200:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142904.856940:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.857297:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867202944 00000100:00100000:2.0:1746142904.857301:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867202944 00000100:00100000:2.0:1746142904.857335:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13844 00000100:00100000:2.0:1746142904.857341:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867202944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142904.857349:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.857361:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e54 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.858427:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.858429:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.858436:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.858449:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.858457:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098290000, rc 0) 00000100:00100000:2.0:1746142904.860151:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867202944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2806us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.860159:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13844 00000100:00100000:1.0:1746142904.860191:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.860210:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867203456 00000100:00100000:2.0:1746142904.860215:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867203456 00002000:00100000:2.0:1746142904.860236:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096142300 x1830962867203456/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.860243:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096142300 with x1830962867203456 ext(3145728->4194303) 00002000:00010000:2.0:1746142904.860248:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096142300 00000100:00100000:2.0:1746142904.860260:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4166 00000100:00100000:2.0:1746142904.860266:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867203456:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142904.861256:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.861336:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867203712 00000100:00100000:3.0:1746142904.861340:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867203712 00000100:00100000:3.0:1746142904.861377:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14342 00000100:00100000:3.0:1746142904.861383:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:32185:x1830962867203712:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142904.861395:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.861408:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3cc00/0x2fa243e067ccbfb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e5b expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.861457:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861466:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861488:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861498:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861503:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861510:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861586:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861592:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861597:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142904.861604:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142904.861654:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861659:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861663:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861668:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861672:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3ce00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142904.861675:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861680:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861687:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142904.861689:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142904.861692:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861697:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccbfb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861709:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861714:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861718:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861721:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3d600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142904.861723:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861727:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861732:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd400) 00010000:00010000:3.0:1746142904.861733:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142904.861735:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861738:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccbfc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142904.861766:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3cc00/0x2fa243e067ccbfb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.861774:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 12 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.861779:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142904.861781:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142904.861782:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d800, rc 0) 00000100:00100000:3.0:1746142904.861804:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:32185:x1830962867203712:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 421us (548us total) trans 8589936484 rc 0/0 00000100:00100000:3.0:1746142904.861809:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14342 00000100:00100000:0.0:1746142904.866511:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.866790:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867203968 00000100:00100000:1.0:1746142904.866797:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867203968 00002000:00100000:1.0:1746142904.866830:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012c0e1500 x1830962867203968/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.866840:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1500 with x1830962867203968 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.866844:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e1500 00000100:00100000:1.0:1746142904.866874:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4167 00000100:00100000:1.0:1746142904.866881:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867203968:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142904.873420:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867203200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16565us (17338us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142904.873430:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4165 00002000:00100000:2.0:1746142904.873439:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012c0e0380 x1830962867203200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.873447:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0380 with x1830962867203200 ext(2097152->4194303) 00002000:00010000:2.0:1746142904.873452:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e0380 00000100:00100000:2.0:1746142904.877318:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867203456:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17044us (17119us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142904.877328:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4166 00002000:00100000:2.0:1746142904.877337:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096142300 x1830962867203456/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.877345:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096142300 with x1830962867203456 ext(3145728->4194303) 00002000:00010000:2.0:1746142904.877350:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096142300 00000100:00100000:1.0:1746142904.878332:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867203968:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11449us (11824us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142904.878339:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4167 00002000:00100000:1.0:1746142904.878345:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012c0e1500 x1830962867203968/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.878352:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1500 with x1830962867203968 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.878356:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e1500 00000100:00100000:0.0:1746142904.884224:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.884756:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867204224 00000100:00100000:2.0:1746142904.884764:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867204224 00000100:00100000:2.0:1746142904.884809:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5206 00000100:00100000:2.0:1746142904.884815:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32180:x1830962867204224:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142904.886330:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32180:x1830962867204224:12345-192.168.204.50@tcp:35:cat.0 Request processed in 1510us (2108us total) trans 8589936485 rc 0/0 00000100:00100000:2.0:1746142904.886338:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5206 00000100:00100000:0.0:1746142904.886680:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142904.886814:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867204480 00000100:00100000:1.0:1746142904.886819:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867204480 00002000:00100000:1.0:1746142904.886845:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012c0e3480 x1830962867204480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.886855:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e3480 with x1830962867204480 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.886859:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e3480 00000100:00100000:1.0:1746142904.886951:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4168 00000100:00100000:1.0:1746142904.886957:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867204480:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142904.895196:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867204480:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8230us (8507us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142904.895206:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4168 00002000:00100000:1.0:1746142904.895216:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012c0e3480 x1830962867204480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/440 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142904.895224:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e3480 with x1830962867204480 ext(4194304->5033983) 00002000:00010000:1.0:1746142904.895229:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e3480 00000100:00100000:0.0:1746142904.902376:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.902485:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867204736 00000100:00100000:2.0:1746142904.902493:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867204736 00000100:00100000:2.0:1746142904.902529:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5207 00000100:00100000:2.0:1746142904.902536:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:32181:x1830962867204736:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142904.903072:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:32181:x1830962867204736:12345-192.168.204.50@tcp:35:cat.0 Request processed in 534us (701us total) trans 8589936486 rc 0/0 00000100:00100000:2.0:1746142904.903078:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5207 00000100:00100000:0.0:1746142904.923257:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.923382:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867204864 00000100:00100000:2.0:1746142904.923390:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867204864 00000100:00100000:2.0:1746142904.923445:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13845 00000100:00100000:2.0:1746142904.923452:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:32185:x1830962867204864:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142904.923468:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.923493:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e62 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.923518:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.923525:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.923530:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.923532:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.923534:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.923556:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.923565:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.923575:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867752192:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.923654:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.923662:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 31 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.923669:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867752320:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.923688:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.925741:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867752192:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.925752:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867752320:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.925771:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.925784:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89ca00, rc 0) 00000100:00100000:2.0:1746142904.925822:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:32185:x1830962867204864:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2371us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.925828:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13845 00000100:00100000:0.0:1746142904.926965:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.927027:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867204992 00000100:00100000:3.0:1746142904.927032:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867204992 00010000:00010000:3.0:1746142904.927053:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.927125:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6177 00000100:00100000:3.0:1746142904.927132:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867204992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142904.927141:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142904.927155:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.927163:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.927181:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2f000/0x2fa243e067ccbfa4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e4d expref: 13 pid: 1397 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.927433:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.927576:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867204992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 444us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.927582:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6177 00000100:00100000:0.0:1746142904.928244:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.928290:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867205120 00000100:00100000:3.0:1746142904.928293:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867205120 00010000:00010000:3.0:1746142904.928303:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 32 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.928320:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6178 00000100:00100000:3.0:1746142904.928323:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867205120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142904.928329:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142904.928335:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 32 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.928343:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 32 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.928360:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccbf8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e38 expref: 32 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.928368:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.928370:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.928374:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.928381:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.928405:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142904.928415:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867752448:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142904.928488:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142904.929531:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867752448:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142904.929633:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.929662:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867205120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1336us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.929669:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6178 00000100:00100000:0.0:1746142904.929750:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.929881:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867205376 00000100:00100000:2.0:1746142904.929886:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867205376 00002000:00100000:2.0:1746142904.929949:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3043328->3047423) req@ffff88012c0e1c00 x1830962867205376/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.929961:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1c00 with x1830962867205376 ext(3043328->3047423) 00002000:00010000:2.0:1746142904.929965:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e1c00 00000100:00100000:2.0:1746142904.929989:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4169 00000100:00100000:2.0:1746142904.929996:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867205376:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.930093:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867205376:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 98us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142904.930099:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4169 00002000:00100000:2.0:1746142904.930104:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3043328->3047423) req@ffff88012c0e1c00 x1830962867205376/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.930110:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1c00 with x1830962867205376 ext(3043328->3047423) 00002000:00010000:2.0:1746142904.930113:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e1c00 00000100:00100000:0.0:1746142904.931635:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.931706:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867205504 00000100:00100000:2.0:1746142904.931710:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867205504 00000100:00100000:2.0:1746142904.931747:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13846 00000100:00100000:2.0:1746142904.931754:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:32185:x1830962867205504:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142904.931764:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.931778:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e69 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.931799:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.931806:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.931811:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.931812:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.931815:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3588095] (req 3145728->3588095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.931838:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142904.931852:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.931860:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867752576:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142904.931940:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.931948:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 34 pid: 1397 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.931955:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867752704:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.931979:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142904.933196:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867752576:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142904.933205:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867752704:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142904.933221:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3588095] (req 3145728->3588095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.933230:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b600, rc 0) 00000100:00100000:3.0:1746142904.933251:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:32185:x1830962867205504:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1499us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.933256:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13846 00000100:00100000:0.0:1746142904.935617:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142904.935937:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.935998:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867205632 00000100:00100000:3.0:1746142904.936006:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867205632 00010000:00010000:3.0:1746142904.936028:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746142904.936051:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867205760 00000100:00100000:3.0:1746142904.936053:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867205760 00010000:00010000:3.0:1746142904.936061:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 35 pid: 1397 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.936076:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6179 00000100:00100000:3.0:1746142904.936082:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867205632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142904.936093:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142904.936112:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:3.0:1746142904.936121:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:3.0:1746142904.936137:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2f600/0x2fa243e067ccbf96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e3f expref: 23 pid: 1854 timeout: 778 lvb_type: 1 00010000:00010000:3.0:1746142904.936150:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.936190:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867205632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.936196:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6179 00000100:00100000:3.0:1746142904.936214:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6180 00000100:00100000:3.0:1746142904.936219:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867205760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142904.936225:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142904.936231:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 35 pid: 1397 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.936240:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 35 pid: 1397 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.936259:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6200/0x2fa243e067ccbf88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e31 expref: 35 pid: 1397 timeout: 778 lvb_type: 0 00010000:00010000:3.0:1746142904.936267:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.936269:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.936408:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.936416:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.936441:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142904.936451:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867752832:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142904.936658:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142904.937778:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867752832:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142904.937805:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.937841:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867205760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1621us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.937848:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6180 00000100:00100000:0.0:1746142904.942176:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.942271:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867206016 00000100:00100000:3.0:1746142904.942279:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867206016 00002000:00100000:3.0:1746142904.942318:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3584000->3588095) req@ffff880130121f80 x1830962867206016/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.942333:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121f80 with x1830962867206016 ext(3584000->3588095) 00002000:00010000:3.0:1746142904.942337:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130121f80 00000100:00100000:3.0:1746142904.942929:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4170 00000100:00100000:3.0:1746142904.942937:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867206016:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142904.943066:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867206016:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 129us (894us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142904.943072:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4170 00002000:00100000:3.0:1746142904.943077:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3584000->3588095) req@ffff880130121f80 x1830962867206016/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.943084:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121f80 with x1830962867206016 ext(3584000->3588095) 00002000:00010000:3.0:1746142904.943087:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130121f80 00000100:00100000:0.0:1746142904.949718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.949847:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867206272 00000100:00100000:2.0:1746142904.949855:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867206272 00000100:00100000:2.0:1746142904.949929:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5208 00000100:00100000:2.0:1746142904.949937:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4853050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:32185:x1830962867206272:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142904.950578:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4853050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:32185:x1830962867206272:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 640us (865us total) trans 8589936487 rc 0/0 00000100:00100000:2.0:1746142904.950585:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5208 00000100:00100000:0.0:1746142904.953233:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.953350:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867206528 00000100:00100000:2.0:1746142904.953357:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867206528 00000100:00100000:2.0:1746142904.953406:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14343 00000100:00100000:2.0:1746142904.953412:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32189:x1830962867206528:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142904.953434:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142904.953449:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccbfe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e70 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.953515:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953525:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953535:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953546:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953551:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953556:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953630:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953638:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953643:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:2.0:1746142904.953650:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142904.953698:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953707:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953712:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953717:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953722:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2be00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142904.953725:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953730:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953738:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142904.953740:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142904.953743:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953747:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccbfea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953755:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953759:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953763:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953766:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2b800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142904.953769:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953773:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953778:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013482f400) 00010000:00010000:2.0:1746142904.953780:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142904.953782:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953786:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b800/0x2fa243e067ccbff1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142904.953812:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccbfe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 32 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.953821:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 31 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.953826:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142904.953828:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142904.953830:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a600, rc 0) 00000100:00100000:2.0:1746142904.953876:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32189:x1830962867206528:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 464us (648us total) trans 8589936488 rc 0/0 00000100:00100000:2.0:1746142904.953882:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14343 00000100:00100000:0.0:1746142904.981645:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142904.981800:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867206656 00000100:00100000:3.0:1746142904.981809:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867206656 00000100:00100000:3.0:1746142904.981857:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13847 00000100:00100000:3.0:1746142904.981864:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32189:x1830962867206656:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142904.981880:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142904.981893:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e77 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.981951:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.981958:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142904.981969:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.981970:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142904.981973:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1630208->2080767] (req 1630208->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 35 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.981997:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142904.982007:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 35 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746142904.982017:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867752960:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142904.982113:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.982121:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 21 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:3.0:1746142904.982129:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867753088:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142904.982146:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142904.983619:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.983697:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867206784 00000100:00100000:2.0:1746142904.983702:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867206784 00010000:00010000:2.0:1746142904.983725:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 36 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:2.0:1746142904.983759:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6181 00000100:00100000:2.0:1746142904.983765:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867206784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.983774:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.983790:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 36 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.983798:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 36 pid: 11421 timeout: 778 lvb_type: 1 00010000:00010000:2.0:1746142904.983816:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142904.983825:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccbfab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e54 expref: 36 pid: 11421 timeout: 778 lvb_type: 1 00000100:00100000:3.0:1746142904.983847:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867752960:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.983855:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867206784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.983860:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867753088:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142904.983861:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6181 00010000:00010000:3.0:1746142904.983896:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1630208->2080767] (req 1630208->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 34 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142904.983923:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3de00, rc 0) 00000100:00100000:3.0:1746142904.983946:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32189:x1830962867206656:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2083us (2309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142904.983952:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13847 00000100:00100000:0.0:1746142904.986484:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.986648:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867206912 00000100:00100000:2.0:1746142904.986656:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867206912 00010000:00010000:2.0:1746142904.986682:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00000100:00100000:2.0:1746142904.986716:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6182 00000100:00100000:2.0:1746142904.986724:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867206912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142904.986734:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142904.986749:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.986764:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.986782:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccbf81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e2a expref: 22 pid: 11421 timeout: 778 lvb_type: 0 00010000:00010000:2.0:1746142904.986807:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.986809:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142904.986814:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.986821:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142904.986847:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142904.986857:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867753216:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142904.986939:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142904.990005:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867753216:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142904.990019:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142904.990047:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.990056:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867206912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3334us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142904.990064:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6182 00000100:00100000:3.0:1746142904.990097:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867207168 00000100:00100000:3.0:1746142904.990102:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867207168 00002000:00100000:3.0:1746142904.990131:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1630208->1634303) req@ffff880097348380 x1830962867207168/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.990140:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348380 with x1830962867207168 ext(1630208->1634303) 00002000:00010000:3.0:1746142904.990143:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097348380 00000100:00100000:3.0:1746142904.990167:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4171 00000100:00100000:3.0:1746142904.990173:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867207168:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142904.990278:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867207168:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 104us (231us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142904.990283:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4171 00002000:00100000:3.0:1746142904.990287:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1630208->1634303) req@ffff880097348380 x1830962867207168/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142904.990293:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348380 with x1830962867207168 ext(1630208->1634303) 00002000:00010000:3.0:1746142904.990296:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097348380 00000100:00100000:0.0:1746142904.995397:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.995506:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867207424 00000100:00100000:2.0:1746142904.995515:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867207424 00002000:00100000:2.0:1746142904.995548:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (2076672->2080767) req@ffff880130121c00 x1830962867207424/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/0 e 0 to 0 dl 1746142915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.995555:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121c00 with x1830962867207424 ext(2076672->2080767) 00002000:00010000:2.0:1746142904.995559:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130121c00 00000100:00100000:2.0:1746142904.995582:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4172 00000100:00100000:2.0:1746142904.995588:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867207424:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142904.995694:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867207424:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 106us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142904.995700:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4172 00002000:00100000:2.0:1746142904.995706:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (2076672->2080767) req@ffff880130121c00 x1830962867207424/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:55/0 lens 488/4536 e 0 to 0 dl 1746142915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142904.995711:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121c00 with x1830962867207424 ext(2076672->2080767) 00002000:00010000:2.0:1746142904.995714:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130121c00 00000100:00100000:0.0:1746142904.999629:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142904.999998:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867207680 00000100:00100000:2.0:1746142905.000005:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867207680 00000100:00100000:2.0:1746142905.000047:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5209 00000100:00100000:2.0:1746142905.000054:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32189:x1830962867207680:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142905.000224:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32189:x1830962867207680:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 170us (601us total) trans 8589936489 rc 0/0 00000100:00100000:2.0:1746142905.000230:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5209 00010000:00010000:3.0:1746142905.098523:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142905.111563:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.111949:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867207936 00000100:00100000:3.0:1746142905.111958:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867207936 00000100:00100000:3.0:1746142905.112018:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14344 00000100:00100000:3.0:1746142905.112025:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32194:x1830962867207936:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.112042:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.112057:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc00d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e7e expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746142905.112073:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746142905.112142:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.112154:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.112163:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142905.112170:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142905.112241:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc00d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 35 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.112268:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 34 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.112274:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.112276:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142905.112279:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c400, rc 0) 00000100:00100000:3.0:1746142905.112327:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32194:x1830962867207936:12345-192.168.204.50@tcp:101:cat.0 Request processed in 303us (772us total) trans 8589936490 rc 0/0 00000100:00100000:3.0:1746142905.112335:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14344 00000100:00100000:0.0:1746142905.118786:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.119136:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867208064 00000100:00100000:3.0:1746142905.119143:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867208064 00000100:00100000:1.0:1746142905.119305:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.119344:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867208192 00000100:00100000:0.0:1746142905.119347:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867208192 00000100:00080000:2.0:1746142905.119398:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746142905.119401:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142905.119424:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13848 00000100:00100000:0.0:1746142905.119433:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867208192:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142905.119449:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13849 00010000:00010000:0.0:1746142905.119449:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142905.119455:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867208064:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.119461:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142905.119464:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccc022 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e8c expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.119476:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccc029 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e85 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142905.119516:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867753344:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142905.119516:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867753472:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142905.119884:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.120181:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142905.123220:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867753344:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142905.123270:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccc029 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e85 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.123283:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccc029 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e85 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.123405:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3ca00, rc 0) 00002000:00010000:1.0:1746142905.123418:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142904 -> 1746142905 00000100:00100000:1.0:1746142905.123430:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867753472:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142905.123446:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccc022 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e8c expref: 32 pid: 1397 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142905.123448:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867208064:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3991us (4666us total) trans 0 rc 301/301 00010000:00010000:1.0:1746142905.123454:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccc022 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e8c expref: 32 pid: 1397 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142905.123456:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13849 00010000:00010000:1.0:1746142905.124187:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600e00, rc 0) 00000100:00100000:1.0:1746142905.124213:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867208192:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4781us (4907us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142905.124218:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13848 00000100:00100000:0.0:1746142905.128802:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.128858:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867208448 00000100:00100000:2.0:1746142905.128867:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867208448 00000100:00100000:2.0:1746142905.128951:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14345 00000100:00100000:2.0:1746142905.128959:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32197:x1830962867208448:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142905.128977:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.128993:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a200/0x2fa243e067ccc030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e93 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.129073:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142905.129085:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.129092:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 35 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.129096:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142905.129120:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 35 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.129130:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 35 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.129140:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867753600:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.129226:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.129233:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 13 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.129241:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867753728:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.129259:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.134153:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.134214:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867208704 00000100:00100000:3.0:1746142905.134221:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867208704 00000100:00100000:0.0:1746142905.134249:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867753600:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.134257:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867753728:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142905.134279:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:3.0:1746142905.134335:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14346 00000100:00100000:3.0:1746142905.134343:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:32199:x1830962867208704:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.134361:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.134375:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc03e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89e9a expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.134455:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.134481:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.134490:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142905.134498:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142905.134567:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc03e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.134582:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 16 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.134589:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.134591:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142905.134594:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.134599:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.134603:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3da00, rc 0) 00000100:00080000:1.0:1746142905.135501:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142905.135562:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:32199:x1830962867208704:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1216us (1412us total) trans 8589936491 rc 0/0 00000100:00100000:3.0:1746142905.135569:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14346 00000100:00100000:0.0:1746142905.137737:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.138216:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.138360:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867208960 00000100:00100000:3.0:1746142905.138368:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867208960 00010000:00010000:3.0:1746142905.138395:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 36 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.138477:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6183 00000100:00100000:1.0:1746142905.138485:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867208960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142905.138496:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142905.138502:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 36 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.138511:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 36 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.138529:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067ccbff8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e70 expref: 36 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.138560:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.138593:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.138705:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209088 00000100:00100000:2.0:1746142905.138709:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209088 00002000:00100000:2.0:1746142905.138737:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880130121180 x1830962867209088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.138745:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121180 with x1830962867209088 ext(0->1048575) 00002000:00010000:2.0:1746142905.138748:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130121180 00000100:00100000:2.0:1746142905.138760:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209344 00000100:00100000:2.0:1746142905.138762:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209344 00002000:00100000:2.0:1746142905.138772:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880130120700 x1830962867209344/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 504/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.138778:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120700 with x1830962867209344 ext(1048576->2097151) 00002000:00010000:2.0:1746142905.138781:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120700 00000100:00100000:2.0:1746142905.138791:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4173 00000100:00100000:2.0:1746142905.138796:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867209088:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1746142905.139071:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142905.139077:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142905.139084:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142905.139088:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142905.139305:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867208960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 819us (1572us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.139312:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6183 00000100:00100000:3.0:1746142905.139351:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209216 00000100:00100000:3.0:1746142905.139355:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209216 00010000:00010000:3.0:1746142905.139368:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.139393:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6184 00000100:00100000:3.0:1746142905.139399:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962867209216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.139406:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.139410:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.139419:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.139430:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d800/0x2fa243e067ccbfc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e5b expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.139440:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.139443:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.139450:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.139455:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00000100:00100000:0.0:1746142905.139456:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4174 00000100:00100000:0.0:1746142905.139462:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867209344:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142905.139501:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.139521:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867209216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 122us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.139527:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6184 00010000:00010000:3.0:1746142905.139552:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.139558:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142905.139572:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142905.139668:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a200/0x2fa243e067ccc030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 36 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.139678:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 35 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.139683:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.139684:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142905.139686:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b000, rc 0) 00000100:00100000:3.0:1746142905.139707:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32197:x1830962867208448:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 10749us (10912us total) trans 8589936492 rc 0/0 00000100:00100000:3.0:1746142905.139713:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14345 00000100:00100000:2.0:1746142905.149419:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.150480:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209600 00000100:00100000:3.0:1746142905.150488:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209600 00000100:00100000:3.0:1746142905.150529:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14347 00000100:00100000:3.0:1746142905.150537:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:32199:x1830962867209600:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.150557:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.150573:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccc05a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ea1 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.150644:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.150657:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 34 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.150662:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.150689:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 34 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.150699:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 34 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.150709:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867753856:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142905.150791:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142905.150944:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867209344:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11479us (12499us total) trans 0 rc 598016/598016 00000100:00100000:1.0:1746142905.150953:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4174 00002000:00100000:1.0:1746142905.150961:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880130120700 x1830962867209344/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 504/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 598016/598016 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.150969:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120700 with x1830962867209344 ext(1048576->2097151) 00002000:00010000:1.0:1746142905.150973:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120700 00000100:00100000:2.0:1746142905.152646:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867209088:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13845us (14425us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142905.152655:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4173 00002000:00100000:2.0:1746142905.152661:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880130121180 x1830962867209088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.152668:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130121180 with x1830962867209088 ext(0->1048575) 00002000:00010000:2.0:1746142905.152673:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130121180 00000100:00100000:2.0:1746142905.158045:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.158121:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209728 00000100:00100000:1.0:1746142905.158128:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209728 00000100:00100000:3.0:1746142905.158193:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867753856:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142905.158228:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142905.158597:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 35 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.158618:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6185 00000100:00100000:1.0:1746142905.158625:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867209728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142905.158636:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142905.158641:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 35 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.158650:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 35 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.158668:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccc037 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e93 expref: 35 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.158680:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142905.158684:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142905.158692:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142905.158698:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142905.158836:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142905.158948:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867209728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 322us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.158954:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6185 00010000:00010000:2.0:1746142905.159440:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142905.159447:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:2.0:1746142905.159497:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:2.0:1746142905.159500:0:22383:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142905.159514:0:22383:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142905.159540:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccc05a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 17 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.159564:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 16 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.159570:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.159572:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142905.159574:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d600, rc 0) 00000100:00100000:2.0:1746142905.159598:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:32199:x1830962867209600:12345-192.168.204.50@tcp:101:cat.0 Request processed in 9062us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.159605:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14347 00000100:00100000:0.0:1746142905.167001:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.167066:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209856 00000100:00100000:1.0:1746142905.167074:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209856 00000100:00100000:1.0:1746142905.167138:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13850 00000100:00100000:1.0:1746142905.167145:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867209856:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142905.167161:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.167176:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc068 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ea8 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.167226:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867753984:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142905.167299:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746142905.167493:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142905.170623:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.170696:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867209984 00000100:00100000:3.0:1746142905.170703:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867209984 00000100:00100000:3.0:1746142905.170740:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13851 00000100:00100000:1.0:1746142905.170744:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867753984:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142905.170747:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867209984:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.170762:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.170768:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc068 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea8 expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.170772:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130400/0x2fa243e067ccc06f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89eaf expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.170780:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc068 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea8 expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.170794:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2e800, rc 0) 00000100:00100000:3.0:1746142905.170802:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867754112:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142905.170822:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867209856:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3678us (3829us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142905.170828:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13850 00000100:00100000:3.0:1746142905.170841:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.171220:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.171487:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867210112 00000100:00100000:2.0:1746142905.171491:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867210112 00000100:00100000:2.0:1746142905.171516:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13852 00000100:00100000:2.0:1746142905.171521:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867210112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.171530:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.171537:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a89c400/0x2fa243e067ccc076 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89eb6 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.171561:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867754240:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142905.172483:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142905.174880:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867754240:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142905.174925:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a89c400/0x2fa243e067ccc076 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eb6 expref: 32 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.174939:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a89c400/0x2fa243e067ccc076 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eb6 expref: 32 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142905.175057:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867754112:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142905.175094:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130400/0x2fa243e067ccc06f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eaf expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.175102:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130400/0x2fa243e067ccc06f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eaf expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.175115:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130400, rc 0) 00000100:00100000:3.0:1746142905.175165:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867209984:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4417us (4548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142905.175172:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13851 00010000:00010000:2.0:1746142905.177129:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89c400, rc 0) 00000100:00100000:2.0:1746142905.177660:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867210112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6134us (6435us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142905.177667:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13852 00000100:00100000:0.0:1746142905.183287:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.183376:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867210240 00000100:00100000:2.0:1746142905.183383:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867210240 00000100:00100000:2.0:1746142905.183421:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13853 00000100:00100000:2.0:1746142905.183427:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:32199:x1830962867210240:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.183441:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.183453:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ebd expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.183483:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.183490:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142905.183492:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142905.183495:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 22 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.183516:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.183524:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.183533:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867754368:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.183595:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.186945:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.187022:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867210368 00000100:00100000:3.0:1746142905.187030:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867210368 00000100:00100000:3.0:1746142905.187068:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13854 00000100:00100000:3.0:1746142905.187075:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32194:x1830962867210368:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.187089:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.187102:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ec4 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.187128:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.187135:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142905.187136:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142905.187139:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 35 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.187161:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.187171:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 22 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.187181:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867754496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142905.187247:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.189654:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.189721:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867210496 00000100:00100000:2.0:1746142905.189728:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867210496 00002000:00100000:2.0:1746142905.189764:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1630208->2080767) req@ffff880088fd8380 x1830962867210496/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.189775:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8380 with x1830962867210496 ext(1630208->2080767) 00010000:00010000:2.0:1746142905.189784:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.189793:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.189799:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8380 00000100:00100000:2.0:1746142905.189829:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1291 00000100:00100000:2.0:1746142905.189836:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867210496:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142905.190003:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867754368:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.190021:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 22 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.190033:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89c600, rc 0) 00000100:00100000:2.0:1746142905.190053:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:32199:x1830962867210240:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6626us (6772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.190059:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13853 00000100:00100000:3.0:1746142905.190561:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867754496:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142905.190592:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.190600:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130800, rc 0) 00000100:00100000:3.0:1746142905.190616:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32194:x1830962867210368:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3542us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.190621:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13854 00000100:00100000:1.0:1746142905.194813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.195376:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867210624 00000100:00100000:2.0:1746142905.195384:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867210624 00002000:00100000:2.0:1746142905.195415:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3588095) req@ffff880096140000 x1830962867210624/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.195423:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140000 with x1830962867210624 ext(3145728->3588095) 00010000:00010000:2.0:1746142905.195435:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 22 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.195446:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 22 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.195452:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096140000 00000100:00100000:2.0:1746142905.195484:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1292 00000100:00100000:2.0:1746142905.195491:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867210624:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142905.197213:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867210496:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7373us (7560us total) trans 21474841128 rc 0/0 00000100:00100000:0.0:1746142905.197221:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1291 00002000:00100000:0.0:1746142905.197228:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1630208->2080767) req@ffff880088fd8380 x1830962867210496/t21474841128(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.197235:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8380 with x1830962867210496 ext(1630208->2080767) 00010000:00010000:0.0:1746142905.197242:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.197251:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746142905.197257:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8380 00000100:00100000:1.0:1746142905.197429:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.197535:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867210880 00000100:00100000:3.0:1746142905.197540:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867210880 00000100:00100000:3.0:1746142905.197565:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14348 00000100:00100000:3.0:1746142905.197571:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:32202:x1830962867210880:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142905.197582:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.197596:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccc08b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ecb expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.197647:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197657:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197666:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197676:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197681:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197686:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197750:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccc0a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197758:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccc0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197763:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccc0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142905.197772:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142905.197815:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197821:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197826:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197830:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197835:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096131c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142905.197838:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197843:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197852:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142905.197854:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142905.197857:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197862:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccc092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197876:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197880:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197888:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197891:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096131000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142905.197893:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197912:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197917:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdf00) 00010000:00010000:3.0:1746142905.197919:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142905.197921:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197924:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131000/0x2fa243e067ccc099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142905.197950:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131400/0x2fa243e067ccc08b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ecb expref: 19 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.197959:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccc0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ecb expref: 18 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.197964:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.197965:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142905.197967:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130a00, rc 0) 00000100:00100000:3.0:1746142905.197986:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:32202:x1830962867210880:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 416us (558us total) trans 8589936493 rc 0/0 00000100:00100000:3.0:1746142905.197991:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14348 00000100:00100000:2.0:1746142905.203372:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.203894:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867211008 00000100:00100000:0.0:1746142905.203914:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867211008 00000100:00100000:2.0:1746142905.203917:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142905.203943:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.203965:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867211136 00000100:00100000:0.0:1746142905.203968:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867211136 00000100:00100000:0.0:1746142905.203984:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6186 00000100:00100000:0.0:1746142905.203990:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867211008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.204000:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.204016:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.204025:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.204048:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3de00/0x2fa243e067ccc006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1630208->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e77 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.204073:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.204075:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.204080:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.204087:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142905.204132:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 754 00000100:00100000:3.0:1746142905.204139:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867211136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.204147:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.204160:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130a00/0x2fa243e067ccc0a0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ecb expref: 18 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.204172:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.204176:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.204233:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867211136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.204239:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 754 00010000:00010000:0.0:1746142905.205510:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 25 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.205524:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867754624:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142905.205602:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142905.205790:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867210624:12345-192.168.204.50@tcp:4:cat.0 Request processed in 10299us (10981us total) trans 21474841129 rc 0/0 00000100:00100000:3.0:1746142905.205797:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1292 00002000:00100000:3.0:1746142905.205804:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3588095) req@ffff880096140000 x1830962867210624/t21474841129(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.205812:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140000 with x1830962867210624 ext(3145728->3588095) 00010000:00010000:3.0:1746142905.205818:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 24 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.205829:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 24 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.205834:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096140000 00000100:00100000:0.0:1746142905.212379:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.212505:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867754624:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142905.212521:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.212559:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867211008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8568us (9195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.212568:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6186 00000100:00100000:2.0:1746142905.213613:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867211264 00000100:00100000:2.0:1746142905.213619:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867211264 00010000:00010000:2.0:1746142905.213642:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 24 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.213671:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6187 00000100:00100000:3.0:1746142905.213678:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867211264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.213690:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.213705:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 24 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.214054:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 24 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.214074:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b600/0x2fa243e067ccbfdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3588095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e69 expref: 24 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.214089:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.214091:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.214097:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 35 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.214105:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 35 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.214131:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 35 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142905.214140:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867754752:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142905.214186:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880088f8b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.215628:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.215663:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.215680:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867211520 00000100:00100000:3.0:1746142905.215685:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867211520 00002000:00100000:3.0:1746142905.215714:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088fdbb80 x1830962867211520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.215727:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdbb80 with x1830962867211520 ext(1048576->2097151) 00002000:00010000:3.0:1746142905.215731:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdbb80 00000100:00100000:3.0:1746142905.215758:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4175 00000100:00100000:3.0:1746142905.215765:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867211520:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142905.216159:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867211648 00000100:00100000:2.0:1746142905.216162:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867211648 00000100:00100000:2.0:1746142905.216183:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13855 00000100:00100000:2.0:1746142905.216188:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32197:x1830962867211648:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142905.216195:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.216207:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ed2 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.216223:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.216229:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.216231:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.216234:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3063808->3145727] (req 3063808->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 37 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.216253:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.216263:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.216272:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867754880:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.217597:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867754752:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142905.217627:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.217914:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.218398:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867211264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4719us (6023us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.218407:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6187 00000100:00100000:0.0:1746142905.220240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.220398:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867754880:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.220421:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3063808->3145727] (req 3063808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 37 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.220436:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1800, rc 0) 00000100:00100000:2.0:1746142905.220492:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32197:x1830962867211648:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4303us (4828us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.220499:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13855 00000100:00100000:1.0:1746142905.220500:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867211904 00000100:00100000:1.0:1746142905.220505:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867211904 00002000:00100000:1.0:1746142905.220532:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880088fd9500 x1830962867211904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.220540:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9500 with x1830962867211904 ext(2097152->3145727) 00010000:00010000:1.0:1746142905.220546:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.220556:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.220561:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd9500 00000100:00100000:1.0:1746142905.220588:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1293 00000100:00100000:1.0:1746142905.220595:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867211904:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142905.224726:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867211520:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8954us (9095us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142905.224736:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4175 00002000:00100000:3.0:1746142905.224746:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088fdbb80 x1830962867211520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.224755:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdbb80 with x1830962867211520 ext(1048576->2097151) 00002000:00010000:3.0:1746142905.224760:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdbb80 00000100:00100000:1.0:1746142905.228291:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867211904:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7688us (8047us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142905.228302:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1293 00002000:00100000:1.0:1746142905.228311:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880088fd9500 x1830962867211904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.228320:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9500 with x1830962867211904 ext(2097152->3145727) 00010000:00010000:1.0:1746142905.228328:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.228340:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.228347:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd9500 00000100:00100000:0.0:1746142905.231272:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.231409:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867212032 00000100:00100000:2.0:1746142905.231417:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867212032 00000100:00100000:2.0:1746142905.231459:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13856 00000100:00100000:2.0:1746142905.231477:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:32199:x1830962867212032:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.231491:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.231506:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ed9 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.231529:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.231535:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3063808->3145727] (req 3063808->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.231545:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142905.231548:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 24 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.231579:0:11421:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3063808->3145727] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.231589:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 24 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.231598:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3a00, rc 0) 00000100:00100000:2.0:1746142905.231667:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:32199:x1830962867212032:12345-192.168.204.50@tcp:101:cat.0 Request processed in 199us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.231674:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13856 00000100:00100000:0.0:1746142905.232852:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.232934:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867212160 00000100:00100000:2.0:1746142905.232940:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867212160 00000100:00100000:2.0:1746142905.232972:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13857 00000100:00100000:2.0:1746142905.232980:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32194:x1830962867212160:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.232993:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.233006:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ee0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.233027:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.233037:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142905.233039:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142905.233042:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.233065:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.233075:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 11 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.233085:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867755136:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.233360:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.234827:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.234933:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867212288 00000100:00100000:2.0:1746142905.234940:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867212288 00010000:00010000:2.0:1746142905.234967:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.235016:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6188 00000100:00100000:2.0:1746142905.235025:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867212288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.235037:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.235057:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.235070:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.235089:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc084 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ec4 expref: 37 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.235690:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.235693:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.235700:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.235737:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.235835:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.235888:0:7219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.236075:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867755264:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.236141:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142905.236995:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867755136:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.237016:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.237028:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3e00, rc 0) 00000100:00100000:2.0:1746142905.237056:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32194:x1830962867212160:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4076us (4205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.237064:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13857 00000100:00100000:1.0:1746142905.237336:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.237605:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867212416 00000100:00100000:0.0:1746142905.237612:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867212416 00000100:00080000:2.0:1746142905.237663:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:0.0:1746142905.237678:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3043328->3145727) req@ffff880097432d80 x1830962867212416/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.238111:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432d80 with x1830962867212416 ext(3043328->3145727) 00010000:00010000:0.0:1746142905.238120:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 12 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.238129:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 12 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746142905.238135:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097432d80 00000100:00100000:0.0:1746142905.238175:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1294 00000100:00100000:0.0:1746142905.238184:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867212416:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142905.242776:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.242928:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867212672 00000100:00100000:3.0:1746142905.242935:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867212672 00000100:00100000:2.0:1746142905.243242:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867755264:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142905.243262:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.243377:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867212288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8351us (8553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.243386:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6188 00002000:00100000:3.0:1746142905.243489:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3063808->3067903) req@ffff880097432680 x1830962867212672/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.243498:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432680 with x1830962867212672 ext(3063808->3067903) 00010000:00010000:3.0:1746142905.243505:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.243515:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.243521:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097432680 00000100:00100000:3.0:1746142905.243551:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1295 00000100:00100000:3.0:1746142905.243558:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867212672:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142905.243666:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867212672:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 108us (898us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142905.243671:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1295 00002000:00100000:3.0:1746142905.243676:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3063808->3067903) req@ffff880097432680 x1830962867212672/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.243683:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432680 with x1830962867212672 ext(3063808->3067903) 00010000:00010000:3.0:1746142905.243687:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.243695:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.243699:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097432680 00000100:00100000:2.0:1746142905.244385:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867212416:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6200us (7049us total) trans 17179873862 rc 0/0 00000100:00100000:2.0:1746142905.244393:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1294 00002000:00100000:2.0:1746142905.244400:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3043328->3145727) req@ffff880097432d80 x1830962867212416/t17179873862(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.244408:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432d80 with x1830962867212416 ext(3043328->3145727) 00010000:00010000:2.0:1746142905.244416:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.244425:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.244431:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097432d80 00000100:00100000:0.0:1746142905.247426:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.247492:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867213056 00000100:00100000:2.0:1746142905.247499:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867213056 00002000:00100000:2.0:1746142905.247532:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3063808->3145727) req@ffff880088fd8700 x1830962867213056/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.247540:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8700 with x1830962867213056 ext(3063808->3145727) 00010000:00010000:2.0:1746142905.247549:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.247559:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 36 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.247565:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8700 00000100:00100000:2.0:1746142905.247596:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1296 00000100:00100000:2.0:1746142905.247602:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867213056:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142905.247812:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.247858:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.248326:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867213184 00000100:00100000:3.0:1746142905.248332:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867213184 00000100:00100000:3.0:1746142905.248367:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13858 00000100:00100000:3.0:1746142905.248373:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32197:x1830962867213184:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142905.248382:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.248394:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ee7 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.248410:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142905.248414:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.248424:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142905.248426:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2641919] (req 2097152->2641919) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.248430:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867212928 00000100:00100000:2.0:1746142905.248434:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867212928 00010000:00010000:2.0:1746142905.248451:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.248456:0:11421:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.248479:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6189 00010000:00010000:3.0:1746142905.248481:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2641919] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.248484:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867212928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.248490:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130000, rc 0) 00010000:00010000:2.0:1746142905.248491:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.248502:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.248510:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.248517:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32197:x1830962867213184:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 144us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.248522:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13858 00010000:00010000:2.0:1746142905.248524:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a89ca00/0x2fa243e067ccbfd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e62 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.248539:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.248540:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.248545:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.248550:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.248666:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.248674:0:7219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 32 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.248684:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867755520:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.248738:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.249885:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867213056:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 2280us (2462us total) trans 21474841130 rc 0/0 00000100:00100000:0.0:1746142905.249891:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1296 00002000:00100000:0.0:1746142905.249929:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3063808->3145727) req@ffff880088fd8700 x1830962867213056/t21474841130(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.249938:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8700 with x1830962867213056 ext(3063808->3145727) 00010000:00010000:0.0:1746142905.249945:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.249957:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746142905.249963:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8700 00000100:00100000:0.0:1746142905.253342:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.253625:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867755520:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142905.253641:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.253673:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867212928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5188us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.253681:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6189 00000100:00100000:2.0:1746142905.253702:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867213312 00000100:00100000:2.0:1746142905.253707:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867213312 00010000:00010000:2.0:1746142905.253729:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.253785:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6190 00000100:00100000:2.0:1746142905.253795:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867213312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.253810:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.253830:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.253840:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.253861:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d1800/0x2fa243e067ccc0ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3063808->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed2 expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.253881:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.253883:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.253890:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.253935:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.253971:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.253984:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867755648:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.254048:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.256133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.256197:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867213568 00000100:00100000:1.0:1746142905.256203:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867213568 00002000:00100000:1.0:1746142905.256237:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880088fd9880 x1830962867213568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.256245:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9880 with x1830962867213568 ext(2097152->3145727) 00010000:00010000:1.0:1746142905.256252:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.256262:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867755648:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142905.256262:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.256271:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088fd9880 00010000:00010000:2.0:1746142905.256275:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142905.256301:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1297 00000100:00100000:2.0:1746142905.256303:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867213312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2511us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.256307:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867213568:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142905.256309:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6190 00000100:00100000:0.0:1746142905.260664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.261055:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867213824 00000100:00100000:2.0:1746142905.261064:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867213824 00002000:00100000:2.0:1746142905.261099:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092405500 x1830962867213824/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.261108:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405500 with x1830962867213824 ext(2097152->3145727) 00002000:00010000:2.0:1746142905.261112:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405500 00000100:00100000:2.0:1746142905.261139:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4176 00000100:00100000:2.0:1746142905.261146:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867213824:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142905.267040:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867213568:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 10723us (10905us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142905.267050:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1297 00002000:00100000:1.0:1746142905.267060:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880088fd9880 x1830962867213568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.267069:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9880 with x1830962867213568 ext(2097152->3145727) 00010000:00010000:1.0:1746142905.267078:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.267090:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.267096:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088fd9880 00000100:00100000:2.0:1746142905.268995:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867213824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7842us (8331us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142905.269003:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4176 00002000:00100000:2.0:1746142905.269010:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092405500 x1830962867213824/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.269018:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405500 with x1830962867213824 ext(2097152->3145727) 00002000:00010000:2.0:1746142905.269023:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405500 00000100:00100000:0.0:1746142905.271406:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.271477:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867213952 00000100:00100000:3.0:1746142905.271486:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867213952 00000100:00100000:3.0:1746142905.271534:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13859 00000100:00100000:3.0:1746142905.271541:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32194:x1830962867213952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.271557:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.271572:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89eee expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.271593:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.271595:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.271601:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 38 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.271619:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 38 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.271775:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36000, rc 0) 00000100:00100000:3.0:1746142905.271972:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32194:x1830962867213952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 430us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.271978:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13859 00000100:00100000:0.0:1746142905.272462:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.272524:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867214080 00000100:00100000:2.0:1746142905.272529:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867214080 00010000:00010000:2.0:1746142905.272550:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.272585:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6191 00000100:00100000:2.0:1746142905.272590:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867214080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.272600:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.272616:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.272626:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.272648:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccc0bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee0 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.272666:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.272667:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.272672:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.272678:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.272704:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 32 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.272717:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867755776:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.272778:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.275560:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.275675:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867755776:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142905.275690:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.275736:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867214080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3144us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.275744:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6191 00000100:00100000:3.0:1746142905.275817:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867214208 00000100:00100000:3.0:1746142905.275824:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867214208 00000100:00100000:3.0:1746142905.275853:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13860 00000100:00100000:3.0:1746142905.275859:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:32199:x1830962867214208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.275873:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.275885:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ef5 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.275922:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.275930:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142905.275931:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142905.275934:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.275954:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.275970:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 31 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.275979:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867755904:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142905.276020:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a85840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.279432:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.279613:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867214592 00000100:00100000:2.0:1746142905.279620:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867214592 00002000:00100000:2.0:1746142905.279652:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092407100 x1830962867214592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.279661:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407100 with x1830962867214592 ext(3145728->4194303) 00002000:00010000:2.0:1746142905.279665:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407100 00000100:00100000:2.0:1746142905.279924:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4177 00000100:00100000:2.0:1746142905.279932:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867214592:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142905.281206:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.281234:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.281292:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867214720 00000100:00100000:1.0:1746142905.281298:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867214720 00002000:00100000:1.0:1746142905.281319:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880092407b80 x1830962867214720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746142905.281327:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867755904:192.168.204.50@tcp:104: 00002000:00100000:1.0:1746142905.281328:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407b80 with x1830962867214720 ext(3145728->4194303) 00010000:00010000:1.0:1746142905.281335:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 32 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.281348:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.281352:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 32 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.281358:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092407b80 00010000:00010000:3.0:1746142905.281360:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36200, rc 0) 00000100:00100000:1.0:1746142905.281378:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867214976 00000100:00100000:1.0:1746142905.281381:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867214976 00002000:00100000:1.0:1746142905.281392:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2637824->2641919) req@ffff880092407800 x1830962867214976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.281398:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407800 with x1830962867214976 ext(2637824->2641919) 00010000:00010000:1.0:1746142905.281402:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.281408:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1298 00010000:00010000:1.0:1746142905.281410:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.281415:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092407800 00000100:00100000:2.0:1746142905.281416:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867214720:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142905.281440:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1299 00000100:00100000:1.0:1746142905.281445:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867214976:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142905.281521:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867214976:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 75us (285us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142905.281526:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1299 00002000:00100000:1.0:1746142905.281531:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2637824->2641919) req@ffff880092407800 x1830962867214976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142905.281537:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407800 with x1830962867214976 ext(2637824->2641919) 00010000:00010000:1.0:1746142905.281541:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 34 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.281548:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 34 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:1.0:1746142905.281553:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092407800 00000100:00100000:3.0:1746142905.281666:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e548450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:32199:x1830962867214208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5807us (6112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.281672:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13860 00000100:00100000:2.0:1746142905.291959:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867214592:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 12019us (12525us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142905.291970:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4177 00002000:00100000:2.0:1746142905.291980:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092407100 x1830962867214592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.291990:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407100 with x1830962867214592 ext(3145728->4194303) 00002000:00010000:2.0:1746142905.291995:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407100 00000100:00100000:0.0:1746142905.293387:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.293445:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867215488 00000100:00100000:2.0:1746142905.293453:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867215488 00000100:00100000:2.0:1746142905.293510:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5210 00000100:00100000:2.0:1746142905.293518:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32197:x1830962867215488:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142905.293785:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32197:x1830962867215488:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 267us (402us total) trans 8589936494 rc 0/0 00000100:00100000:2.0:1746142905.293792:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5210 00000100:00100000:2.0:1746142905.294240:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.294455:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867215232 00000100:00100000:0.0:1746142905.294460:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867215232 00002000:00100000:0.0:1746142905.294494:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2641919) req@ffff880091c05c00 x1830962867215232/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.294502:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05c00 with x1830962867215232 ext(2097152->2641919) 00010000:00010000:0.0:1746142905.294509:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 34 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.294520:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 34 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:0.0:1746142905.294525:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c05c00 00000100:00100000:0.0:1746142905.294550:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1300 00000100:00100000:0.0:1746142905.294556:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867215232:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142905.298312:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867214720:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 16890us (17102us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142905.298323:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1298 00002000:00100000:2.0:1746142905.298334:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880092407b80 x1830962867214720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.298342:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407b80 with x1830962867214720 ext(3145728->4194303) 00010000:00010000:2.0:1746142905.298351:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 34 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.298363:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 34 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.298370:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092407b80 00000100:00100000:0.0:1746142905.304601:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.305612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.306160:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867215616 00000100:00100000:2.0:1746142905.306168:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867215616 00000100:00100000:1.0:1746142905.306306:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867215744 00000100:00100000:1.0:1746142905.306310:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867215744 00000100:00100000:2.0:1746142905.306313:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13861 00000100:00100000:2.0:1746142905.306322:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:32202:x1830962867215616:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:1.0:1746142905.306331:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13862 00010000:00010000:2.0:1746142905.306336:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142905.306337:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32194:x1830962867215744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142905.306343:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.306354:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f03 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.306354:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89efc expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.306374:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142905.306377:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142905.306380:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.306389:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142905.306393:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.306399:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142905.306402:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.306412:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.306421:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea4dc00, rc 0) 00010000:00010000:2.0:1746142905.306428:0:11421:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.306436:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.306442:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3000, rc 0) 00000100:00100000:2.0:1746142905.306476:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:32202:x1830962867215616:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 145us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.306476:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32194:x1830962867215744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 128us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.306482:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13862 00000100:00100000:2.0:1746142905.306485:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13861 00000100:00100000:3.0:1746142905.306950:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867215232:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 12392us (12709us total) trans 17179873863 rc 0/0 00000100:00100000:3.0:1746142905.306957:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1300 00002000:00100000:3.0:1746142905.306965:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2641919) req@ffff880091c05c00 x1830962867215232/t17179873863(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.306973:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05c00 with x1830962867215232 ext(2097152->2641919) 00010000:00010000:3.0:1746142905.306979:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 35 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.306990:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 35 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.306996:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c05c00 00000100:00100000:0.0:1746142905.311291:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.311355:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867215872 00000100:00100000:2.0:1746142905.311363:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867215872 00010000:00010000:2.0:1746142905.311394:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 35 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.311435:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6192 00000100:00100000:2.0:1746142905.311443:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2003:x1830962867215872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.311454:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.311484:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 35 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.311495:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 35 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.311514:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc0c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2641919) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ee7 expref: 35 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.311540:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.311542:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.311547:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.311554:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.311562:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.311562:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.311565:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.311569:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.311590:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.311598:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867756160:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142905.311660:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.311667:0:7219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.311672:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867756288:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.311682:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142905.312985:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867756160:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.312994:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867756288:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142905.313006:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.313031:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867215872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1589us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.313043:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6192 00000100:00100000:1.0:1746142905.315212:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.315267:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867216128 00000100:00100000:3.0:1746142905.315274:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867216128 00002000:00100000:3.0:1746142905.315310:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880097433100 x1830962867216128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.315319:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433100 with x1830962867216128 ext(3145728->4194303) 00002000:00010000:3.0:1746142905.315323:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097433100 00000100:00100000:3.0:1746142905.315354:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4178 00000100:00100000:3.0:1746142905.315361:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867216128:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142905.324136:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.324173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.324240:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867216640 00000100:00100000:2.0:1746142905.324248:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867216640 00002000:00100000:2.0:1746142905.324283:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092407480 x1830962867216640/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.324292:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407480 with x1830962867216640 ext(3145728->4194303) 00002000:00010000:2.0:1746142905.324297:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407480 00000100:00100000:2.0:1746142905.324323:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867216512 00000100:00100000:2.0:1746142905.324326:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867216512 00002000:00100000:2.0:1746142905.324338:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092404700 x1830962867216512/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.324345:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404700 with x1830962867216512 ext(2097152->4194303) 00010000:00010000:2.0:1746142905.324353:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 15 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.324366:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 15 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.324372:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092404700 00000100:00100000:2.0:1746142905.324395:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1301 00000100:00100000:2.0:1746142905.324402:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867216512:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142905.324419:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4179 00000100:00100000:1.0:1746142905.324426:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867216640:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142905.325501:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867216128:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 10138us (10292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142905.325508:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4178 00002000:00100000:3.0:1746142905.325515:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880097433100 x1830962867216128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.325523:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433100 with x1830962867216128 ext(3145728->4194303) 00002000:00010000:3.0:1746142905.325526:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097433100 00000100:00100000:0.0:1746142905.335521:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.335560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.335587:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867216768 00000100:00100000:2.0:1746142905.335596:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867216768 00000100:00100000:2.0:1746142905.335634:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867216896 00000100:00100000:2.0:1746142905.335635:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867216896 00000100:00100000:2.0:1746142905.337669:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13863 00000100:00100000:2.0:1746142905.337684:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867216768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.337699:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.337713:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f0a expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.337732:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.337733:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.337740:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 39 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.337753:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 39 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.337762:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2400, rc 0) 00000100:00100000:2.0:1746142905.337819:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867216768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 141us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.337825:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13863 00000100:00100000:2.0:1746142905.337839:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13864 00000100:00100000:2.0:1746142905.337844:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867216896:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.337851:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.337859:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc0ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f11 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.337868:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.337874:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc0ed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f11 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.337882:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc0ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f11 expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.337894:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3c00, rc 0) 00000100:00100000:2.0:1746142905.337942:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867216896:12345-192.168.204.50@tcp:101:cat.0 Request processed in 97us (2381us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142905.337946:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13864 00000100:00100000:0.0:1746142905.338212:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867216640:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 13786us (14082us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142905.338219:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4179 00002000:00100000:0.0:1746142905.338227:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092407480 x1830962867216640/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.338235:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407480 with x1830962867216640 ext(3145728->4194303) 00002000:00010000:0.0:1746142905.338239:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407480 00000100:00100000:2.0:1746142905.346297:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867216512:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 21886us (22114us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142905.346309:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1301 00002000:00100000:2.0:1746142905.346320:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092404700 x1830962867216512/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.346329:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404700 with x1830962867216512 ext(2097152->4194303) 00010000:00010000:2.0:1746142905.346340:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 15 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.346354:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 15 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:2.0:1746142905.346360:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092404700 00000100:00100000:0.0:1746142905.346562:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.346807:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867217152 00000100:00100000:2.0:1746142905.346814:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867217152 00002000:00100000:2.0:1746142905.346841:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092404000 x1830962867217152/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.346847:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404000 with x1830962867217152 ext(4194304->5033983) 00002000:00010000:2.0:1746142905.346850:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404000 00000100:00100000:2.0:1746142905.346874:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4180 00000100:00100000:2.0:1746142905.346881:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867217152:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142905.352163:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867217152:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5273us (5591us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746142905.352173:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4180 00002000:00100000:2.0:1746142905.352182:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092404000 x1830962867217152/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.352191:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404000 with x1830962867217152 ext(4194304->5033983) 00002000:00010000:2.0:1746142905.352195:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404000 00000100:00100000:0.0:1746142905.352659:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.353691:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867217280 00000100:00100000:1.0:1746142905.353699:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867217280 00000100:00100000:1.0:1746142905.353735:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13865 00000100:00100000:1.0:1746142905.353740:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:32199:x1830962867217280:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142905.353755:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.353768:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f18 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.353788:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.353790:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.353796:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.353808:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.353817:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0a00, rc 0) 00000100:00100000:1.0:1746142905.353848:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:32199:x1830962867217280:12345-192.168.204.50@tcp:101:cat.0 Request processed in 107us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.353853:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13865 00000100:00100000:0.0:1746142905.354429:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.354483:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867217408 00000100:00100000:2.0:1746142905.354487:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867217408 00010000:00010000:2.0:1746142905.354508:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 16 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.354617:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6193 00000100:00100000:2.0:1746142905.354623:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867217408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.354632:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.354648:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 16 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.354658:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 16 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.354674:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a36200/0x2fa243e067ccc0d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ef5 expref: 16 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.354698:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.354700:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.354704:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.354710:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.354734:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.354743:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867756416:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142905.354814:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.356617:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.356945:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867217664 00000100:00100000:2.0:1746142905.356951:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867217664 00002000:00100000:2.0:1746142905.356982:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880092406d80 x1830962867217664/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.356992:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406d80 with x1830962867217664 ext(3145728->4194303) 00002000:00010000:2.0:1746142905.356995:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406d80 00000100:00100000:2.0:1746142905.357026:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4181 00000100:00100000:2.0:1746142905.357033:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867217664:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142905.357079:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.357151:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867756416:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142905.357164:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.357192:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867217408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2569us (2765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.357198:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6193 00000100:00100000:3.0:1746142905.357258:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867217792 00000100:00100000:3.0:1746142905.357260:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867217792 00000100:00100000:3.0:1746142905.357279:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13866 00000100:00100000:3.0:1746142905.357284:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867217792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142905.357291:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142905.357309:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x2fa243e067ccc0fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f1f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.357327:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x2fa243e067ccc0fb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f1f expref: 35 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.357335:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a36600/0x2fa243e067ccc0fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f1f expref: 35 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.357347:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36600, rc 0) 00000100:00100000:3.0:1746142905.357365:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867217792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 80us (285us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142905.357369:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13866 00000100:00100000:3.0:1746142905.358616:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.358750:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218048 00000100:00100000:0.0:1746142905.358754:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218048 00002000:00100000:0.0:1746142905.358776:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2707456->2711551) req@ffff88009734a300 x1830962867218048/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.358784:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734a300 with x1830962867218048 ext(2707456->2711551) 00002000:00010000:0.0:1746142905.358788:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734a300 00000100:00100000:0.0:1746142905.358812:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4182 00000100:00100000:0.0:1746142905.358819:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867218048:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142905.358891:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867218048:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 73us (278us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142905.358897:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4182 00002000:00100000:0.0:1746142905.358915:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2707456->2711551) req@ffff88009734a300 x1830962867218048/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142905.358922:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734a300 with x1830962867218048 ext(2707456->2711551) 00002000:00010000:0.0:1746142905.358924:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734a300 00000100:00100000:0.0:1746142905.363718:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.363768:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218176 00000100:00100000:2.0:1746142905.363777:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218176 00000100:00100000:2.0:1746142905.363821:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13867 00000100:00100000:2.0:1746142905.363828:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867218176:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.363842:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.363854:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc102 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f26 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.363878:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc102 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f26 expref: 35 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.363887:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc102 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f26 expref: 35 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.363924:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2a00, rc 0) 00000100:00100000:2.0:1746142905.363971:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867218176:12345-192.168.204.50@tcp:101:cat.0 Request processed in 144us (259us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142905.363976:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13867 00000100:00100000:2.0:1746142905.365368:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867217664:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 8331us (8752us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142905.365376:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4181 00002000:00100000:2.0:1746142905.365384:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880092406d80 x1830962867217664/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142905.365392:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406d80 with x1830962867217664 ext(3145728->4194303) 00002000:00010000:2.0:1746142905.365396:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406d80 00000100:00100000:0.0:1746142905.369202:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.369285:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218304 00000100:00100000:2.0:1746142905.369293:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218304 00000100:00100000:2.0:1746142905.369339:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13868 00000100:00100000:2.0:1746142905.369346:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867218304:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.369362:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.369451:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067ccc109 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f2d expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.369569:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067ccc109 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f2d expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.369580:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067ccc109 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f2d expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.369588:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2000, rc 0) 00000100:00100000:2.0:1746142905.369642:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867218304:12345-192.168.204.50@tcp:101:cat.0 Request processed in 295us (446us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142905.369648:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13868 00000100:00100000:0.0:1746142905.374410:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.374454:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.374526:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218432 00000100:00100000:2.0:1746142905.374534:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218432 00000100:00100000:2.0:1746142905.374566:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13869 00000100:00100000:2.0:1746142905.374572:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:32202:x1830962867218432:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142905.374587:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.374600:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f34 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.374623:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.374631:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 38 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.374637:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.374638:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.374641:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.374664:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 38 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.374674:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 38 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.374684:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867756544:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.374756:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.374769:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 25 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.374777:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867756672:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.374793:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142905.375457:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218688 00000100:00100000:3.0:1746142905.375471:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218688 00002000:00100000:3.0:1746142905.375495:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880093bcca80 x1830962867218688/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.375504:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcca80 with x1830962867218688 ext(4194304->5033983) 00010000:00010000:3.0:1746142905.375511:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 26 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.375520:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 26 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.375531:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093bcca80 00000100:00100000:3.0:1746142905.375882:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1302 00000100:00100000:3.0:1746142905.375890:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867218688:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142905.376152:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867756544:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.376193:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867756672:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.376211:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.376223:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:2.0:1746142905.376263:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:32202:x1830962867218432:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1690us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.376269:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13869 00000100:00100000:3.0:1746142905.380040:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2003:x1830962867218688:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4142us (5576us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746142905.380050:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1302 00002000:00100000:3.0:1746142905.380060:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880093bcca80 x1830962867218688/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/440 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.380068:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcca80 with x1830962867218688 ext(4194304->5033983) 00010000:00010000:3.0:1746142905.380077:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 25 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.380088:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 25 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.380093:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093bcca80 00000100:00100000:0.0:1746142905.380934:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.381626:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218816 00000100:00100000:3.0:1746142905.381633:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218816 00010000:00010000:3.0:1746142905.381658:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 39 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.381694:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6194 00000100:00100000:3.0:1746142905.381701:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867218816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.381714:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.381728:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 39 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.381738:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 39 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.381755:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36000/0x2fa243e067ccc0ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89eee expref: 39 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.381774:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.381815:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867218816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.381820:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6194 00000100:00100000:0.0:1746142905.385718:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.385768:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.385798:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867218944 00000100:00100000:2.0:1746142905.385806:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867218944 00000100:00100000:2.0:1746142905.385880:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867219072 00000100:00100000:2.0:1746142905.385883:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867219072 00000100:00100000:2.0:1746142905.385930:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13870 00000100:00100000:2.0:1746142905.385937:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867218944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.385952:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.385965:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc117 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f3b expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.385976:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13871 00000100:00100000:1.0:1746142905.385983:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867219072:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.385988:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.385991:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.385997:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc117 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f3b expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.385999:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc11e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f42 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.386006:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc117 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f3b expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.386013:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc11e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f42 expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.386017:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3600, rc 0) 00010000:00010000:1.0:1746142905.386020:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc11e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f42 expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.386030:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:2.0:1746142905.386053:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867218944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 117us (344us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142905.386058:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13870 00000100:00100000:1.0:1746142905.386197:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867219072:12345-192.168.204.50@tcp:101:cat.0 Request processed in 214us (428us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142905.386202:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13871 00000100:00100000:0.0:1746142905.390132:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.390481:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.390482:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867219200 00000100:00100000:3.0:1746142905.390489:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867219200 00010000:00010000:3.0:1746142905.390516:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 25 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.390667:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6195 00000100:00100000:3.0:1746142905.390675:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867219200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142905.390677:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867219328 00000100:00100000:1.0:1746142905.390681:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867219328 00010000:00010000:3.0:1746142905.390685:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.390701:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 26 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.390862:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 26 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.390882:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccc0b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ed9 expref: 26 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.390925:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.390927:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.390932:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.390939:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.390966:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142905.390990:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867756800:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142905.391060:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a85840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142905.391122:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13872 00000100:00100000:1.0:1746142905.391129:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+25:32199:x1830962867219328:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142905.391140:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.391149:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f49 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.391165:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.391170:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142905.391172:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142905.391175:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.391196:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.391205:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 26 pid: 1397 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.391213:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867756928:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.391234:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142905.392936:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867756800:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142905.392952:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.392980:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867219200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2305us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.392989:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6195 00000100:00100000:1.0:1746142905.393087:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867756928:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.393103:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.393115:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74600, rc 0) 00000100:00100000:1.0:1746142905.393131:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+25:32199:x1830962867219328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2003us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.393136:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13872 00000100:00100000:0.0:1746142905.394952:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.395009:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867219584 00000100:00100000:3.0:1746142905.395017:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867219584 00002000:00100000:3.0:1746142905.395050:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3420159) req@ffff880093bced80 x1830962867219584/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.395066:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bced80 with x1830962867219584 ext(3416064->3420159) 00010000:00010000:3.0:1746142905.395073:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.395085:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.395091:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093bced80 00000100:00100000:3.0:1746142905.395106:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1303 00000100:00100000:3.0:1746142905.395113:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867219584:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142905.395230:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867219584:12345-192.168.204.50@tcp:3:cat.0 Request processed in 117us (283us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142905.395236:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1303 00002000:00100000:3.0:1746142905.395241:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3420159) req@ffff880093bced80 x1830962867219584/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.395248:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bced80 with x1830962867219584 ext(3416064->3420159) 00010000:00010000:3.0:1746142905.395253:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.395261:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.395267:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093bced80 00000100:00100000:2.0:1746142905.399521:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.399570:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.399592:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867219968 00000100:00100000:0.0:1746142905.399600:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867219968 00000100:00100000:0.0:1746142905.399632:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5211 00000100:00100000:0.0:1746142905.399676:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:32202:x1830962867219968:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142905.399765:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220096 00000100:00100000:3.0:1746142905.399769:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220096 00002000:00100000:3.0:1746142905.399791:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3420159) req@ffff880091c05180 x1830962867220096/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.399799:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05180 with x1830962867220096 ext(3145728->3420159) 00010000:00010000:3.0:1746142905.399806:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.399817:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 25 pid: 1397 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.399823:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c05180 00000100:00100000:3.0:1746142905.399849:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1304 00000100:00100000:3.0:1746142905.399854:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2003:x1830962867220096:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142905.403014:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:32202:x1830962867219968:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 3367us (3492us total) trans 8589936495 rc 0/0 00000100:00100000:0.0:1746142905.403024:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5211 00000100:00100000:3.0:1746142905.405648:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867220096:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5787us (6072us total) trans 21474841131 rc 0/0 00000100:00100000:3.0:1746142905.405657:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1304 00002000:00100000:3.0:1746142905.405666:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3420159) req@ffff880091c05180 x1830962867220096/t21474841131(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.405675:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05180 with x1830962867220096 ext(3145728->3420159) 00010000:00010000:3.0:1746142905.405683:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.405694:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.405700:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c05180 00000100:00100000:0.0:1746142905.411882:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.413175:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220224 00000100:00100000:3.0:1746142905.413186:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220224 00010000:00010000:3.0:1746142905.413217:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.413729:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6196 00000100:00100000:3.0:1746142905.413738:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867220224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.413750:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142905.413764:0:7219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142905 -> 1746142906 00002000:00010000:3.0:1746142905.413767:0:7219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142905 -> 1746142906 00010000:00010000:3.0:1746142905.413772:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.413783:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.413802:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc110 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f34 expref: 27 pid: 1397 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.414971:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.414974:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.414982:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.414992:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.415025:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142905.415037:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867757056:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142905.415121:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a40300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142905.417038:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867757056:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142905.417053:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.417075:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867220224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3339us (5201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.417082:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6196 00000100:00100000:0.0:1746142905.418639:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.418679:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220352 00000100:00100000:2.0:1746142905.418686:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220352 00000100:00100000:2.0:1746142905.418716:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13873 00000100:00100000:2.0:1746142905.418722:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867220352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142905.418735:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.418749:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3800/0x2fa243e067ccc12c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f50 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.418773:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3800/0x2fa243e067ccc12c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f50 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.418782:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3800/0x2fa243e067ccc12c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f50 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142905.418810:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3800, rc 0) 00000100:00100000:2.0:1746142905.418854:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867220352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 131us (219us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142905.418859:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13873 00000100:00100000:2.0:1746142905.422845:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.422896:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220608 00000100:00100000:3.0:1746142905.422930:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220608 00002000:00100000:3.0:1746142905.422966:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff880091c06d80 x1830962867220608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.422976:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06d80 with x1830962867220608 ext(5029888->5033983) 00002000:00010000:3.0:1746142905.422981:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c06d80 00000100:00100000:3.0:1746142905.423010:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4183 00000100:00100000:3.0:1746142905.423017:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867220608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142905.423137:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867220608:12345-192.168.204.50@tcp:3:cat.0 Request processed in 121us (299us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142905.423144:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4183 00002000:00100000:3.0:1746142905.423149:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff880091c06d80 x1830962867220608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/4536 e 0 to 0 dl 1746142916 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.423156:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06d80 with x1830962867220608 ext(5029888->5033983) 00002000:00010000:3.0:1746142905.423158:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c06d80 00000100:00100000:0.0:1746142905.435575:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.435811:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220736 00000100:00100000:2.0:1746142905.435819:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220736 00000100:00100000:2.0:1746142905.435871:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14349 00000100:00100000:2.0:1746142905.435878:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+6:32208:x1830962867220736:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142905.435895:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.435934:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f57 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.435981:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436039:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436049:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436060:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436065:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436070:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436122:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436129:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436134:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142905.436163:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:2.0:1746142905.436167:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142905.436179:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436186:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436193:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436198:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436203:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436208:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436212:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142905.436216:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436221:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436230:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142905.436233:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142905.436236:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436241:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc13a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436264:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436269:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436273:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436277:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142905.436280:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436284:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436289:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88013482f000) 00010000:00010000:2.0:1746142905.436291:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142905.436397:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436404:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc141 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.436427:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.436436:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.436612:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.436615:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142905.436618:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:2.0:1746142905.436657:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32208:x1830962867220736:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 779us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.436663:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14349 00000100:00100000:0.0:1746142905.439981:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.440007:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.440024:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.440037:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.440046:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.440061:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220864 00000100:00100000:0.0:1746142905.440066:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220864 00000100:00100000:0.0:1746142905.440096:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867221120 00000100:00100000:0.0:1746142905.440097:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867221120 00000100:00100000:0.0:1746142905.440104:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867221376 00000100:00100000:0.0:1746142905.440105:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867221376 00000100:00100000:0.0:1746142905.440109:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867220992 00000100:00100000:0.0:1746142905.440110:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867220992 00000100:00100000:0.0:1746142905.440115:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867221248 00000100:00100000:0.0:1746142905.440116:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867221248 00000100:00100000:0.0:1746142905.440123:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13874 00000100:00100000:0.0:1746142905.440128:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867220864:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142905.440140:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142905.440151:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f5e expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.440168:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440169:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440176:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440186:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440192:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471e200, rc 0) 00000100:00100000:0.0:1746142905.440222:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867220864:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.440226:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13874 00000100:00100000:0.0:1746142905.440234:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13875 00000100:00100000:0.0:1746142905.440237:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867221120:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142905.440241:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142905.440246:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f6c expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.440252:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440252:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440255:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440261:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440265:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ea00, rc 0) 00000100:00100000:0.0:1746142905.440272:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867221120:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.440274:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13875 00000100:00100000:0.0:1746142905.440278:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13876 00000100:00100000:0.0:1746142905.440281:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867221376:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142905.440283:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142905.440286:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f7a expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.440291:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440292:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440294:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440299:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440302:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f000, rc 0) 00000100:00100000:0.0:1746142905.440308:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867221376:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.440311:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13876 00000100:00100000:0.0:1746142905.440316:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13877 00000100:00100000:0.0:1746142905.440318:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867220992:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142905.440320:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142905.440323:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f65 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.440328:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440329:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440331:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440335:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440339:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ec00, rc 0) 00000100:00100000:0.0:1746142905.440344:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867220992:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.440347:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13877 00000100:00100000:0.0:1746142905.440351:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13878 00000100:00100000:0.0:1746142905.440353:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867221248:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00080000:2.0:1746142905.440354:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746142905.440356:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1746142905.440358:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746142905.440359:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f73 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.440363:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440364:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.440366:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440372:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.440375:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471e400, rc 0) 00000100:00100000:0.0:1746142905.440381:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867221248:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.440383:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13878 00000100:00100000:0.0:1746142905.440409:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.440415:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867221504 00000100:00100000:1.0:1746142905.440420:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867221504 00000100:00100000:1.0:1746142905.440456:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13879 00000100:00100000:1.0:1746142905.440472:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867221504:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142905.440480:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.440487:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067ccc172 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f81 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.440507:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067ccc172 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f81 expref: 16 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.440514:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067ccc172 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f81 expref: 16 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.440533:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75a00, rc 0) 00000100:00100000:1.0:1746142905.440564:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867221504:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 102us (153us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142905.440569:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13879 00000100:00100000:0.0:1746142905.443076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.443126:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867221760 00000100:00100000:2.0:1746142905.443133:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867221760 00000100:00100000:2.0:1746142905.443281:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14350 00000100:00100000:2.0:1746142905.443289:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32208:x1830962867221760:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142905.443303:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.443318:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f88 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.443393:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.443404:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 17 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.443410:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.443420:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.443442:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.443451:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 8 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.443475:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867757184:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.443952:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 17 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.443960:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 17 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.443967:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867757312:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.444014:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142905.446130:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867757184:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.446140:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867757312:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.446156:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142905.446548:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.446625:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.446648:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222016 00000100:00100000:3.0:1746142905.446655:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222016 00010000:00010000:3.0:1746142905.446686:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 18 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.446717:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867221888 00000100:00100000:3.0:1746142905.446720:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867221888 00010000:00010000:3.0:1746142905.446730:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 9 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.446746:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6197 00000100:00100000:3.0:1746142905.446752:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867222016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.446762:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.446766:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 18 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.446773:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 18 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.446789:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc061 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ea1 expref: 18 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.446810:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.446814:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.446821:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.446825:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.446885:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6198 00000100:00100000:2.0:1746142905.446891:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867221888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.446928:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.446932:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 9 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.446939:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 9 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.446949:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc148 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f57 expref: 9 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.446961:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.446964:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.446970:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.446974:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.446985:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.447045:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867221888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.447050:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6198 00010000:00010000:2.0:1746142905.447066:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.447070:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142905.447083:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000100:00100000:3.0:1746142905.447141:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867222016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 389us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.447146:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6197 00010000:00010000:2.0:1746142905.447665:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f88 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.447678:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f88 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.447683:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.447686:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142905.447688:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2000, rc 0) 00000100:00100000:2.0:1746142905.447717:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867221760:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 4428us (4645us total) trans 8589936496 rc 0/0 00000100:00100000:2.0:1746142905.447723:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14350 00000100:00100000:0.0:1746142905.449176:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.449244:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222272 00000100:00100000:2.0:1746142905.449251:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222272 00000100:00100000:2.0:1746142905.449294:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14351 00000100:00100000:2.0:1746142905.449301:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867222272:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142905.449330:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.449333:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142905.449348:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccc180 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f88 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.449359:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.449362:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142905.449371:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc18e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f8f expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.449440:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc195 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.449452:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc195 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.449458:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc195 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142905.449479:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142905.449541:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc18e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f8f expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.449550:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc195 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f8f expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.449556:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.449558:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142905.449560:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3c00, rc 0) 00000100:00100000:2.0:1746142905.449599:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32208:x1830962867222272:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 298us (426us total) trans 8589936497 rc 0/0 00000100:00100000:2.0:1746142905.449604:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14351 00000100:00100000:0.0:1746142905.451122:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.451176:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222400 00000100:00100000:2.0:1746142905.451183:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222400 00000100:00100000:2.0:1746142905.451217:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14352 00000100:00100000:2.0:1746142905.451223:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32208:x1830962867222400:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142905.451235:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.451245:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc1a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f96 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.451276:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f96 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.451287:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f96 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.451300:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.451303:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142905.451305:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3800, rc 0) 00000100:00100000:2.0:1746142905.451329:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32208:x1830962867222400:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 107us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.451334:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14352 00000100:00100000:3.0:1746142905.453401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.453454:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222528 00000100:00100000:1.0:1746142905.453471:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222528 00000100:00100000:1.0:1746142905.453503:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13880 00000100:00100000:1.0:1746142905.453509:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867222528:12345-192.168.204.50@tcp:1:mirror_io.0 00000100:00100000:0.0:1746142905.453534:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142905.453540:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453547:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142905.453554:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453561:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142905.453562:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.453567:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453572:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142905.453577:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.453578:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.453580:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453583:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222656 00000100:00100000:0.0:1746142905.453586:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222656 00010000:00010000:1.0:1746142905.453603:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453603:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222912 00000100:00100000:0.0:1746142905.453604:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222912 00010000:00010000:1.0:1746142905.453613:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.453613:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223168 00000100:00100000:0.0:1746142905.453615:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223168 00000100:00100000:0.0:1746142905.453622:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867222784 00000100:00100000:0.0:1746142905.453623:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867222784 00000100:00100000:1.0:1746142905.453624:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867757440:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.453633:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13881 00000100:00100000:0.0:1746142905.453637:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867222656:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:0.0:1746142905.453654:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453664:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453670:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.453676:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 14 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.453681:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.453681:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.453682:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.453684:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.453689:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 14 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746142905.453695:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867757568:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142905.453697:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 14 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453704:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 14 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.453712:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867757696:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.453718:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.453726:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.453737:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867757824:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142905.453739:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.453749:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 17 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746142905.453755:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.453755:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867757952:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.453773:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13882 00000100:00100000:1.0:1746142905.453778:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867222912:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:0.0:1746142905.453779:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453786:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 33 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.453792:0:11943:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453793:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867758080:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.453802:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 25 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453805:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06900 going to sleep for 11 seconds 00010000:00010000:1.0:1746142905.453809:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.453815:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 37 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.453820:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746142905.453820:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13883 00010000:00010000:1.0:1746142905.453821:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.453823:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453825:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867223168:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:1.0:1746142905.453837:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 37 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.453840:0:9578:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.453844:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 37 pid: 11421 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.453849:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.453851:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867758208:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142905.453854:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453859:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 14 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453864:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746142905.453865:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:0.0:1746142905.453867:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.453873:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.453880:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 14 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.453880:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 14 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.453887:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867758336:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142905.453887:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 14 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.453893:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867758464:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.453929:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 25 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.453933:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.453937:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 25 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.453940:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 33 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.453943:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867758592:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.453948:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867758720:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.453958:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00010000:00010000:0.0:1746142905.453966:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.453971:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13884 00010000:00010000:0.0:1746142905.453973:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.453976:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867222784:12345-192.168.204.50@tcp:1:mirror_io.0 00000100:00100000:0.0:1746142905.453985:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867758848:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.453991:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.453996:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746142905.454001:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.454011:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.454017:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.454022:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.454024:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746142905.454024:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142905.454026:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.454038:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.454044:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.454051:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867758976:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142905.454637:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223040 00000100:00100000:3.0:1746142905.454641:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223040 00000100:00100000:3.0:1746142905.454658:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13885 00000100:00100000:3.0:1746142905.454663:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867223040:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:3.0:1746142905.454678:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.454687:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.454693:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.454697:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.454698:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.454700:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.454713:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142905.454719:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 15 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:3.0:1746142905.454730:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867759104:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.455740:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.455787:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 17 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:1.0:1746142905.455797:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867759232:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.455858:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.455865:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.455872:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867759360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.455892:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433000 going to sleep for 11 seconds 00010000:00010000:3.0:1746142905.456299:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.456313:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 25 pid: 1854 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.456321:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867759488:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142905.456340:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4a40300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142905.457869:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867757696:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.457956:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867757440:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.457964:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867757568:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.459350:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867757952:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.459359:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867758080:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.459381:0:12211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.459387:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867758208:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.459395:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867758336:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.459406:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867757824:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.459419:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.461147:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.461176:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.461194:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224064 00000100:00100000:0.0:1746142905.461199:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224064 00010000:00010000:0.0:1746142905.461224:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 34 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.461242:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223552 00000100:00100000:0.0:1746142905.461244:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223552 00010000:00010000:0.0:1746142905.461251:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 18 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746142905.461264:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6199 00000100:00100000:0.0:1746142905.461269:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867224064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.461280:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.461296:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 34 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.461305:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 34 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.461323:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131322000/0x2fa243e067ccbf34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ddd expref: 34 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.461338:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142905.461366:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867224064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.461372:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6199 00000100:00100000:0.0:1746142905.461383:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6200 00000100:00100000:0.0:1746142905.461387:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867223552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.461393:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.461400:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 18 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.461407:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 18 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.461417:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471ec00/0x2fa243e067ccc164 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f65 expref: 18 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.461424:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142905.461436:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867223552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.461440:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6200 00000100:00100000:0.0:1746142905.461481:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.461494:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224192 00000100:00100000:0.0:1746142905.461497:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224192 00010000:00010000:0.0:1746142905.461507:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:0.0:1746142905.461523:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6201 00000100:00100000:0.0:1746142905.461526:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867224192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.461531:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.461541:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.461547:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:0.0:1746142905.461556:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142905.461568:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867224192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 42us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.461572:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6201 00010000:00010000:3.0:1746142905.461981:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471f000/0x2fa243e067ccc15d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f7a expref: 15 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:3.0:1746142905.462005:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867759104:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.462082:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867759360:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142905.463706:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867759488:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142905.463736:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.463800:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867758464:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142905.464034:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867758592:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.464052:0:11943:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.464119:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.464180:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224448 00000100:00100000:1.0:1746142905.464185:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224448 00000100:00100000:0.0:1746142905.464189:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867758720:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.464197:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867758848:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142905.464206:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.464219:0:9578:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.464236:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6202 00000100:00100000:1.0:1746142905.464243:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867224448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142905.464253:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142905.464267:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.464275:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.464289:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74600/0x2fa243e067ccc125 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f49 expref: 26 pid: 1854 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.464302:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.464303:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.464306:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.464313:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.464333:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142905.464354:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.464358:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867224448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 116us (240us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142905.464362:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.464363:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6202 00010000:00010000:3.0:1746142905.464380:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.464387:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.464394:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.464399:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142905.464402:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.464406:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867758976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142905.464409:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.464413:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867759232:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142905.464418:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.464424:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37a00/0x2fa243e067ccc1cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.464425:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142905.464657:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867223040:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 9992us (10632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.464664:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13885 00000100:00100000:2.0:1746142905.467185:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.467214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.467235:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.467252:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223424 00000100:00100000:2.0:1746142905.467258:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223424 00010000:00010000:2.0:1746142905.467284:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.467304:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223808 00000100:00100000:2.0:1746142905.467307:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223808 00010000:00010000:2.0:1746142905.467315:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 38 pid: 11421 timeout: 779 lvb_type: 1 00000100:00100000:2.0:1746142905.467335:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224320 00000100:00100000:2.0:1746142905.467337:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224320 00010000:00010000:2.0:1746142905.467345:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.467358:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6203 00000100:00100000:2.0:1746142905.467363:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867223424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.467373:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.467386:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467395:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467411:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131323600/0x2fa243e067ccbf0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dc1 expref: 25 pid: 1853 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467426:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.467453:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867223424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.467458:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6203 00000100:00100000:2.0:1746142905.467480:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6204 00000100:00100000:2.0:1746142905.467485:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867223808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.467493:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.467500:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 38 pid: 11421 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.467507:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 38 pid: 11421 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.467516:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067ccc0e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f0a expref: 38 pid: 11421 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.467523:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.467535:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867223808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.467539:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6204 00000100:00100000:2.0:1746142905.467547:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6205 00000100:00100000:2.0:1746142905.467552:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867224320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.467558:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.467567:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467575:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467585:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccbf65 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e0e expref: 33 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467597:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.467608:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867224320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.467613:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6205 00000100:00100000:2.0:1746142905.467640:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.467650:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224704 00000100:00100000:2.0:1746142905.467652:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224704 00010000:00010000:2.0:1746142905.467661:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 24 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.467673:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6206 00000100:00100000:2.0:1746142905.467676:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867224704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.467682:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.467688:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 24 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467695:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 24 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467704:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c600/0x2fa243e067ccc07d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ebd expref: 24 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467711:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.467721:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867224704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 45us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.467729:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6206 00000100:00100000:2.0:1746142905.467763:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.467771:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224960 00000100:00100000:2.0:1746142905.467773:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224960 00010000:00010000:2.0:1746142905.467781:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 32 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.467792:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6207 00000100:00100000:2.0:1746142905.467796:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867224960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.467801:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.467807:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 32 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467814:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 32 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467823:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccc0df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89efc expref: 32 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.467831:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.467841:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867224960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 45us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.467846:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6207 00000100:00100000:2.0:1746142905.467870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.467877:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223296 00000100:00100000:2.0:1746142905.467879:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223296 00010000:00010000:2.0:1746142905.467887:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 14 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:2.0:1746142905.467915:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6208 00000100:00100000:2.0:1746142905.467921:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867223296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.467926:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.467932:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 14 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.467940:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 14 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.467950:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471e200/0x2fa243e067ccc14f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f5e expref: 14 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.467957:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.467968:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867223296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 48us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.467972:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6208 00000100:00100000:2.0:1746142905.468003:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.468011:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223680 00000100:00100000:2.0:1746142905.468013:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223680 00010000:00010000:2.0:1746142905.468021:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.468032:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6209 00000100:00100000:2.0:1746142905.468036:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867223680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.468044:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.468049:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.468056:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.468065:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131322800/0x2fa243e067ccbed9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89db3 expref: 37 pid: 1853 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.468073:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.468075:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.468078:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468085:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468101:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.468112:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867223680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.468117:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6209 00000100:00100000:2.0:1746142905.468157:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.468165:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867223936 00000100:00100000:2.0:1746142905.468167:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867223936 00010000:00010000:2.0:1746142905.468174:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 13 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:2.0:1746142905.468188:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6210 00000100:00100000:2.0:1746142905.468192:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867223936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.468197:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.468203:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 13 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.468209:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 13 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.468218:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471e400/0x2fa243e067ccc16b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f73 expref: 13 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.468225:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.468226:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.468229:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468234:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468246:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.468258:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867223936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.468263:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6210 00000100:00100000:2.0:1746142905.468292:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.468300:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224576 00000100:00100000:2.0:1746142905.468302:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224576 00010000:00010000:2.0:1746142905.468312:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.468323:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6211 00000100:00100000:2.0:1746142905.468328:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867224576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.468333:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.468340:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.468347:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.468357:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccbf5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e07 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:2.0:1746142905.468363:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.468365:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142905.468367:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468373:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468382:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.468393:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867224576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.468398:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6211 00010000:00010000:2.0:1746142905.468411:0:12211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468418:0:12211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468430:0:12211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468437:0:12211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468443:0:12211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468448:0:12211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142905.468452:0:12211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468458:0:12211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468478:0:12211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.468483:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471f200/0x2fa243e067ccc1b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142905.468518:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867222656:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 14880us (14984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.468524:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13881 00000100:00100000:2.0:1746142905.468560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.468589:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.468597:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867225088 00000100:00100000:2.0:1746142905.468599:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867225088 00010000:00010000:2.0:1746142905.468609:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00000100:00100000:2.0:1746142905.468620:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6212 00000100:00100000:2.0:1746142905.468624:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867225088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142905.468629:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.468635:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.468642:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.468651:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc156 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f6c expref: 16 pid: 9578 timeout: 779 lvb_type: 1 00010000:00010000:2.0:1746142905.468659:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142905.468669:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867225088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 45us (80us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.468677:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6212 00000100:00100000:3.0:1746142905.469255:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867224832 00000100:00100000:3.0:1746142905.469259:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867224832 00002000:00100000:3.0:1746142905.469282:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2707456->3145727) req@ffff880092134000 x1830962867224832/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/0 e 0 to 0 dl 1746142916 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.469290:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134000 with x1830962867224832 ext(2707456->3145727) 00010000:00010000:3.0:1746142905.469295:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.469303:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.469308:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134000 00000100:00100000:3.0:1746142905.469319:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1305 00000100:00100000:3.0:1746142905.469324:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867224832:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:1.0:1746142905.469542:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469550:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469561:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469567:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469573:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469578:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142905.469581:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469586:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469595:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469601:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc1aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.469655:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867222528:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 16145us (16260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.469660:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13880 00010000:00010000:1.0:1746142905.469678:0:11943:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469685:0:11943:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469695:0:11943:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469700:0:11943:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469706:0:11943:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469711:0:11943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142905.469713:0:11943:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469719:0:11943:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469727:0:11943:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.469732:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067ccc1b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.469753:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867222912:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 15975us (16204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.469758:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13882 00000100:00100000:0.0:1746142905.469888:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.469960:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.469971:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867225216 00000100:00100000:0.0:1746142905.469974:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867225216 00010000:00010000:0.0:1746142905.469986:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 16 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.469998:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867225344 00000100:00100000:0.0:1746142905.470000:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867225344 00010000:00010000:0.0:1746142905.470006:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 17 pid: 9580 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.470016:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6213 00000100:00100000:0.0:1746142905.470021:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867225216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.470026:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.470034:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 17 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.470040:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 17 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.470051:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d400/0x2fa243e067ccbf6c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e15 expref: 17 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.470060:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.470061:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.470064:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.470070:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.470088:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142905.470101:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867225216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.470106:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6213 00000100:00100000:0.0:1746142905.470114:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6214 00000100:00100000:0.0:1746142905.470124:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867225344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.470129:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.470135:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.470143:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.470151:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0a00/0x2fa243e067ccc0f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f18 expref: 15 pid: 9580 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.470159:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142905.470170:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867225344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.470175:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6214 00010000:00010000:1.0:1746142905.470355:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470362:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470373:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470379:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470385:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470390:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ed1000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142905.470392:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470399:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470407:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142905.470412:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccc1c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142905.470442:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867222784:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 16466us (16869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.470448:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13884 00000100:00100000:3.0:1746142905.477994:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867224832:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8659us (9424us total) trans 17179873864 rc 0/0 00000100:00100000:3.0:1746142905.478005:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1305 00002000:00100000:3.0:1746142905.478017:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2707456->3145727) req@ffff880092134000 x1830962867224832/t17179873864(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:56/0 lens 488/448 e 0 to 0 dl 1746142916 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142905.478025:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134000 with x1830962867224832 ext(2707456->3145727) 00010000:00010000:3.0:1746142905.478034:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.478046:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00002000:00010000:3.0:1746142905.478053:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134000 00000100:00100000:0.0:1746142905.478988:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.479090:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867225472 00000100:00100000:3.0:1746142905.479096:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867225472 00010000:00010000:3.0:1746142905.479116:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00000100:00100000:3.0:1746142905.479144:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6215 00000100:00100000:3.0:1746142905.479150:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867225472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.479161:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142905.479173:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142905 -> 1746142906 00010000:00010000:3.0:1746142905.479179:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.479188:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.479206:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3000/0x2fa243e067ccc0d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2707456->3145727] (req 2707456->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f03 expref: 14 pid: 11421 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.479216:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.479218:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142905.479222:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.479230:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142905.479255:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.479285:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867225472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 135us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.479291:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6215 00010000:00010000:0.0:1746142905.479337:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479345:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479359:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479366:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479373:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479378:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9d0600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142905.479381:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479388:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479397:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142905.479403:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0600/0x2fa243e067ccc1bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142905.479434:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867223168:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 25609us (25872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.479441:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13883 00000100:00100000:0.0:1746142905.480529:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.480764:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867225728 00000100:00100000:2.0:1746142905.480769:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867225728 00000100:00100000:2.0:1746142905.480804:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14353 00000100:00100000:2.0:1746142905.480810:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32208:x1830962867225728:12345-192.168.204.50@tcp:36:mirror_io.0 00010000:00010000:2.0:1746142905.480842:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142905.480853:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067ccc1a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f96 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480870:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.480873:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142905.480888:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.480895:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480920:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480926:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 16 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480931:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 34 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480937:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 16 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480947:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.480967:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 16 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.480975:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.480985:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867759616:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.481254:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 34 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.481261:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 34 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.481269:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867759744:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.481296:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 16 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.481303:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 16 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.481309:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867759872:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.481330:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.481341:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 34 pid: 7231 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.481348:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867760000:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142905.481370:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.481377:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.481383:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867760128:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.481397:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142905.482585:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.482615:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867759616:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.482625:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867759744:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.482628:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.482632:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867759872:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.482637:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867760000:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142905.482663:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867760128:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142905.482668:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.482677:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867225984 00000100:00100000:3.0:1746142905.482682:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867225984 00010000:00010000:2.0:1746142905.482683:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142905.482707:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867226240 00000100:00100000:3.0:1746142905.482709:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867226240 00000100:00100000:0.0:1746142905.482713:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.482717:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5212 00000100:00100000:2.0:1746142905.482723:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:8514:x1830962867225984:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142905.482776:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867226368 00000100:00100000:1.0:1746142905.482779:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867226368 00000100:00100000:3.0:1746142905.482788:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5213 00000100:00100000:3.0:1746142905.482794:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:16986:x1830962867226240:12345-192.168.204.50@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746142905.482795:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 18 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.482809:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867226496 00000100:00100000:1.0:1746142905.482810:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867226496 00010000:00010000:1.0:1746142905.482815:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 36 pid: 7231 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.482826:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6216 00000100:00100000:1.0:1746142905.482830:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867226368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142905.482837:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142905.482841:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 19 pid: 22383 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.482849:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 19 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.482859:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:8514:x1830962867225984:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 136us (276us total) trans 8589936498 rc 0/0 00000100:00100000:3.0:1746142905.482861:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:16986:x1830962867226240:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 67us (231us total) trans 8589936499 rc 0/0 00010000:00010000:1.0:1746142905.482861:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712b800/0x2fa243e067ccbf42 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89deb expref: 19 pid: 22383 timeout: 779 lvb_type: 0 00000100:00100000:2.0:1746142905.482866:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5212 00000100:00100000:3.0:1746142905.482869:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5213 00010000:00010000:1.0:1746142905.482872:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142905.482876:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142905.482881:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.482885:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6217 00000100:00100000:3.0:1746142905.482890:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867226496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142905.482896:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867226368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (228us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142905.482897:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.482918:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 36 pid: 7231 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.482919:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6216 00010000:00010000:3.0:1746142905.482927:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 36 pid: 7231 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.482938:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009712ac00/0x2fa243e067ccbf3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89de4 expref: 36 pid: 7231 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.482946:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.482949:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.482954:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.482972:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867226496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.482977:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6217 00000100:00100000:0.0:1746142905.484658:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142905.484761:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867226624 00000100:00100000:3.0:1746142905.484767:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867226624 00000100:00100000:0.0:1746142905.485215:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.485278:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142905.485412:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867226752 00000100:00100000:1.0:1746142905.485416:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867226752 00010000:00010000:1.0:1746142905.485430:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 18 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.485448:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867226880 00000100:00100000:1.0:1746142905.485450:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867226880 00010000:00010000:1.0:1746142905.485457:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 35 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:1.0:1746142905.485522:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6218 00000100:00100000:1.0:1746142905.485528:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867226752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142905.485537:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142905.485543:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 18 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.485551:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 18 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.485567:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3da00/0x2fa243e067ccc045 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e9a expref: 18 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:1.0:1746142905.485577:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142905.485581:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142905.485587:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142905.485639:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6219 00000100:00100000:0.0:1746142905.485645:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867226880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142905.485651:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142905.485654:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 35 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.485661:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 35 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.485671:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc014 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89e7e expref: 35 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:0.0:1746142905.485679:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142905.485681:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142905.485686:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142905.486023:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867226752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 491us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.486032:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6218 00010000:00010000:3.0:1746142905.486073:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00000100:00100000:0.0:1746142905.486110:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867226880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 465us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.486115:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6219 00000100:00100000:3.0:1746142905.486156:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6220 00000100:00100000:3.0:1746142905.486162:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867226624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142905.486169:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142905.486172:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.486180:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.486190:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccbf2d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89dcf expref: 16 pid: 10924 timeout: 779 lvb_type: 0 00010000:00010000:3.0:1746142905.486198:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142905.486201:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.486207:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.486213:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142905.486242:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142905.486269:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867226624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142905.486274:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6220 00010000:00010000:2.0:1746142905.486425:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.486432:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000040:00080000:2.0:1746142905.486631:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].593, 88 off59896 00000004:00080000:2.0:1746142905.486638:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485737613ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486672:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].660, 88 off65888 00000004:00080000:2.0:1746142905.486676:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485775883ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486688:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].661, 88 off65976 00000004:00080000:2.0:1746142905.486691:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485791108ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486699:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].594, 88 off59984 00000004:00080000:2.0:1746142905.486701:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485801455ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486708:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].595, 88 off60072 00000004:00080000:2.0:1746142905.486710:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485810280ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486717:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].662, 88 off66064 00000004:00080000:2.0:1746142905.486719:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485819118ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486725:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].663, 88 off66152 00000004:00080000:2.0:1746142905.486728:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485828040ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486734:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].596, 88 off60160 00000004:00080000:2.0:1746142905.486737:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485836880ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486743:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].664, 88 off66240 00000004:00080000:2.0:1746142905.486745:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485845458ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486752:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].597, 88 off60248 00000004:00080000:2.0:1746142905.486755:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485854795ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486762:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].665, 88 off66328 00000004:00080000:2.0:1746142905.486765:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485864850ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486772:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].598, 88 off60336 00000004:00080000:2.0:1746142905.486774:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485874035ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486781:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].666, 88 off66416 00000004:00080000:2.0:1746142905.486783:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485883230ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486790:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].599, 88 off60424 00000004:00080000:2.0:1746142905.486793:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485892727ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142905.486800:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].667, 88 off66504 00000004:00080000:2.0:1746142905.486802:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485902703ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486810:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].668, 88 off66592 00000004:00080000:2.0:1746142905.486812:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 679485912495ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142905.486820:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].600, 88 off60512 00000004:00080000:2.0:1746142905.486823:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 679485922883ns, next at 629431245375ns, rc = 0 00000001:00080000:0.0:1746142905.489429:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936500 is committed 00000004:00080000:0.0:1746142905.489436:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 589 committed 00000004:00080000:0.0:1746142905.489451:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 657 committed 00000004:00080000:0.0:1746142905.489777:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 656 committed 00000004:00080000:0.0:1746142905.489780:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 588 committed 00000004:00080000:0.0:1746142905.489781:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 655 committed 00000004:00080000:0.0:1746142905.489782:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 587 committed 00000004:00080000:0.0:1746142905.489783:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 654 committed 00000004:00080000:0.0:1746142905.489785:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 586 committed 00000004:00080000:0.0:1746142905.489786:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 653 committed 00000004:00080000:0.0:1746142905.489787:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 585 committed 00000004:00080000:0.0:1746142905.489789:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 652 committed 00000004:00080000:0.0:1746142905.489791:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 651 committed 00000004:00080000:0.0:1746142905.489792:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 584 committed 00000004:00080000:0.0:1746142905.489794:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 583 committed 00000004:00080000:0.0:1746142905.489795:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 650 committed 00000004:00080000:0.0:1746142905.489796:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 649 committed 00000004:00080000:0.0:1746142905.489797:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 582 committed 00000001:00080000:0.0:1746142905.489801:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936499 is committed 00000001:00080000:0.0:1746142905.489807:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936498 is committed 00000100:00100000:0.0:1746142905.489844:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867760640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142905.489890:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746142905.489921:0:10924:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800938d3800 reply state ffff880091ee7800 transno 8589936500 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142905.489928:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746142905.489933:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867760256:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746142905.489936:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.489944:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.489946:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746142905.489946:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142905.489949:0:10924:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746142905.489955:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867760768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142905.489966:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142905.489984:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867760640 00000100:00100000:0.0:1746142905.489989:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867760640 00010000:00080000:2.0:1746142905.490011:0:10924:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746142905.490014:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867760256 00000100:00100000:0.0:1746142905.490015:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867760256 00000100:00100000:2.0:1746142905.490023:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867225728:12345-192.168.204.50@tcp:36:mirror_io.0 Request processed in 9211us (9495us total) trans 8589936500 rc 0/0 00000100:00100000:0.0:1746142905.490025:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867760768 00000100:00100000:0.0:1746142905.490027:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867760768 00000100:00100000:2.0:1746142905.490030:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14353 00000100:00100000:0.0:1746142905.490037:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13886 00000100:00100000:0.0:1746142905.490042:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3764:x1830962867760640:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746142905.490048:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.490058:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.490063:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.490068:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c2a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142905.490075:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.490081:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.490088:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.490090:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142905.490092:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.490097:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccc1d4 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142905.490115:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13887 00000100:00100000:2.0:1746142905.490120:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867760256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142905.490154:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867760640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (263us total) trans 21474841132 rc 0/0 00000100:00100000:0.0:1746142905.490159:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13886 00000100:00100000:0.0:1746142905.490169:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13888 00000100:00100000:0.0:1746142905.490173:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867760768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142905.490185:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867760256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (238us total) trans 21474841133 rc 0/0 00000100:00100000:2.0:1746142905.490191:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13887 00000100:00100000:0.0:1746142905.490219:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867760768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (252us total) trans 21474841134 rc 0/0 00000100:00100000:0.0:1746142905.490223:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13888 00000100:00100000:3.0:1746142905.490232:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867761280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142905.490236:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867761152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142905.490252:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142905.490260:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761152 00000100:00100000:3.0:1746142905.490265:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761152 00000100:00100000:3.0:1746142905.490273:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142905.490273:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867761664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142905.490286:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142905.490287:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761280 00000100:00100000:3.0:1746142905.490288:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867761792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142905.490289:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761280 00000100:00100000:2.0:1746142905.490301:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761664 00000100:00100000:2.0:1746142905.490303:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761664 00000100:00100000:3.0:1746142905.490304:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142905.490307:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430e00/2, rc 0, transno 21474841133 00000100:00100000:2.0:1746142905.490311:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761792 00000100:00100000:2.0:1746142905.490313:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761792 00000100:00100000:2.0:1746142905.490320:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13889 00000100:00100000:3.0:1746142905.490323:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13890 00000100:00100000:2.0:1746142905.490324:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3765:x1830962867761280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142905.490328:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3764:x1830962867761664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142905.490385:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746142905.490388:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142905.490390:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142905.490392:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142905.490394:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:2.0:1746142905.490394:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3765:x1830962867761280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (121us total) trans 17179873865 rc 0/0 00000100:00100000:2.0:1746142905.490399:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13889 00000100:00100000:3.0:1746142905.490407:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3764:x1830962867761664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (121us total) trans 17179873866 rc 0/0 00000100:00100000:3.0:1746142905.490412:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13890 00000100:00100000:3.0:1746142905.490421:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13891 00000100:00100000:3.0:1746142905.490425:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3765:x1830962867761792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142905.490472:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:3.0:1746142905.490474:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142905.490476:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142905.490478:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142905.490479:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142905.490495:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3765:x1830962867761792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (191us total) trans 17179873867 rc 0/0 00000100:00100000:3.0:1746142905.490500:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13891 00000100:00100000:3.0:1746142905.490508:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13892 00000100:00100000:3.0:1746142905.490512:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3764:x1830962867761152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142905.490552:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3764:x1830962867761152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (299us total) trans 17179873868 rc 0/0 00000100:00100000:3.0:1746142905.490557:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13892 00000004:00080000:3.0:1746142905.490576:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097348000/2, rc 0, transno 17179873865 00000100:00100000:3.0:1746142905.490583:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867761280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142905.490589:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734b480/2, rc 0, transno 17179873867 00000100:00100000:3.0:1746142905.490591:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867761792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142905.490613:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746142905.490617:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867762176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142905.490633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142905.490648:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867762176 00000100:00100000:3.0:1746142905.490650:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867762176 00000100:00100000:3.0:1746142905.490660:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13893 00000100:00100000:3.0:1746142905.490663:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3765:x1830962867762176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142905.490717:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3765:x1830962867762176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (82us total) trans 17179873869 rc 0/0 00000100:00100000:3.0:1746142905.490721:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13893 00000004:00080000:3.0:1746142905.490738:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096142d80/2, rc 0, transno 17179873869 00000100:00100000:3.0:1746142905.490742:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867762176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142905.491316:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867760256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142905.491328:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097431f80/2, rc 0, transno 21474841134 00000100:00100000:0.0:1746142905.491331:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867760768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142905.491337:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867760384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142905.491338:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430a80/2, rc 0, transno 21474841132 00000100:00100000:0.0:1746142905.491340:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867760640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142905.491348:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097349c00/2, rc 0, transno 17179873868 00000100:00100000:0.0:1746142905.491351:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867761152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142905.491358:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097348e00/2, rc 0, transno 17179873866 00000100:00100000:0.0:1746142905.491360:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867761664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142905.491361:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142905.491363:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746142905.491367:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867762304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142905.491484:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867760384 00000100:00100000:0.0:1746142905.491487:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867760384 00000100:00100000:1.0:1746142905.491495:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867760896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142905.491511:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142905.491511:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13894 00000100:00100000:0.0:1746142905.491515:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3762:x1830962867760384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142905.491597:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142905.491612:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142905.491672:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142905.491688:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142905.491689:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867760384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (327us total) trans 21474841135 rc 0/0 00000100:00100000:0.0:1746142905.491694:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13894 00000100:00100000:2.0:1746142905.491705:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867760896 00000100:00100000:2.0:1746142905.491708:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867760896 00000100:00100000:2.0:1746142905.491721:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761408 00000100:00100000:2.0:1746142905.491723:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761408 00000100:00100000:2.0:1746142905.491730:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13895 00000100:00100000:2.0:1746142905.491734:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867760896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142905.491784:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:3762:x1830962867760896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (272us total) trans 21474841136 rc 0/0 00000100:00100000:2.0:1746142905.491789:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13895 00000100:00100000:3.0:1746142905.491792:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13896 00000100:00100000:3.0:1746142905.491806:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3762:x1830962867761408:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142905.491833:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097433800/2, rc 0, transno 21474841135 00000100:00100000:1.0:1746142905.491837:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867760384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142905.491845:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430380/2, rc 0, transno 21474841136 00000100:00100000:1.0:1746142905.491848:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867760896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142905.491854:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097349880/2, rc 0, transno 17179873870 00000100:00100000:3.0:1746142905.491855:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3762:x1830962867761408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (242us total) trans 17179873870 rc 0/0 00000100:00100000:1.0:1746142905.491857:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142905.491860:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746142905.491865:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867760512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142905.491880:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142905.491888:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142905.491914:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142905.491923:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142905.491939:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142905.491945:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867762048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142905.491956:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142905.491972:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761920 00000100:00100000:1.0:1746142905.491975:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761920 00000100:00100000:2.0:1746142905.492018:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867760512 00000100:00100000:2.0:1746142905.492021:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867760512 00000100:00100000:2.0:1746142905.492029:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761024 00000100:00100000:2.0:1746142905.492030:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761024 00000100:00100000:2.0:1746142905.492035:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867761536 00000100:00100000:2.0:1746142905.492037:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867761536 00000100:00100000:2.0:1746142905.492041:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867762048 00000100:00100000:2.0:1746142905.492043:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867762048 00000100:00100000:2.0:1746142905.492049:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13897 00000100:00100000:2.0:1746142905.492053:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:3762:x1830962867760512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142905.492141:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13896 00000100:00100000:2.0:1746142905.492145:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3762:x1830962867760512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (263us total) trans 21474841137 rc 0/0 00000100:00100000:2.0:1746142905.492151:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13897 00000100:00100000:3.0:1746142905.492154:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13898 00000100:00100000:3.0:1746142905.492158:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+43:3762:x1830962867761024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142905.492161:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13899 00000100:00100000:2.0:1746142905.492166:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3762:x1830962867761536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142905.492197:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142905.492199:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142905.492200:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142905.492201:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142905.492201:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142905.492202:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142905.492203:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142905.492204:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00002000:00010000:2.0:1746142905.492204:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142905.492206:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142905.492224:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3762:x1830962867761024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (309us total) trans 21474841138 rc 0/0 00000100:00100000:2.0:1746142905.492225:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3762:x1830962867761536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (285us total) trans 17179873871 rc 0/0 00000100:00100000:2.0:1746142905.492229:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13899 00000100:00100000:3.0:1746142905.492647:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13898 00000100:00100000:1.0:1746142905.492653:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13900 00000100:00100000:1.0:1746142905.492658:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3762:x1830962867762048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142905.492660:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13901 00000100:00100000:3.0:1746142905.492664:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3762:x1830962867761920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142905.492694:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:1.0:1746142905.492695:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142905.492697:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142905.492699:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142905.492700:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142905.492719:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3762:x1830962867762048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (763us total) trans 17179873872 rc 0/0 00000100:00100000:3.0:1746142905.492720:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3762:x1830962867761920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (1030us total) trans 17179873873 rc 0/0 00000100:00100000:1.0:1746142905.492724:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13900 00000100:00100000:3.0:1746142905.492727:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13901 00000004:00080000:1.0:1746142905.492741:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430700/2, rc 0, transno 21474841137 00000100:00100000:1.0:1746142905.492744:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867760512:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142905.492749:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097431880/2, rc 0, transno 21474841138 00000100:00100000:1.0:1746142905.492751:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142905.492755:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097349180/2, rc 0, transno 17179873871 00000100:00100000:1.0:1746142905.492758:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142905.492762:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092406a00/2, rc 0, transno 17179873872 00000100:00100000:1.0:1746142905.492764:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092406a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867762048:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142905.492768:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734b800/2, rc 0, transno 17179873873 00000100:00100000:1.0:1746142905.492770:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867761920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142905.492824:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142905.492836:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867762304 00000100:00100000:2.0:1746142905.492839:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867762304 00000100:00100000:2.0:1746142905.492859:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13902 00000100:00100000:2.0:1746142905.492863:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3764:x1830962867762304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142905.492925:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3764:x1830962867762304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (101us total) trans 21474841139 rc 0/0 00000100:00100000:2.0:1746142905.492929:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13902 00000004:00080000:0.0:1746142905.492939:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097431c00/2, rc 0, transno 21474841139 00000100:00100000:0.0:1746142905.492943:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867762304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142905.493044:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.493057:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227008 00000100:00100000:2.0:1746142905.493059:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227008 00000100:00100000:2.0:1746142905.493594:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14354 00000100:00100000:2.0:1746142905.493600:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32208:x1830962867227008:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142905.493611:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.493622:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89f9d expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.493656:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.493667:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.493679:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.493681:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142905.493683:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f000, rc 0) 00000100:00100000:2.0:1746142905.494041:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867227008:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 440us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.494046:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14354 00000100:00100000:0.0:1746142905.496388:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142905.496565:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227136 00000100:00100000:2.0:1746142905.496571:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227136 00000100:00100000:2.0:1746142905.496612:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14355 00000100:00100000:2.0:1746142905.496618:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867227136:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142905.496631:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142905.496644:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ec00/0x2fa243e067ccc1e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fa4 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.496702:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.496710:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.496717:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142905.496733:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:2.0:1746142905.496736:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142905.496747:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142905.496767:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ec00/0x2fa243e067ccc1e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.496827:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142905.496833:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142905.496953:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142905.496957:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f800, rc 0) 00000100:00100000:2.0:1746142905.497000:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32208:x1830962867227136:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 379us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142905.497006:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14355 00000100:00100000:0.0:1746142905.499029:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.499060:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.499082:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.499097:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227264 00000100:00100000:0.0:1746142905.499103:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227264 00000100:00100000:0.0:1746142905.499136:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227392 00000100:00100000:0.0:1746142905.499137:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227392 00000100:00100000:0.0:1746142905.499147:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227520 00000100:00100000:0.0:1746142905.499149:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227520 00000100:00100000:0.0:1746142905.499160:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13903 00000100:00100000:0.0:1746142905.499165:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867227264:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:1.0:1746142905.499214:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13904 00000100:00100000:1.0:1746142905.499220:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867227392:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142905.499230:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.499243:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fb2 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142905.499258:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406b8, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x808 00010000:00010000:1.0:1746142905.499272:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.499274:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.499280:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 15 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.499291:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 15 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.499304:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a0400, rc 0) 00000100:00100000:1.0:1746142905.499330:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867227392:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 111us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.499335:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13904 00000100:00100000:1.0:1746142905.499345:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13905 00000100:00100000:1.0:1746142905.499350:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867227520:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142905.499355:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.499361:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fb9 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142905.499370:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406b8, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x800 00010000:00010000:1.0:1746142905.499377:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.499378:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.499382:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 15 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.499389:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 15 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.499395:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1800, rc 0) 00000100:00100000:1.0:1746142905.499408:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867227520:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.499412:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13905 00000100:00100000:1.0:1746142905.499505:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142905.499533:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142905.499591:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fab expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142905.499782:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406b8, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x7f0 00010000:00010000:0.0:1746142905.499791:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.499793:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142905.499797:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.499806:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142905.499811:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe5a00, rc 0) 00000100:00100000:0.0:1746142905.499826:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867227264:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 662us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142905.499831:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13903 00000100:00100000:1.0:1746142905.500202:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227648 00000100:00100000:1.0:1746142905.500206:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227648 00000100:00100000:1.0:1746142905.500450:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13906 00000100:00100000:1.0:1746142905.500457:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867227648:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142905.500472:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.500480:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fc0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142905.500489:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406b9, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x808 00010000:00010000:1.0:1746142905.500496:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.500498:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.500501:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.500510:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.500517:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0600, rc 0) 00000100:00100000:1.0:1746142905.500532:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867227648:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 76us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.500536:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13906 00000100:00100000:1.0:1746142905.501769:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.502941:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227904 00000100:00100000:0.0:1746142905.502949:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227904 00000100:00100000:1.0:1746142905.502973:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142905.503006:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867227776 00000100:00100000:0.0:1746142905.503008:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867227776 00000100:00100000:1.0:1746142905.503027:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13907 00000100:00100000:1.0:1746142905.503032:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867227904:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142905.503063:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.503106:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fce expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142905.503121:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406ba, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x1008 00010000:00010000:1.0:1746142905.503187:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.503189:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.503196:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.503208:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.503442:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0400, rc 0) 00000100:00100000:1.0:1746142905.503481:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867227904:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 448us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.503487:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13907 00000100:00100000:1.0:1746142905.503498:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13908 00000100:00100000:1.0:1746142905.503502:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867227776:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142905.503508:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142905.503515:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fc7 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142905.503526:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5032768, mtime: 0x681406ba, atime: 0x681406b9, ctime: 0x681406ba, blocks: 0x1670 00010000:00010000:1.0:1746142905.503532:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.503533:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142905.503536:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.503549:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142905.503555:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0800, rc 0) 00000100:00100000:1.0:1746142905.503566:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867227776:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 63us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142905.503569:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13908 00010000:00010000:3.0:1746142906.101099:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142906.507476:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.507505:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.507523:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.508124:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.508167:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228160 00000100:00100000:3.0:1746142906.508168:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228416 00000100:00100000:3.0:1746142906.508174:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228416 00000100:00100000:2.0:1746142906.508174:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228160 00000100:00100000:2.0:1746142906.508204:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228032 00000100:00100000:2.0:1746142906.508206:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228032 00000100:00100000:3.0:1746142906.508214:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13909 00000100:00100000:0.0:1746142906.508246:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.508266:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.508277:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228672 00000100:00100000:0.0:1746142906.508280:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228672 00000100:00100000:3.0:1746142906.508289:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867228160:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:1.0:1746142906.508298:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228288 00000100:00100000:1.0:1746142906.508300:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228288 00000100:00100000:1.0:1746142906.508306:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228544 00000100:00100000:1.0:1746142906.508307:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228544 00000100:00100000:2.0:1746142906.508334:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13910 00000100:00100000:2.0:1746142906.508339:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867228416:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:2.0:1746142906.508371:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867228416:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 32us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.508372:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867228160:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 85us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.508374:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13910 00000100:00100000:3.0:1746142906.508378:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13909 00000100:00100000:2.0:1746142906.508385:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13911 00000100:00100000:2.0:1746142906.508387:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867228032:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:2.0:1746142906.508409:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867228032:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 20us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.508416:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13911 00000100:00100000:0.0:1746142906.508549:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13912 00000100:00100000:0.0:1746142906.508556:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867228672:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:1.0:1746142906.508559:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13913 00000100:00100000:1.0:1746142906.508563:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867228544:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:1.0:1746142906.508595:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867228544:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.508595:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867228672:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 40us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.508600:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13913 00000100:00100000:0.0:1746142906.508609:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13912 00000100:00100000:1.0:1746142906.508652:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13914 00000100:00100000:1.0:1746142906.508656:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867228288:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:1.0:1746142906.508712:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867228288:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 55us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.508717:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13914 00000100:00100000:0.0:1746142906.511984:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.512046:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.512073:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.512099:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.512108:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228800 00000100:00100000:0.0:1746142906.512112:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229056 00000100:00100000:3.0:1746142906.512115:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228800 00000100:00100000:0.0:1746142906.512115:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229056 00000100:00100000:3.0:1746142906.512148:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867228928 00000100:00100000:3.0:1746142906.512150:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867228928 00000100:00100000:3.0:1746142906.512159:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229312 00000100:00100000:3.0:1746142906.512161:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229312 00000100:00100000:3.0:1746142906.512173:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13915 00000100:00100000:2.0:1746142906.512178:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13916 00000100:00100000:3.0:1746142906.512179:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867229056:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:2.0:1746142906.512183:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867228800:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:3.0:1746142906.512256:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867229056:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.512257:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13917 00000100:00100000:3.0:1746142906.512262:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13915 00000100:00100000:1.0:1746142906.512263:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867228928:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:3.0:1746142906.512273:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13918 00000100:00100000:3.0:1746142906.512276:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867229312:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142906.512319:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.512352:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867228800:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.512357:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13916 00000100:00100000:0.0:1746142906.512369:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229184 00000100:00100000:0.0:1746142906.512371:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229184 00000100:00100000:0.0:1746142906.512384:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13919 00000100:00100000:0.0:1746142906.512388:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867229184:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:0.0:1746142906.512414:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867229184:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 26us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.512418:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13919 00000100:00100000:3.0:1746142906.512596:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962867229312:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 318us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.512601:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13918 00000100:00100000:1.0:1746142906.512775:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867228928:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 510us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.512781:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13917 00000100:00100000:0.0:1746142906.513070:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.513146:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229440 00000100:00100000:1.0:1746142906.513150:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229440 00000100:00100000:1.0:1746142906.513168:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13920 00000100:00100000:1.0:1746142906.513172:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867229440:12345-192.168.204.50@tcp:23:mirror_io.0 00000100:00100000:1.0:1746142906.513205:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867229440:12345-192.168.204.50@tcp:23:mirror_io.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.513211:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13920 00000100:00100000:0.0:1746142906.515679:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.516649:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229568 00000100:00100000:1.0:1746142906.516658:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229568 00000100:00100000:1.0:1746142906.516709:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13921 00000100:00100000:1.0:1746142906.516716:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867229568:12345-192.168.204.50@tcp:22:mirror_io.0 00002000:00010000:1.0:1746142906.516871:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142906.516874:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142906.516876:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:1.0:1746142906.516878:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142906.516879:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746142906.516961:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867229568:12345-192.168.204.50@tcp:22:mirror_io.0 Request processed in 244us (1289us total) trans 17179873874 rc 0/0 00000100:00100000:1.0:1746142906.516968:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13921 00000100:00100000:0.0:1746142906.522809:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.522933:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229696 00000100:00100000:1.0:1746142906.522941:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229696 00000100:00100000:1.0:1746142906.522987:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13922 00000100:00100000:1.0:1746142906.522996:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867229696:12345-192.168.204.50@tcp:22:mirror_io.0 00002000:00010000:1.0:1746142906.523162:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142906.523165:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142906.523167:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142906.523168:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142906.523170:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142906.523221:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867229696:12345-192.168.204.50@tcp:22:mirror_io.0 Request processed in 225us (419us total) trans 21474841140 rc 0/0 00000100:00100000:1.0:1746142906.523227:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13922 00000100:00100000:0.0:1746142906.530353:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.530382:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.530414:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867229952 00000100:00100000:0.0:1746142906.530422:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867229952 00000100:00100000:0.0:1746142906.530490:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867230208 00000100:00100000:0.0:1746142906.530492:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867230208 00000100:00100000:0.0:1746142906.530511:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4184 00000100:00100000:0.0:1746142906.530517:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867229952:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:0.0:1746142906.530548:0:9583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.530560:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142906.530617:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4185 00000100:00100000:2.0:1746142906.530625:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867230208:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:2.0:1746142906.530641:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.530649:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.530651:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.530655:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.530667:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.532493:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.532500:0:9583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.532515:0:9583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142906.534483:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.534997:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.536400:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.536603:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867230720 00000100:00100000:3.0:1746142906.536610:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867230720 00000100:00100000:1.0:1746142906.536620:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.536644:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867230592 00000100:00100000:1.0:1746142906.536646:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867230592 00000100:00100000:3.0:1746142906.536649:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867230976 00000100:00100000:3.0:1746142906.536650:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867230976 00000100:00100000:3.0:1746142906.536661:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867231104 00000100:00100000:3.0:1746142906.536662:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867231104 00000100:00100000:1.0:1746142906.536674:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4186 00000100:00100000:3.0:1746142906.536678:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4187 00000100:00100000:1.0:1746142906.536681:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867230720:12345-192.168.204.50@tcp:3:mirror_io.0 00000100:00100000:3.0:1746142906.536682:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+20:2004:x1830962867230976:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:3.0:1746142906.536710:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.536710:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.536721:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142906.536721:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.536722:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142906.536722:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.536726:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.536726:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.536737:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.536737:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.537222:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4188 00000100:00100000:2.0:1746142906.537230:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c8243383-433c-45fe-9bef-8828afa9ff81+18:2004:x1830962867230592:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:2.0:1746142906.537243:0:29475:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.537249:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.537251:0:29475:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.537253:0:29475:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.537260:0:29475:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142906.537265:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4189 00000100:00100000:3.0:1746142906.537269:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+21:2004:x1830962867231104:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:3.0:1746142906.537280:0:20334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.537285:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.537286:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.537288:0:20334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.537293:0:20334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.539298:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.539504:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867231616 00000100:00100000:0.0:1746142906.539510:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867231616 00000100:00100000:0.0:1746142906.539545:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4190 00000100:00100000:0.0:1746142906.539551:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+20:2003:x1830962867231616:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:0.0:1746142906.539575:0:29473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.539585:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.539586:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.539590:0:29473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.539600:0:29473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.540955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.541096:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867231744 00000100:00100000:0.0:1746142906.541102:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867231744 00000100:00100000:0.0:1746142906.541140:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4191 00000100:00100000:0.0:1746142906.541147:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+23:2003:x1830962867231744:12345-192.168.204.50@tcp:3:mirror_io.0 00010000:00010000:0.0:1746142906.541166:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.541175:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.541176:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.541180:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.541189:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545285:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545298:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545305:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545310:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471ea00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142906.545313:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545319:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545333:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.545339:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471ea00/0x2fa243e067ccc221 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.545409:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c8243383-433c-45fe-9bef-8828afa9ff81+23:2003:x1830962867230208:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 14783us (15023us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.545418:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4185 00010000:00010000:1.0:1746142906.548512:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.548525:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.548532:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.548538:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe4800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142906.548541:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.548548:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.548562:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.548568:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccc21a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142906.548639:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+20:2003:x1830962867229952:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 18118us (18289us total) trans 0 rc 1036288/1036288 00000100:00100000:1.0:1746142906.548646:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4184 00010000:00010000:3.0:1746142906.553689:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.553704:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.553712:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.553717:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd88600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142906.553721:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.553727:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.553742:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.553747:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd88600/0x2fa243e067ccc22f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142906.555096:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+21:2004:x1830962867230976:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 18406us (18693us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.555105:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4187 00010000:00010000:2.0:1746142906.559398:0:29475:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.559412:0:29475:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.559419:0:29475:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.559425:0:29475:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142906.559429:0:29475:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.559435:0:29475:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.559460:0:29475:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.559465:0:29475:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc236 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29475 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.559530:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c8243383-433c-45fe-9bef-8828afa9ff81+18:2004:x1830962867230592:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 22296us (24527us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.559539:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4188 00010000:00010000:3.0:1746142906.561973:0:20334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.561986:0:20334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.561994:0:20334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.562001:0:20334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd89400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142906.562005:0:20334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.562011:0:20334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.562026:0:20334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.562031:0:20334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc23d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142906.562086:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+19:2004:x1830962867231104:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 24812us (25462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.562094:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4189 00010000:00010000:1.0:1746142906.567586:0:29472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.567603:0:29472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.567610:0:29472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.567615:0:29472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142906.567619:0:29472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.567626:0:29472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.567639:0:29472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.567644:0:29472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067ccc228 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142906.568518:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867230720:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 31832us (34036us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142906.568528:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4186 00010000:00010000:2.0:1746142906.569636:0:29473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.569646:0:29473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.569652:0:29473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.569658:0:29473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe5600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142906.569661:0:29473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.569667:0:29473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.569679:0:29473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.569684:0:29473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5600/0x2fa243e067ccc244 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.569721:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867231616:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 30169us (30427us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.569728:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4190 00010000:00010000:2.0:1746142906.572468:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.572490:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.572497:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.572502:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801313dee00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142906.572505:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.572511:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.572524:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.572529:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801313dee00/0x2fa243e067ccc24b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.572590:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867231744:12345-192.168.204.50@tcp:3:mirror_io.0 Request processed in 31440us (31633us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.572598:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4191 00000100:00100000:0.0:1746142906.575740:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.575823:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867231872 00000100:00100000:2.0:1746142906.575830:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867231872 00000100:00100000:2.0:1746142906.575892:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 755 00000100:00100000:2.0:1746142906.575918:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32208:x1830962867231872:12345-192.168.204.50@tcp:103:mirror_io.0 00010000:00010000:2.0:1746142906.575937:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1746142906.575950:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746142906.575956:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc195 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f8f expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.575969:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.575972:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142906.575999:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867231872:12345-192.168.204.50@tcp:103:mirror_io.0 Request processed in 101us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.576004:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 755 00000100:00100000:2.0:1746142906.577557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.577615:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867232128 00000100:00100000:0.0:1746142906.577620:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867232128 00000100:00100000:0.0:1746142906.577684:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5214 00000100:00100000:0.0:1746142906.577692:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4852c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:32208:x1830962867232128:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:0.0:1746142906.578085:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4852c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32208:x1830962867232128:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 316us (453us total) trans 8589936501 rc 0/0 00000100:00100000:0.0:1746142906.578092:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5214 00000100:00100000:0.0:1746142906.579217:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.579272:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867232384 00000100:00100000:2.0:1746142906.579277:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867232384 00000100:00100000:2.0:1746142906.579307:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5215 00000100:00100000:2.0:1746142906.579312:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32208:x1830962867232384:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:2.0:1746142906.579407:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32208:x1830962867232384:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 94us (192us total) trans 8589936502 rc 0/0 00000100:00100000:2.0:1746142906.579411:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5215 00000100:00100000:0.0:1746142906.596021:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.596390:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867232640 00000100:00100000:2.0:1746142906.596401:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867232640 00000100:00100000:0.0:1746142906.598689:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.598860:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867232896 00000100:00100000:2.0:1746142906.598868:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867232896 00000100:00100000:1.0:1746142906.598871:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14356 00000100:00100000:1.0:1746142906.598882:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32217:x1830962867232640:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:2.0:1746142906.598929:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14357 00000100:00100000:2.0:1746142906.598935:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:32218:x1830962867232896:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.598948:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.598951:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142906.598967:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc252 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fdc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.598967:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccc259 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fd5 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.599021:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599022:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599032:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599040:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599051:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599057:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599062:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599140:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599148:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599153:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:1.0:1746142906.599160:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142906.599214:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599295:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599303:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599304:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599313:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599316:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599318:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599322:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599323:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bc29a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142906.599326:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599326:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599332:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599340:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142906.599343:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142906.599346:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599350:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29a00/0x2fa243e067ccc260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599376:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599380:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599382:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599385:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599389:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599389:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bc29800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142906.599390:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599393:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746142906.599398:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142906.599399:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599405:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462b00) 00010000:00010000:1.0:1746142906.599407:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142906.599408:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.599412:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc26e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.599432:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599451:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccc259 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.599453:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599460:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599462:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.599464:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599467:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142906.599468:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.599469:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142906.599469:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142906.599471:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc29000, rc 0) 00010000:00010000:2.0:1746142906.599473:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599484:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142906.599486:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142906.599488:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599492:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599503:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599506:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599510:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599514:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142906.599515:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599528:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599533:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462b00) 00010000:00010000:2.0:1746142906.599535:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142906.599536:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599544:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc283 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142906.599572:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc252 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.599580:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.599591:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.599593:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142906.599594:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:2.0:1746142906.599828:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:32218:x1830962867232896:12345-192.168.204.50@tcp:101:cat.0 Request processed in 892us (1145us total) trans 8589936504 rc 0/0 00000100:00100000:2.0:1746142906.599834:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14357 00000100:00100000:1.0:1746142906.599885:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32217:x1830962867232640:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1003us (3870us total) trans 8589936503 rc 0/0 00000100:00100000:1.0:1746142906.599893:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14356 00000100:00100000:0.0:1746142906.607339:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.607402:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.607414:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233024 00000100:00100000:3.0:1746142906.607421:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233024 00000100:00100000:2.0:1746142906.607737:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.608554:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.608599:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233280 00000100:00100000:0.0:1746142906.608605:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233280 00000100:00100000:0.0:1746142906.608650:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234176 00000100:00100000:0.0:1746142906.608655:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234176 00000100:00100000:0.0:1746142906.608680:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14358 00000100:00100000:0.0:1746142906.608688:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32221:x1830962867233280:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.608713:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.608731:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccc298 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fea expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.608824:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.608838:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.608848:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142906.608859:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000100:00100000:1.0:1746142906.609046:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14359 00000100:00100000:1.0:1746142906.609056:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32220:x1830962867234176:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142906.609068:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.609078:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccc2ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a014 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.609118:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.609128:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.609133:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.609139:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.609144:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.609180:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.609197:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 10 pid: 7231 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.609207:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867762432:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142906.609224:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233408 00000100:00100000:3.0:1746142906.609228:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233408 00000100:00100000:2.0:1746142906.609250:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13923 00000100:00100000:2.0:1746142906.609259:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867233024:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.609268:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142906.609271:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13924 00000100:00100000:3.0:1746142906.609277:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867233408:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.609277:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fe3 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.609279:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.609285:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.609286:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 30 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.609291:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.609293:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142906.609296:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867762560:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.609299:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ff1 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.609300:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 24 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142906.609310:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.609310:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 24 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.609314:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.609317:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.609318:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2600, rc 0) 00010000:00010000:1.0:1746142906.609320:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.609322:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142906.609326:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867762688:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.609332:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142906.609338:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a85180 going to sleep for 11 seconds 00000100:00100000:2.0:1746142906.609339:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867233024:12345-192.168.204.50@tcp:101:cat.0 Request processed in 82us (2009us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142906.609344:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd89400, rc 0) 00000100:00100000:2.0:1746142906.609345:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13923 00000100:00100000:3.0:1746142906.609370:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867233408:12345-192.168.204.50@tcp:101:cat.0 Request processed in 87us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.609375:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13924 00010000:00010000:0.0:1746142906.609758:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccc298 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 31 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.609792:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 30 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.609799:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142906.609802:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746142906.609805:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142906.609810:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142906.609815:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732c00, rc 0) 00000100:00100000:0.0:1746142906.609848:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32221:x1830962867233280:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1160us (2445us total) trans 8589936505 rc 0/0 00000100:00100000:0.0:1746142906.609854:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14358 00000100:00100000:1.0:1746142906.609968:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.610038:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233536 00000100:00100000:3.0:1746142906.610041:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233536 00000100:00100000:3.0:1746142906.610070:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13925 00000100:00100000:3.0:1746142906.610124:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867233536:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142906.610131:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142906.610138:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89ff8 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.610149:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.610150:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.610154:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 15 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142906.610163:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 15 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142906.610170:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd89a00, rc 0) 00000100:00100000:3.0:1746142906.610200:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867233536:12345-192.168.204.50@tcp:101:cat.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.610205:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13925 00000100:00100000:0.0:1746142906.613804:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.613853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.613873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.613893:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233664 00000100:00100000:2.0:1746142906.613914:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233664 00000100:00100000:0.0:1746142906.613932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.613942:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233792 00000100:00100000:2.0:1746142906.613944:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233792 00000100:00100000:0.0:1746142906.613948:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.613953:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867233920 00000100:00100000:2.0:1746142906.613954:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867233920 00000100:00100000:2.0:1746142906.613966:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13926 00000100:00100000:0.0:1746142906.613969:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.613972:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867233664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.613987:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142906.613999:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb89fff expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142906.614001:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142906.614016:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.614017:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.614024:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142906.614026:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234560 00000100:00100000:0.0:1746142906.614029:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234560 00010000:00010000:2.0:1746142906.614037:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142906.614046:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3600, rc 0) 00000100:00100000:0.0:1746142906.614053:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14360 00000100:00100000:0.0:1746142906.614057:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32221:x1830962867234560:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.614068:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.614076:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccc2d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a01b expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.614078:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867233664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.614083:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13926 00000100:00100000:2.0:1746142906.614094:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13927 00000100:00100000:2.0:1746142906.614098:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867233792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.614102:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142906.614107:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a006 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.614115:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.614116:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.614118:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142906.614125:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 26 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142906.614130:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3400, rc 0) 00010000:00010000:0.0:1746142906.614136:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00000100:00100000:2.0:1746142906.614142:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867233792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 44us (289us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142906.614145:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00000100:00100000:2.0:1746142906.614146:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13927 00010000:00010000:0.0:1746142906.614151:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00000100:00100000:2.0:1746142906.614154:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13928 00000100:00100000:2.0:1746142906.614158:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867233920:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.614162:0:22383:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.614164:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142906.614169:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a00d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.614169:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142906.614178:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.614179:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.614182:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142906.614189:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142906.614195:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2400, rc 0) 00000100:00100000:2.0:1746142906.614207:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867233920:12345-192.168.204.50@tcp:101:cat.0 Request processed in 49us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.614212:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13928 00000100:00100000:2.0:1746142906.614229:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234432 00000100:00100000:2.0:1746142906.614231:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234432 00010000:00010000:2.0:1746142906.614243:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 10 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746142906.614256:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234304 00000100:00100000:2.0:1746142906.614258:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234304 00000100:00100000:0.0:1746142906.614258:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234688 00000100:00100000:0.0:1746142906.614260:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234688 00010000:00010000:2.0:1746142906.614264:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 32 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746142906.614269:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 11 pid: 7231 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746142906.614274:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6221 00000100:00100000:2.0:1746142906.614279:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867234432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142906.614283:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6222 00010000:00010000:2.0:1746142906.614286:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142906.614287:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867234304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.614290:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 10 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746142906.614291:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142906.614294:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 32 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.614297:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 10 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:0.0:1746142906.614303:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 32 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.614320:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.614324:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.614329:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142906.614333:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142906.614337:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142906.614341:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.614351:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6223 00000100:00100000:3.0:1746142906.614358:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867234688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142906.614358:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867234432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.614362:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6221 00010000:00010000:3.0:1746142906.614364:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.614367:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 11 pid: 7231 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.614375:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 11 pid: 7231 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.614384:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.614387:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142906.614392:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.614396:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142906.614400:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.614404:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.614421:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867234688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.614425:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6223 00010000:00010000:1.0:1746142906.614503:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccc28a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fdc expref: 10 pid: 7231 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.614515:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867762432:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142906.614524:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867762560:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.614535:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccc1e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fa4 expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.614542:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867762688:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142906.614545:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29000/0x2fa243e067ccc275 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fd5 expref: 32 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.614557:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142906.614564:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142906.614567:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142906.614576:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142906.614987:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142906.614995:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142906.614999:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142906.615024:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142906.615035:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142906.615050:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867234304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 762us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.615056:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6222 00010000:00010000:1.0:1746142906.615196:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142906.615202:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00000004:00200000:1.0:1746142906.615219:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142906.615299:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccc2ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.615310:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 10 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.615316:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 10 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.615321:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc29800, rc 0) 00000100:00100000:1.0:1746142906.615491:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32220:x1830962867234176:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6435us (6938us total) trans 8589936506 rc 0/0 00000100:00100000:1.0:1746142906.615497:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14359 00000100:00100000:0.0:1746142906.618530:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.618600:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.618820:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234816 00000100:00100000:1.0:1746142906.618827:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234816 00000100:00100000:1.0:1746142906.618859:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14361 00000100:00100000:1.0:1746142906.618866:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32218:x1830962867234816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142906.618879:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.618893:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccc2fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a022 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.618963:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccc2fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a022 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.618974:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccc2fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a022 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.618991:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.618994:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142906.618997:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3fe00, rc 0) 00000100:00100000:1.0:1746142906.619042:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32218:x1830962867234816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 176us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.619048:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14361 00000100:00100000:2.0:1746142906.619146:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867234944 00000100:00100000:2.0:1746142906.619149:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867234944 00010000:00010000:2.0:1746142906.619168:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 11 pid: 7230 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746142906.619346:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6224 00000100:00100000:2.0:1746142906.619353:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867234944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.619360:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142906.619365:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 11 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.619375:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 11 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.619388:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bc29800/0x2fa243e067ccc2b4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a014 expref: 11 pid: 7230 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.619401:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.619405:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142906.619410:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142906.619415:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142906.619447:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142906.619826:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.619832:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:1.0:1746142906.619860:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142906.619863:0:22383:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142906.619875:0:22383:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.619895:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccc2d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 31 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.619921:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 30 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.619926:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.619928:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142906.619930:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732e00, rc 0) 00000100:00100000:2.0:1746142906.619977:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867234944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 623us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.619983:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6224 00000100:00100000:1.0:1746142906.620072:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32221:x1830962867234560:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6014us (6101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.620080:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14360 00000100:00100000:0.0:1746142906.626821:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.626851:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.626871:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.626895:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.626928:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.626948:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235072 00000100:00100000:0.0:1746142906.626956:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235072 00000100:00100000:0.0:1746142906.626983:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235200 00000100:00100000:0.0:1746142906.626984:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235200 00000100:00100000:0.0:1746142906.626993:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235328 00000100:00100000:0.0:1746142906.626995:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235328 00000100:00100000:0.0:1746142906.627001:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235456 00000100:00100000:0.0:1746142906.627002:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235456 00000100:00100000:0.0:1746142906.627009:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235584 00000100:00100000:0.0:1746142906.627010:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235584 00000100:00100000:0.0:1746142906.627022:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13929 00000100:00100000:0.0:1746142906.627029:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867235072:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.627045:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.627059:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a029 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.627078:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627080:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627086:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 39 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627099:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 39 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627108:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732a00, rc 0) 00000100:00100000:0.0:1746142906.627146:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867235072:12345-192.168.204.50@tcp:101:cat.0 Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.627151:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13929 00000100:00100000:0.0:1746142906.627164:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13930 00000100:00100000:0.0:1746142906.627169:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867235200:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.627175:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.627183:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a030 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.627197:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627199:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627203:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627212:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627219:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733800, rc 0) 00000100:00100000:0.0:1746142906.627233:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867235200:12345-192.168.204.50@tcp:101:cat.0 Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.627238:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13930 00000100:00100000:0.0:1746142906.627247:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13931 00000100:00100000:0.0:1746142906.627251:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867235328:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.627256:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.627262:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a037 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.627270:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627271:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627274:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627282:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627292:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733c00, rc 0) 00000100:00100000:0.0:1746142906.627305:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867235328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 54us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.627309:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13931 00000100:00100000:0.0:1746142906.627318:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13932 00000100:00100000:0.0:1746142906.627322:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867235456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.627327:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.627333:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a03e expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.627340:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627341:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627345:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 39 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627352:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 39 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627358:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732800, rc 0) 00000100:00100000:0.0:1746142906.627370:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867235456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 47us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.627374:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13932 00000100:00100000:0.0:1746142906.627382:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13933 00000100:00100000:0.0:1746142906.627387:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867235584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.627393:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.627398:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a045 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.627406:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627407:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627411:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 39 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627418:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 39 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627424:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732600, rc 0) 00000100:00100000:0.0:1746142906.627435:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867235584:12345-192.168.204.50@tcp:101:cat.0 Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.627461:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13933 00000100:00100000:0.0:1746142906.627491:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.627504:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235712 00000100:00100000:0.0:1746142906.627507:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235712 00000100:00100000:0.0:1746142906.627520:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13934 00000100:00100000:0.0:1746142906.627524:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867235712:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.627529:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.627535:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a04c expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.627543:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627544:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142906.627548:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 34 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627556:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 34 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142906.627562:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0000, rc 0) 00000100:00100000:0.0:1746142906.627576:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867235712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 51us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.627579:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13934 00000100:00100000:0.0:1746142906.627652:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.627932:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867235840 00000100:00100000:1.0:1746142906.627937:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867235840 00000100:00100000:1.0:1746142906.627962:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14362 00000100:00100000:1.0:1746142906.627966:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:32220:x1830962867235840:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142906.627977:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.627986:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a053 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.628023:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.628032:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.628044:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.628046:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142906.628049:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3f400, rc 0) 00000100:00100000:1.0:1746142906.628070:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:32220:x1830962867235840:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 103us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.628075:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14362 00000100:00100000:2.0:1746142906.631275:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.631298:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.631797:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.631951:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.632023:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867236224 00000100:00100000:0.0:1746142906.632030:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867236224 00000100:00100000:3.0:1746142906.632364:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867236352 00000100:00100000:3.0:1746142906.632368:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867236352 00002000:00100000:3.0:1746142906.632389:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092406680 x1830962867236352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.632398:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406680 with x1830962867236352 ext(1048576->2097151) 00002000:00010000:3.0:1746142906.632402:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406680 00000100:00100000:3.0:1746142906.632416:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867236608 00000100:00100000:3.0:1746142906.632418:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867236608 00002000:00100000:3.0:1746142906.632426:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880092405f80 x1830962867236608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.632431:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405f80 with x1830962867236608 ext(1048576->2097151) 00002000:00010000:3.0:1746142906.632433:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092405f80 00000100:00100000:3.0:1746142906.632457:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4192 00000100:00100000:3.0:1746142906.632463:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867236352:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:0.0:1746142906.633401:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092404380 x1830962867236224/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142906.633410:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404380 with x1830962867236224 ext(0->1048575) 00002000:00010000:0.0:1746142906.633413:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404380 00000100:00100000:1.0:1746142906.634866:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867236864 00000100:00100000:1.0:1746142906.634874:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867236864 00002000:00100000:1.0:1746142906.634919:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880092406300 x1830962867236864/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.634926:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406300 with x1830962867236864 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.634929:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092406300 00000100:00100000:0.0:1746142906.635459:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.636200:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.636223:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4193 00000100:00100000:0.0:1746142906.636233:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867236608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142906.638524:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4194 00000100:00100000:3.0:1746142906.638538:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867236224:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142906.638887:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867237248 00000100:00100000:0.0:1746142906.638894:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867237248 00000100:00100000:0.0:1746142906.638939:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14363 00000100:00100000:0.0:1746142906.638943:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:32220:x1830962867237248:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142906.638952:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.638954:0:22383:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746142906.638974:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccc2fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a022 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.638993:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142906.638996:0:22383:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142906.639004:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067ccc332 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a05a expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639035:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142906.639043:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 29 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639048:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639052:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142906.639093:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4195 00000100:00100000:3.0:1746142906.639099:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867236864:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1746142906.639272:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639279:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142906.639304:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639314:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 29 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746142906.639329:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867762816:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142906.639389:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639397:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746142906.639404:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867762944:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142906.639427:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639434:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 8 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746142906.639458:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867763072:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142906.639487:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 29 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.639494:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 29 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:0.0:1746142906.639500:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867763200:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142906.639528:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142906.639712:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867236992 00000100:00100000:3.0:1746142906.639716:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867236992 00010000:00010000:3.0:1746142906.639733:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 12 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.639758:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6225 00000100:00100000:3.0:1746142906.639763:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867236992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.639772:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.639777:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 12 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.639785:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 12 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.639796:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.639799:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.639804:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.639808:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.639827:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867236992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.639833:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6225 00000100:00100000:3.0:1746142906.641930:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.641957:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.641966:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867237504 00000100:00100000:3.0:1746142906.641969:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.641973:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867237504 00000100:00100000:3.0:1746142906.641994:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:1.0:1746142906.642004:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096141f80 x1830962867237504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.642013:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141f80 with x1830962867237504 ext(0->1048575) 00002000:00010000:1.0:1746142906.642018:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096141f80 00000100:00100000:2.0:1746142906.645640:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867237760 00000100:00100000:1.0:1746142906.645640:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238144 00000100:00100000:2.0:1746142906.645649:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867237760 00000100:00100000:1.0:1746142906.645649:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238144 00002000:00100000:2.0:1746142906.645682:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096140700 x1830962867237760/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.645682:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088fdaa00 x1830962867238144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.645691:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140700 with x1830962867237760 ext(1048576->2097151) 00002000:00100000:1.0:1746142906.645691:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdaa00 with x1830962867238144 ext(1048576->2097151) 00002000:00010000:2.0:1746142906.645695:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096140700 00002000:00010000:1.0:1746142906.645695:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdaa00 00000100:00100000:1.0:1746142906.645709:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238272 00000100:00100000:1.0:1746142906.645711:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238272 00002000:00100000:1.0:1746142906.645724:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088fd9c00 x1830962867238272/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142906.645729:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4196 00002000:00100000:1.0:1746142906.645730:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9c00 with x1830962867238272 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.645733:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fd9c00 00000100:00100000:2.0:1746142906.645739:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867237504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.645792:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4197 00000100:00100000:1.0:1746142906.645799:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867238144:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142906.646320:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4198 00000100:00100000:2.0:1746142906.646326:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867237760:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.646396:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4199 00000100:00100000:1.0:1746142906.646402:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867238272:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.648351:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867762816:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.648368:0:22383:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@ffff8800924a1f80 x1830962867762944) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.648389:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f400/0x2fa243e067ccc32b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a053 expref: 11 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.648406:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867762944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142906.648533:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867236352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16068us (17233us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.648542:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4192 00002000:00100000:3.0:1746142906.648550:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092406680 x1830962867236352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.648559:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406680 with x1830962867236352 ext(1048576->2097151) 00002000:00010000:3.0:1746142906.648564:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406680 00000100:00100000:0.0:1746142906.651820:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.653779:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.653802:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238400 00000100:00100000:0.0:1746142906.653809:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238400 00010000:00010000:0.0:1746142906.653837:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 30 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.653940:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867763072:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142906.654945:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238528 00000100:00100000:3.0:1746142906.654949:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238528 00010000:00010000:3.0:1746142906.654967:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.655381:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867763200:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.655404:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.655409:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.655416:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.655422:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:1.0:1746142906.655460:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.656209:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238656 00000100:00100000:3.0:1746142906.656214:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238656 00010000:00010000:3.0:1746142906.656230:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 31 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.656253:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6226 00000100:00100000:3.0:1746142906.656260:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867238400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.656270:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.656275:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 31 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656284:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 31 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656301:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc29f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fea expref: 31 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656313:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.656316:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656321:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656329:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.656361:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867238400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 102us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.656367:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6226 00000100:00100000:3.0:1746142906.656380:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6227 00000100:00100000:3.0:1746142906.656385:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867238528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.656390:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.656394:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656401:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656410:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccc1db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89f9d expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656416:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.656419:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656423:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656427:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.656454:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867238528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.656459:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6227 00000100:00100000:3.0:1746142906.656470:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6228 00000100:00100000:3.0:1746142906.656474:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867238656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.656479:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.656482:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 29 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656490:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 29 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656499:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc2e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a01b expref: 29 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.656505:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.656507:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656512:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656517:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.656533:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.656545:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867238656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.656550:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6228 00000100:00100000:0.0:1746142906.657242:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867236608:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21011us (25444us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142906.657249:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4193 00002000:00100000:0.0:1746142906.657256:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880092405f80 x1830962867236608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142906.657264:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405f80 with x1830962867236608 ext(1048576->2097151) 00002000:00010000:0.0:1746142906.657268:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092405f80 00010000:00010000:1.0:1746142906.661199:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.661213:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000040:00080000:1.0:1746142906.661422:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].601, 88 off60600 00000004:00080000:1.0:1746142906.661428:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680660527657ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.661458:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].669, 88 off66680 00000004:00080000:1.0:1746142906.661461:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680660561627ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.661471:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].670, 88 off66768 00000004:00080000:1.0:1746142906.661474:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680660573885ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662287:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].602, 88 off60688 00000004:00080000:1.0:1746142906.662292:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661391743ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.662300:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].603, 88 off60776 00000004:00080000:1.0:1746142906.662302:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661402165ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.662310:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].671, 88 off66856 00000004:00080000:1.0:1746142906.662312:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661412180ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662362:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].672, 88 off66944 00000004:00080000:1.0:1746142906.662365:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661465538ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662374:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].604, 88 off60864 00000004:00080000:1.0:1746142906.662377:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661476573ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.662384:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].673, 88 off67032 00000004:00080000:1.0:1746142906.662387:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661487450ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662395:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].605, 88 off60952 00000004:00080000:1.0:1746142906.662397:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661497317ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.662404:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].674, 88 off67120 00000004:00080000:1.0:1746142906.662407:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661506775ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662413:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].606, 88 off61040 00000004:00080000:1.0:1746142906.662416:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661515795ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.662423:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].675, 88 off67208 00000004:00080000:1.0:1746142906.662426:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661526080ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662434:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].607, 88 off61128 00000004:00080000:1.0:1746142906.662436:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661536368ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142906.662458:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].676, 88 off67296 00000004:00080000:1.0:1746142906.662461:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661560835ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662468:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].677, 88 off67384 00000004:00080000:1.0:1746142906.662470:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 680661570445ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142906.662478:0:22383:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].608, 88 off61216 00000004:00080000:1.0:1746142906.662480:0:22383:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 680661579827ns, next at 629431245375ns, rc = 0 00000100:00100000:3.0:1746142906.666091:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867236224:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27550us (34814us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.666101:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4194 00002000:00100000:3.0:1746142906.666111:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092404380 x1830962867236224/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.666119:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404380 with x1830962867236224 ext(0->1048575) 00002000:00010000:3.0:1746142906.666124:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404380 00000100:00100000:3.0:1746142906.670522:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867236864:12345-192.168.204.50@tcp:3:cat.0 Request processed in 31415us (38562us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.670532:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4195 00002000:00100000:3.0:1746142906.670541:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880092406300 x1830962867236864/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.670549:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406300 with x1830962867236864 ext(1048576->2097151) 00002000:00010000:3.0:1746142906.670555:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092406300 00000100:00100000:3.0:1746142906.670622:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867237504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 24886us (28702us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.670628:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4196 00002000:00100000:3.0:1746142906.670633:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880096141f80 x1830962867237504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.670640:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141f80 with x1830962867237504 ext(0->1048575) 00002000:00010000:3.0:1746142906.670643:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096141f80 00000001:00080000:2.0:1746142906.671988:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936507 is committed 00000004:00080000:2.0:1746142906.671995:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 597 committed 00000004:00080000:2.0:1746142906.672001:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 666 committed 00000004:00080000:2.0:1746142906.672015:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 665 committed 00000004:00080000:2.0:1746142906.672017:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 596 committed 00000004:00080000:2.0:1746142906.672019:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 664 committed 00000004:00080000:2.0:1746142906.672020:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 595 committed 00000004:00080000:2.0:1746142906.672021:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 663 committed 00000004:00080000:2.0:1746142906.672023:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 594 committed 00000004:00080000:2.0:1746142906.672024:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 662 committed 00000004:00080000:2.0:1746142906.672026:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 593 committed 00000004:00080000:2.0:1746142906.672027:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 661 committed 00000004:00080000:2.0:1746142906.672029:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 660 committed 00000004:00080000:2.0:1746142906.672030:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 592 committed 00000004:00080000:2.0:1746142906.672032:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 591 committed 00000004:00080000:2.0:1746142906.672033:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 659 committed 00000004:00080000:2.0:1746142906.672034:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 658 committed 00000004:00080000:2.0:1746142906.672036:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 590 committed 00000001:00080000:2.0:1746142906.672040:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936505 is committed 00000001:00080000:2.0:1746142906.672046:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936502 is committed 00000100:00100000:3.0:1746142906.672191:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867763712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142906.672228:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142906.672266:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142906.672281:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142906.672297:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746142906.672302:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867763584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142906.672316:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142906.672325:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142906.672336:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142906.672354:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867763712 00000100:00100000:3.0:1746142906.672360:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867763712 00000100:00100000:3.0:1746142906.672390:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764224 00000100:00100000:3.0:1746142906.672393:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764224 00000100:00100000:3.0:1746142906.672402:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867763584 00000100:00100000:3.0:1746142906.672404:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867763584 00000100:00100000:3.0:1746142906.672412:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764096 00000100:00100000:3.0:1746142906.672414:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764096 00000100:00100000:3.0:1746142906.672424:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13935 00000100:00100000:3.0:1746142906.672430:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867763712:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746142906.672545:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1746142906.672550:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142906.672553:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142906.672555:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142906.672557:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142906.672558:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142906.672573:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13936 00000100:00100000:3.0:1746142906.672583:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3765:x1830962867763712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 153us (354us total) trans 17179873875 rc 0/0 00000100:00100000:3.0:1746142906.672589:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13935 00000100:00100000:0.0:1746142906.672594:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3765:x1830962867764224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142906.672600:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13937 00000100:00100000:3.0:1746142906.672605:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867763584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142906.672644:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142906.672646:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142906 -> 1746142906 00002000:00010000:3.0:1746142906.672648:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:3.0:1746142906.672650:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:3.0:1746142906.672652:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746142906.672669:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3765:x1830962867763584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (352us total) trans 17179873876 rc 0/0 00000100:00100000:3.0:1746142906.672674:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13937 00000100:00100000:3.0:1746142906.672683:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13938 00000100:00100000:3.0:1746142906.672688:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867764096:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142906.672711:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fdb100/2, rc 0, transno 17179873876 00000100:00100000:3.0:1746142906.672718:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867763584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142906.672725:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd8000/2, rc 0, transno 17179873875 00000100:00100000:3.0:1746142906.672728:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867763712:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142906.672767:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142906.672770:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142906.672772:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746142906.672798:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142906.672819:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.672831:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142906.672845:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.672855:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746142906.672859:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142906.672872:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.672881:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142906.672893:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.672933:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867764352:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142906.672941:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142906.672943:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:2.0:1746142906.672950:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142906.673045:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867763456 00000100:00100000:1.0:1746142906.673050:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867763456 00000100:00100000:3.0:1746142906.673502:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867763968 00000100:00100000:3.0:1746142906.673506:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867763968 00000100:00100000:3.0:1746142906.673523:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867763328 00000100:00100000:3.0:1746142906.673525:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867763328 00000100:00100000:3.0:1746142906.673531:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867763840 00000100:00100000:3.0:1746142906.673533:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867763840 00000100:00100000:3.0:1746142906.673538:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764352 00000100:00100000:3.0:1746142906.673540:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764352 00000100:00100000:3.0:1746142906.673547:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13939 00000100:00100000:3.0:1746142906.673551:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3763:x1830962867763968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142906.673598:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:3.0:1746142906.673600:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142906.673602:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142906.673604:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142906.673605:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:1.0:1746142906.673663:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13940 00000100:00100000:1.0:1746142906.673677:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867763328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142906.673745:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142906.673748:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142906.673749:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142906.673751:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142906.673752:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142906.677485:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3763:x1830962867763328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3802us (4605us total) trans 17179873879 rc 0/0 00000100:00100000:1.0:1746142906.677496:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13940 00000100:00100000:1.0:1746142906.677519:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13941 00000100:00100000:1.0:1746142906.677527:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867763840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142906.677625:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746142906.677627:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142906.677629:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142906.677631:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142906.677632:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:1.0:1746142906.677653:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3763:x1830962867763840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (4759us total) trans 17179873880 rc 0/0 00000100:00100000:1.0:1746142906.677657:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13941 00000100:00100000:1.0:1746142906.677665:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13942 00000100:00100000:1.0:1746142906.677670:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867764352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142906.677715:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3763:x1830962867764352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (4764us total) trans 17179873881 rc 0/0 00000100:00100000:1.0:1746142906.677719:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13942 00000100:00100000:1.0:1746142906.677726:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13943 00000100:00100000:1.0:1746142906.677730:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867763456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142906.677757:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142906.677759:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142906.677761:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142906.677762:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142906.677764:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746142906.677776:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3763:x1830962867763456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (4957us total) trans 17179873882 rc 0/0 00000100:00100000:1.0:1746142906.677780:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13943 00010000:00010000:1.0:1746142906.677842:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.677851:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.677854:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746142906.677864:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067ccc332 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 9 pid: 22383 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746142906.677876:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 8 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.677895:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.677896:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746142906.677910:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711ae00, rc 0) 00000100:00100000:1.0:1746142906.677934:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:32220:x1830962867237248:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 38991us (41736us total) trans 8589936507 rc 0/0 00000100:00100000:1.0:1746142906.677940:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14363 00000100:00100000:1.0:1746142906.677976:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.677988:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238784 00000100:00100000:1.0:1746142906.677993:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238784 00000100:00100000:1.0:1746142906.678010:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14364 00000100:00100000:1.0:1746142906.678014:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:32218:x1830962867238784:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142906.678022:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.678031:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccc340 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a061 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.678052:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccc340 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a061 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.678060:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccc340 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a061 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.678068:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.678069:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142906.678071:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3e600, rc 0) 00000100:00100000:1.0:1746142906.678085:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:32218:x1830962867238784:12345-192.168.204.50@tcp:101:cat.0 Request processed in 70us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.678090:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14364 00000100:00100000:3.0:1746142906.678261:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3983c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867763968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4708us (5414us total) trans 17179873878 rc 0/0 00000100:00100000:3.0:1746142906.678270:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13939 00000100:00100000:0.0:1746142906.678305:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142906.678343:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.678391:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764736 00000100:00100000:2.0:1746142906.678394:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764736 00000100:00100000:0.0:1746142906.678396:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867765248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142906.678414:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13944 00000100:00100000:2.0:1746142906.678420:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3765:x1830962867764736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142906.678421:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142906.678453:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746142906.678458:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764608:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142906.678481:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:2.0:1746142906.678484:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142906 -> 1746142906 00000100:00100000:0.0:1746142906.678484:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746142906.678485:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:2.0:1746142906.678487:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142906 -> 1746142906 00002000:00010000:2.0:1746142906.678489:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:0.0:1746142906.678494:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867765120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142906.678507:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+46:3765:x1830962867764736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (164us total) trans 21474841141 rc 0/0 00000100:00100000:2.0:1746142906.678511:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13944 00000100:00100000:2.0:1746142906.678518:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867765248 00000100:00100000:0.0:1746142906.678519:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.678520:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867765248 00000100:00100000:1.0:1746142906.679458:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867764864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142906.679552:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867238144:12345-192.168.204.50@tcp:3:cat.0 Request processed in 33754us (37582us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142906.679559:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4197 00002000:00100000:1.0:1746142906.679566:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088fdaa00 x1830962867238144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.679574:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdaa00 with x1830962867238144 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.679578:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdaa00 00000100:00100000:2.0:1746142906.679846:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764608 00000100:00100000:2.0:1746142906.679850:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764608 00000100:00100000:2.0:1746142906.679862:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867765120 00000100:00100000:2.0:1746142906.679864:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867765120 00000100:00100000:2.0:1746142906.679871:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13945 00000100:00100000:2.0:1746142906.679875:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3765:x1830962867765248:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142906.679941:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2300/2, rc 0, transno 21474841141 00000100:00100000:0.0:1746142906.679948:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764736:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142906.679949:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142906.679952:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142906.679954:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142906.679956:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142906.679957:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142906.679966:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13946 00000100:00100000:0.0:1746142906.679971:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3765:x1830962867764608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142906.679982:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3765:x1830962867765248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (1560us total) trans 21474841142 rc 0/0 00000100:00100000:2.0:1746142906.679987:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13945 00000100:00100000:2.0:1746142906.679996:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13947 00000100:00100000:2.0:1746142906.680000:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3765:x1830962867765120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142906.680022:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142906.680024:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142906.680026:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142906.680028:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142906.680029:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142906.680051:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3765:x1830962867764608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1566us total) trans 21474841143 rc 0/0 00000100:00100000:2.0:1746142906.680052:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3765:x1830962867765120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (1532us total) trans 21474841144 rc 0/0 00000100:00100000:0.0:1746142906.680057:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13946 00000100:00100000:2.0:1746142906.680059:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13947 00000100:00080000:0.0:1746142906.680073:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1746142906.680099:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0a80/2, rc 0, transno 17179873881 00000100:00100000:2.0:1746142906.680103:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867764352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142906.680112:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd9f80/2, rc 0, transno 17179873882 00000100:00100000:2.0:1746142906.680114:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142906.680121:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd8e00/2, rc 0, transno 17179873878 00000100:00100000:2.0:1746142906.680123:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142906.680132:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867764480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142906.680151:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.680164:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867764992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142906.680176:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142906.680187:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764480 00000100:00100000:2.0:1746142906.680189:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764480 00000100:00100000:2.0:1746142906.680200:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764992 00000100:00100000:3.0:1746142906.680361:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13948 00000100:00100000:3.0:1746142906.680367:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3763:x1830962867764480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142906.680410:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746142906.680413:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:3.0:1746142906.680415:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:3.0:1746142906.680416:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:3.0:1746142906.680418:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:3.0:1746142906.680449:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3763:x1830962867764480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (286us total) trans 21474841145 rc 0/0 00000100:00100000:3.0:1746142906.680453:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13948 00000100:00100000:1.0:1746142906.680528:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142906.680542:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867765376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142906.680558:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142906.680576:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867764864 00000100:00100000:1.0:1746142906.680579:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764864 00000100:00100000:1.0:1746142906.680591:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867765376 00000100:00100000:1.0:1746142906.680593:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867765376 00000100:00100000:1.0:1746142906.680601:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13949 00000100:00100000:1.0:1746142906.680605:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3762:x1830962867764864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142906.680668:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3762:x1830962867764864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (139us total) trans 21474841146 rc 0/0 00000100:00100000:1.0:1746142906.680673:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13949 00000100:00100000:1.0:1746142906.680682:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13950 00000100:00100000:1.0:1746142906.680686:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3762:x1830962867765376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142906.680750:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3765:x1830962867764096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8060us (8411us total) trans 17179873883 rc 0/0 00000100:00100000:0.0:1746142906.680758:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13938 00000100:00100000:2.0:1746142906.680782:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867764992 00000100:00100000:2.0:1746142906.680804:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13951 00000100:00100000:2.0:1746142906.680808:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867764992:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142906.680878:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a3800/2, rc 0, transno 21474841143 00000100:00100000:1.0:1746142906.680883:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3762:x1830962867765376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (323us total) trans 21474841147 rc 0/0 00000100:00100000:0.0:1746142906.680883:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142906.680887:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13950 00000004:00080000:0.0:1746142906.680890:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1c00/2, rc 0, transno 21474841144 00000100:00100000:0.0:1746142906.680892:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867765120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142906.680918:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2d80/2, rc 0, transno 21474841146 00000100:00100000:1.0:1746142906.680921:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867764864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142906.680925:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a0a80/2, rc 0, transno 21474841142 00000100:00100000:0.0:1746142906.680928:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867765248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142906.680940:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fdad80/2, rc 0, transno 17179873883 00000100:00100000:0.0:1746142906.680942:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142906.680971:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3765:x1830962867764224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 8392us (8688us total) trans 17179873877 rc 0/0 00000100:00100000:0.0:1746142906.680976:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13936 00000004:00080000:0.0:1746142906.681076:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd9180/2, rc 0, transno 17179873877 00000100:00100000:0.0:1746142906.681080:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867764224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142906.681125:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867764992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 316us (948us total) trans 21474841148 rc 0/0 00000100:00100000:2.0:1746142906.681130:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13951 00000004:00080000:1.0:1746142906.681235:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a3480/2, rc 0, transno 21474841147 00000100:00100000:1.0:1746142906.681238:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867765376:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142906.681272:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2680/2, rc 0, transno 21474841148 00000100:00100000:2.0:1746142906.681275:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867764992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142906.681283:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fdb480/2, rc 0, transno 17179873879 00000100:00100000:2.0:1746142906.681285:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142906.681291:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fda300/2, rc 0, transno 17179873880 00000100:00100000:2.0:1746142906.681294:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867763840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142906.681302:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a3b80/2, rc 0, transno 21474841145 00000100:00100000:2.0:1746142906.681305:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867764480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142906.684124:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.684618:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867237760:12345-192.168.204.50@tcp:3:cat.0 Request processed in 38290us (42658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.684628:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4198 00002000:00100000:3.0:1746142906.684638:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880096140700 x1830962867237760/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.684645:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140700 with x1830962867237760 ext(1048576->2097151) 00002000:00010000:3.0:1746142906.684650:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096140700 00000100:00100000:2.0:1746142906.685933:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867238912 00000100:00100000:2.0:1746142906.685940:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867238912 00000100:00100000:2.0:1746142906.687000:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14365 00000100:00100000:2.0:1746142906.687010:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32221:x1830962867238912:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.687026:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142906.687043:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a068 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.687086:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 27 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.687098:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 27 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.687114:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.687117:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142906.687120:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3c00, rc 0) 00000100:00100000:2.0:1746142906.687387:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32221:x1830962867238912:12345-192.168.204.50@tcp:101:cat.0 Request processed in 378us (3268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.687393:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14365 00000100:00100000:1.0:1746142906.694004:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867238272:12345-192.168.204.50@tcp:3:cat.0 Request processed in 47594us (52001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142906.694013:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4199 00002000:00100000:1.0:1746142906.694023:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088fd9c00 x1830962867238272/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.694033:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9c00 with x1830962867238272 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.694038:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fd9c00 00000100:00100000:0.0:1746142906.701350:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.701407:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.701513:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867239168 00000100:00100000:1.0:1746142906.701521:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867239168 00000100:00100000:1.0:1746142906.701571:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13952 00000100:00100000:1.0:1746142906.701578:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:32220:x1830962867239168:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142906.701594:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.701608:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a06f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.701631:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.701638:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.701643:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.701652:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142906.701654:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142906.701657:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2351104->2396159] (req 2351104->2396159) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.701687:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.701698:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 17 pid: 1854 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.701708:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867765504:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.701787:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.701796:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 33 pid: 1852 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.701803:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867765632:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.701829:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142906.701878:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867239040 00000100:00100000:2.0:1746142906.701882:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867239040 00000100:00100000:2.0:1746142906.701938:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 756 00000100:00100000:2.0:1746142906.701944:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867239040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.701953:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142906.701970:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccc340 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a061 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.701987:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.701990:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142906.702010:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867239040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.702015:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 756 00010000:00010000:1.0:1746142906.702102:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 16 pid: 11943 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.702114:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867765760:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142906.702148:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142906.713688:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.713728:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.713844:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.714070:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867239424 00000100:00100000:0.0:1746142906.714074:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.714078:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867239424 00000100:00100000:2.0:1746142906.714109:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867240064 00000100:00100000:2.0:1746142906.714113:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867240064 00000100:00100000:0.0:1746142906.714135:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867765504:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142906.714148:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14366 00000100:00100000:2.0:1746142906.714155:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+6:32224:x1830962867240064:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142906.714173:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142906.714173:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867765632:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142906.714189:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a076 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142906.714193:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.714214:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867240192 00000100:00100000:0.0:1746142906.714217:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867240192 00010000:00010000:0.0:1746142906.714237:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 19 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.714238:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714249:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714255:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6229 00010000:00010000:2.0:1746142906.714258:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714260:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867240192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.714267:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714272:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.714272:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142906.714276:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.714285:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 19 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746142906.714293:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 19 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746142906.714314:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccc2ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a00d expref: 19 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.714328:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.714333:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142906.714334:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714338:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714367:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867240192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 106us (173us total) trans 0 rc 0/0 00000004:00200000:2.0:1746142906.714370:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000100:00100000:0.0:1746142906.714372:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6229 00000004:00200000:2.0:1746142906.714373:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142906.714385:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714392:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714398:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714402:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714407:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714411:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714416:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142906.714419:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714424:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142906.714431:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142906.714434:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142906.714446:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714451:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc35c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714454:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867240320 00000100:00100000:0.0:1746142906.714457:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867240320 00010000:00010000:2.0:1746142906.714462:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714466:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.714467:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 34 pid: 1852 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.714471:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714474:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142906.714477:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714480:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6230 00010000:00010000:2.0:1746142906.714481:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142906.714484:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867240320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.714487:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b52bf000) 00010000:00010000:2.0:1746142906.714490:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142906.714492:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142906.714496:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc363 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142906.714496:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142906.714502:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 34 pid: 1852 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.714515:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.714524:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 34 pid: 1852 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.714525:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.714530:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142906.714532:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142906.714534:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75000, rc 0) 00010000:00010000:0.0:1746142906.714539:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0000/0x2fa243e067ccc324 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a04c expref: 34 pid: 1852 timeout: 780 lvb_type: 1 00010000:00010000:0.0:1746142906.714551:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142906.714555:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32224:x1830962867240064:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 402us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.714561:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14366 00000100:00100000:0.0:1746142906.714561:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867240320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.714566:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6230 00000100:00100000:0.0:1746142906.714683:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867239680 00000100:00100000:0.0:1746142906.714687:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867239680 00002000:00100000:0.0:1746142906.714722:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130377480 x1830962867239680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142906.714756:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377480 with x1830962867239680 ext(1048576->2097151) 00002000:00010000:0.0:1746142906.714759:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130377480 00000100:00100000:0.0:1746142906.714776:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867239936 00000100:00100000:0.0:1746142906.714779:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867239936 00002000:00100000:0.0:1746142906.714800:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088d62a00 x1830962867239936/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.714802:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130376680 x1830962867239424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142906.714806:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62a00 with x1830962867239936 ext(1048576->2097151) 00002000:00100000:1.0:1746142906.714809:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376680 with x1830962867239424 ext(1048576->2097151) 00002000:00010000:0.0:1746142906.714809:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d62a00 00002000:00010000:1.0:1746142906.714811:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130376680 00000100:00100000:0.0:1746142906.714825:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4200 00000100:00100000:0.0:1746142906.714830:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867239680:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142906.714836:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4201 00000100:00100000:1.0:1746142906.714841:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867239936:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142906.714843:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4202 00000100:00100000:3.0:1746142906.714852:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867239424:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142906.715765:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.715852:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867240448 00000100:00100000:3.0:1746142906.715857:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867240448 00010000:00010000:3.0:1746142906.715877:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 17 pid: 11943 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746142906.716262:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6231 00000100:00100000:2.0:1746142906.716270:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867240448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.716277:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142906.716295:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 17 pid: 11943 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.716305:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 17 pid: 11943 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.716326:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.716328:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.716334:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.716347:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.716378:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.716389:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867765888:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142906.716453:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b780 going to sleep for 11 seconds 00010000:00010000:0.0:1746142906.717332:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccc20c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fce expref: 17 pid: 11943 timeout: 780 lvb_type: 1 00000100:00100000:0.0:1746142906.717355:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867765760:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142906.717395:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.717405:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3e800, rc 0) 00000100:00100000:0.0:1746142906.717428:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:32220:x1830962867239168:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 15850us (16087us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.717435:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13952 00000100:00100000:0.0:1746142906.717502:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.717534:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867240832 00000100:00100000:0.0:1746142906.717535:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.717539:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867240832 00000100:00100000:0.0:1746142906.717554:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:1.0:1746142906.717561:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8801355d1880 x1830962867240832/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.717568:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d1880 with x1830962867240832 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.717572:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d1880 00000100:00100000:2.0:1746142906.718365:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867240960 00000100:00100000:1.0:1746142906.718366:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867241088 00000100:00100000:2.0:1746142906.718369:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867240960 00000100:00100000:1.0:1746142906.718370:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867241088 00002000:00100000:1.0:1746142906.718387:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8801355d0000 x1830962867241088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.718395:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0000 with x1830962867241088 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.718398:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d0000 00002000:00100000:2.0:1746142906.718400:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8801355d2300 x1830962867240960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.718406:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d2300 with x1830962867240960 ext(1048576->2097151) 00002000:00010000:2.0:1746142906.718413:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d2300 00000100:00100000:1.0:1746142906.718416:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4203 00000100:00100000:1.0:1746142906.718423:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867240832:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142906.718429:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4204 00000100:00100000:2.0:1746142906.718453:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867241088:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.719042:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.719062:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867241344 00000100:00100000:1.0:1746142906.719065:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867241344 00000100:00100000:1.0:1746142906.719088:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13953 00000100:00100000:1.0:1746142906.719093:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867241344:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142906.719101:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.719112:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3000/0x2fa243e067ccc371 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a07d expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142906.719146:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766016:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142906.719184:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515540 going to sleep for 11 seconds 00000100:00100000:1.0:1746142906.719206:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4205 00000100:00100000:1.0:1746142906.719211:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867240960:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142906.721030:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867765888:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142906.721046:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.721085:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867240448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4815us (5321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.721093:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6231 00000100:00100000:0.0:1746142906.724528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.724758:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867239424:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 9906us (11076us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.724767:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4202 00002000:00100000:3.0:1746142906.724778:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130376680 x1830962867239424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.724786:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376680 with x1830962867239424 ext(1048576->2097151) 00002000:00010000:3.0:1746142906.724791:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130376680 00000100:00100000:3.0:1746142906.724810:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867241600 00000100:00100000:3.0:1746142906.724815:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867241600 00002000:00100000:3.0:1746142906.724837:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2351104->2355199) req@ffff880092433100 x1830962867241600/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.724844:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092433100 with x1830962867241600 ext(2351104->2355199) 00002000:00010000:3.0:1746142906.724847:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092433100 00000100:00100000:3.0:1746142906.724862:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4206 00000100:00100000:3.0:1746142906.724868:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867241600:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142906.724972:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867241600:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 104us (451us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142906.724980:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4206 00002000:00100000:3.0:1746142906.724984:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2351104->2355199) req@ffff880092433100 x1830962867241600/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.724991:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092433100 with x1830962867241600 ext(2351104->2355199) 00002000:00010000:3.0:1746142906.724993:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092433100 00002000:00010000:1.0:1746142906.725100:0:1852:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142906 -> 1746142907 00002000:00010000:1.0:1746142906.725104:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142905 -> 1746142907 00002000:00010000:1.0:1746142906.725106:0:1852:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142905 -> 1746142907 00000100:00100000:1.0:1746142906.725116:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766016:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142906.725140:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3000/0x2fa243e067ccc371 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a07d expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.725151:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3000/0x2fa243e067ccc371 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a07d expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.725164:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3000, rc 0) 00000100:00100000:1.0:1746142906.725183:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867241344:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6089us (6142us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142906.725188:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13953 00000100:00100000:1.0:1746142906.731361:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867239936:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 16507us (17505us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142906.731371:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4201 00002000:00100000:1.0:1746142906.731382:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088d62a00 x1830962867239936/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.731390:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62a00 with x1830962867239936 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.731395:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d62a00 00000100:00100000:2.0:1746142906.733078:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:2003:x1830962867239680:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 18241us (19343us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.733088:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4200 00002000:00100000:2.0:1746142906.733096:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130377480 x1830962867239680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.733104:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377480 with x1830962867239680 ext(1048576->2097151) 00002000:00010000:2.0:1746142906.733108:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130377480 00000100:00100000:3.0:1746142906.741351:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.741387:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867241856 00000100:00100000:3.0:1746142906.741394:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867241856 00000100:00100000:3.0:1746142906.741433:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14367 00000100:00100000:3.0:1746142906.741450:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+7:32224:x1830962867241856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142906.741467:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142906.741483:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a084 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.741569:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.741581:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.741587:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.741610:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.741621:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 8 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.741635:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867766144:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142906.742159:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867240832:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23734us (24655us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142906.742167:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4203 00002000:00100000:0.0:1746142906.742175:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8801355d1880 x1830962867240832/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142906.742184:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d1880 with x1830962867240832 ext(1048576->2097151) 00002000:00010000:0.0:1746142906.742188:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d1880 00000100:00100000:3.0:1746142906.742247:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142906.747456:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867241088:12345-192.168.204.50@tcp:3:cat.0 Request processed in 29000us (29879us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.747669:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4204 00002000:00100000:2.0:1746142906.747683:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8801355d0000 x1830962867241088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.748144:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0000 with x1830962867241088 ext(1048576->2097151) 00002000:00010000:2.0:1746142906.748150:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d0000 00000100:00100000:3.0:1746142906.751183:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867766144:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.751207:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:0.0:1746142906.752148:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.752274:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867240960:12345-192.168.204.50@tcp:3:cat.0 Request processed in 33062us (34737us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142906.752283:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4205 00002000:00100000:1.0:1746142906.752292:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8801355d2300 x1830962867240960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.752300:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d2300 with x1830962867240960 ext(1048576->2097151) 00002000:00010000:1.0:1746142906.752304:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d2300 00000100:00100000:3.0:1746142906.753271:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867241984 00000100:00100000:3.0:1746142906.753279:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867241984 00010000:00010000:3.0:1746142906.753305:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.753343:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6232 00000100:00100000:3.0:1746142906.753350:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867241984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.753360:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.753365:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.753374:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.753391:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75000/0x2fa243e067ccc36a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a076 expref: 9 pid: 10924 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.753419:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.753423:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.753433:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.753448:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.753464:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.753489:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867241984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 140us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.753494:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6232 00010000:00010000:3.0:1746142906.753511:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.753517:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142906.753531:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142906.753630:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.753642:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 8 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.753647:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.753649:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142906.753651:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714e00, rc 0) 00000100:00100000:3.0:1746142906.753671:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:32224:x1830962867241856:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 12223us (12328us total) trans 8589936508 rc 0/0 00000100:00100000:3.0:1746142906.753677:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14367 00000100:00100000:0.0:1746142906.754808:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.759159:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867242240 00000100:00100000:1.0:1746142906.759169:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867242240 00002000:00100000:1.0:1746142906.759210:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2392064->2396159) req@ffff880096096a00 x1830962867242240/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.759218:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096096a00 with x1830962867242240 ext(2392064->2396159) 00002000:00010000:1.0:1746142906.759223:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096096a00 00000100:00100000:1.0:1746142906.759251:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4207 00000100:00100000:1.0:1746142906.759257:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867242240:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.759371:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867242240:12345-192.168.204.50@tcp:3:cat.0 Request processed in 114us (4567us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142906.759377:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4207 00002000:00100000:1.0:1746142906.759381:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2392064->2396159) req@ffff880096096a00 x1830962867242240/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.759388:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096096a00 with x1830962867242240 ext(2392064->2396159) 00002000:00010000:1.0:1746142906.759390:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096096a00 00000100:00100000:0.0:1746142906.762097:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.762588:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.762615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.762631:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867242496 00000100:00100000:3.0:1746142906.762639:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867242496 00000100:00100000:3.0:1746142906.762678:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14368 00000100:00100000:0.0:1746142906.762679:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.762685:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:32224:x1830962867242496:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1746142906.762707:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867242368 00000100:00100000:1.0:1746142906.762711:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867242368 00000100:00100000:1.0:1746142906.762731:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13954 00000100:00100000:1.0:1746142906.762736:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867242368:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142906.762748:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.762762:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067ccc38d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a08b expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142906.762800:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766272:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142906.762817:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142906.762828:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc394 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a092 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142906.762851:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142906.763091:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867242752 00000100:00100000:1.0:1746142906.763094:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867242752 00000100:00100000:2.0:1746142906.763100:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243008 00000100:00100000:2.0:1746142906.763105:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243008 00002000:00100000:1.0:1746142906.763113:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800946c5180 x1830962867242752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.763121:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2351103) req@ffff8800946c7b80 x1830962867243008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.763126:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c5180 with x1830962867242752 ext(2097152->3145727) 00002000:00100000:2.0:1746142906.763127:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c7b80 with x1830962867243008 ext(2097152->2351103) 00002000:00010000:2.0:1746142906.763130:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800946c7b80 00002000:00010000:1.0:1746142906.763130:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c5180 00000100:00100000:1.0:1746142906.763142:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4208 00000100:00100000:1.0:1746142906.763146:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867242752:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142906.763164:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.763178:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.763183:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.763202:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.763212:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 9 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746142906.763319:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4209 00000100:00100000:2.0:1746142906.763325:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867243008:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142906.764363:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867766400:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142906.764403:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142906.766288:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.766380:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243264 00000100:00100000:2.0:1746142906.766387:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243264 00000100:00100000:2.0:1746142906.766426:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5216 00000100:00100000:2.0:1746142906.766433:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:32220:x1830962867243264:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142906.767784:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32220:x1830962867243264:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 1347us (1496us total) trans 8589936509 rc 0/0 00000100:00100000:2.0:1746142906.767792:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5216 00000100:00100000:1.0:1746142906.769211:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766272:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142906.769235:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067ccc38d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a08b expref: 34 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.769246:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d3400/0x2fa243e067ccc38d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a08b expref: 34 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.769268:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3400, rc 0) 00000100:00100000:1.0:1746142906.769297:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867242368:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6560us (7207us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142906.769304:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13954 00000100:00100000:0.0:1746142906.775269:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.775379:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243392 00000100:00100000:1.0:1746142906.775386:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243392 00000100:00100000:1.0:1746142906.775416:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13955 00000100:00100000:1.0:1746142906.775423:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32217:x1830962867243392:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142906.775446:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.775460:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a099 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.775485:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.775492:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142906.775493:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142906.775496:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.775524:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.775533:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 17 pid: 9580 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.775543:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766528:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142906.775605:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142906.775850:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867242752:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12701us (13231us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.775858:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4208 00002000:00100000:2.0:1746142906.775865:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800946c5180 x1830962867242752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.775873:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c5180 with x1830962867242752 ext(2097152->3145727) 00002000:00010000:2.0:1746142906.775877:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c5180 00000100:00100000:3.0:1746142906.777247:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867766400:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.777265:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:0.0:1746142906.777614:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.777694:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243520 00000100:00100000:1.0:1746142906.777699:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243520 00010000:00010000:1.0:1746142906.777719:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 10 pid: 22383 timeout: 780 lvb_type: 0 00000100:00100000:1.0:1746142906.777744:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6233 00000100:00100000:1.0:1746142906.777750:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867243520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142906.777759:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142906.777764:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 10 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.777773:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 10 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.777792:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714e00/0x2fa243e067ccc37f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a084 expref: 10 pid: 22383 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.777806:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142906.777810:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.777817:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.777822:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:1.0:1746142906.777834:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142906.777857:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867243520:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.777862:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6233 00000100:00100000:1.0:1746142906.777887:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766528:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.777919:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.777931:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378c00, rc 0) 00000100:00100000:1.0:1746142906.777948:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32217:x1830962867243392:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2525us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.777954:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13955 00000100:00100000:2.0:1746142906.778132:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867243008:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14807us (15452us total) trans 0 rc 253952/253952 00000100:00100000:2.0:1746142906.778140:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4209 00002000:00100000:2.0:1746142906.778146:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2351103) req@ffff8800946c7b80 x1830962867243008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.778154:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c7b80 with x1830962867243008 ext(2097152->2351103) 00010000:00010000:2.0:1746142906.778159:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 16 pid: 9580 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.778169:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 16 pid: 9580 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.778175:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800946c7b80 00010000:00010000:3.0:1746142906.778233:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.778240:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142906.778282:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:3.0:1746142906.778286:0:22383:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142906.778298:0:22383:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.778323:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc394 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.778345:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 8 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.778350:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142906.778352:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142906.778354:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714400, rc 0) 00000100:00100000:3.0:1746142906.778388:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:32224:x1830962867242496:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 15703us (15799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.778394:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14368 00000100:00100000:0.0:1746142906.779789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.780010:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243648 00000100:00100000:2.0:1746142906.780016:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243648 00002000:00100000:2.0:1746142906.780041:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2351104->2396159) req@ffff8800938d0700 x1830962867243648/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.780048:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d0700 with x1830962867243648 ext(2351104->2396159) 00010000:00010000:2.0:1746142906.780055:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 16 pid: 9580 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.780064:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 16 pid: 9580 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.780069:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d0700 00000100:00100000:2.0:1746142906.780090:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1306 00000100:00100000:2.0:1746142906.780096:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867243648:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142906.782448:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.783222:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243776 00000100:00100000:1.0:1746142906.783228:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243776 00000100:00100000:2.0:1746142906.783246:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867243648:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3149us (3458us total) trans 17179873884 rc 0/0 00000100:00100000:1.0:1746142906.783255:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13956 00000100:00100000:2.0:1746142906.783257:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1306 00002000:00100000:2.0:1746142906.783265:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2351104->2396159) req@ffff8800938d0700 x1830962867243648/t17179873884(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/448 e 0 to 0 dl 1746142917 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746142906.783266:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867243776:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142906.783276:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746142906.783278:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d0700 with x1830962867243648 ext(2351104->2396159) 00010000:00010000:2.0:1746142906.783285:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 18 pid: 9580 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.783288:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc3a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0a0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.783296:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 18 pid: 9580 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.783302:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d0700 00000100:00100000:1.0:1746142906.783325:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766656:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142906.783380:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142906.784277:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.784315:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.784321:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867243904 00000100:00100000:1.0:1746142906.784325:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867243904 00000100:00100000:1.0:1746142906.784347:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13957 00000100:00100000:1.0:1746142906.784352:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32218:x1830962867243904:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142906.784359:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.784366:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0a7 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.784380:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142906.784384:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.784389:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746142906.784390:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867244160 00010000:00010000:1.0:1746142906.784391:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.784394:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867244160 00010000:00010000:1.0:1746142906.784411:0:9580:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746142906.784414:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800938d3480 x1830962867244160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.784421:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3480 with x1830962867244160 ext(2097152->3145727) 00010000:00010000:1.0:1746142906.784422:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142906.784425:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d3480 00010000:00010000:1.0:1746142906.784429:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093379000, rc 0) 00000100:00100000:2.0:1746142906.784447:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4210 00000100:00100000:2.0:1746142906.784452:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867244160:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.784465:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32218:x1830962867243904:12345-192.168.204.50@tcp:101:cat.0 Request processed in 113us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.784471:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13957 00000100:00100000:1.0:1746142906.785893:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867766656:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142906.785920:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc3a9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a0 expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.785926:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc3a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a0 expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.786874:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378800, rc 0) 00000100:00100000:1.0:1746142906.786924:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867243776:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3662us (4490us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142906.786931:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13956 00000100:00100000:2.0:1746142906.787419:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.787476:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867244288 00000100:00100000:3.0:1746142906.787482:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867244288 00010000:00010000:3.0:1746142906.787504:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 19 pid: 9580 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.787534:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6234 00000100:00100000:3.0:1746142906.787541:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867244288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.787551:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.787563:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 19 pid: 9580 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.787573:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 19 pid: 9580 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.787589:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccc34e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2351104->2396159) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a06f expref: 19 pid: 9580 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.787615:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.787618:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.787624:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.787631:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.787656:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.787666:0:7218:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 33 pid: 1852 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.787676:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867766912:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142906.787723:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142906.791397:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.791503:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867766912:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142906.791517:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142906.791544:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.791558:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867244288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4017us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.791566:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6234 00000100:00100000:3.0:1746142906.791595:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867244544 00000100:00100000:3.0:1746142906.791600:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867244544 00000100:00100000:3.0:1746142906.791624:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14369 00000100:00100000:3.0:1746142906.791629:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:32224:x1830962867244544:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1746142906.791653:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867244800 00000100:00100000:1.0:1746142906.791657:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867244800 00010000:00010000:3.0:1746142906.791673:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746142906.791685:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2408448->2412543) req@ffff880093bcea00 x1830962867244800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746142906.791687:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc3b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0ae expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746142906.791694:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcea00 with x1830962867244800 ext(2408448->2412543) 00010000:00010000:1.0:1746142906.791700:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.791712:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:1.0:1746142906.791718:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bcea00 00000100:00100000:1.0:1746142906.791741:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1307 00000100:00100000:1.0:1746142906.791747:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867244800:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142906.791763:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.791773:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.791782:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.791790:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.791795:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142906.791801:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00000100:00100000:2.0:1746142906.791805:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867244160:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7353us (7489us total) trans 0 rc 1048576/1048576 00010000:00010000:3.0:1746142906.791806:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094715200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142906.791809:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00000100:00100000:2.0:1746142906.791811:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4210 00002000:00100000:2.0:1746142906.791816:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800938d3480 x1830962867244160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746142906.791817:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00002000:00100000:2.0:1746142906.791823:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3480 with x1830962867244160 ext(2097152->3145727) 00000100:00100000:1.0:1746142906.791824:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867244800:12345-192.168.204.50@tcp:3:cat.0 Request processed in 77us (429us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746142906.791826:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00002000:00010000:2.0:1746142906.791826:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d3480 00010000:00010000:3.0:1746142906.791828:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1746142906.791829:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1307 00010000:00010000:3.0:1746142906.791831:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00002000:00100000:1.0:1746142906.791834:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2408448->2412543) req@ffff880093bcea00 x1830962867244800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746142917 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746142906.791835:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3be lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00002000:00100000:1.0:1746142906.791841:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcea00 with x1830962867244800 ext(2408448->2412543) 00010000:00010000:1.0:1746142906.791845:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.791853:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.791855:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc3b7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ae expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142906.791859:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bcea00 00010000:00010000:3.0:1746142906.791862:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc3b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ae expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.791868:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714200, rc 0) 00000100:00100000:3.0:1746142906.791886:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:32224:x1830962867244544:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 256us (640us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142906.791891:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14369 00000100:00100000:0.0:1746142906.793301:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.793387:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867245056 00000100:00100000:2.0:1746142906.793391:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867245056 00000100:00100000:2.0:1746142906.793429:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5217 00000100:00100000:2.0:1746142906.793448:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32224:x1830962867245056:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142906.793637:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:32224:x1830962867245056:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 203us (339us total) trans 8589936510 rc 0/0 00000100:00100000:2.0:1746142906.793643:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5217 00000100:00100000:0.0:1746142906.794095:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.794150:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867245312 00000100:00100000:2.0:1746142906.794154:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867245312 00002000:00100000:2.0:1746142906.794172:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2408447) req@ffff8800938d3100 x1830962867245312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.794180:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3100 with x1830962867245312 ext(2097152->2408447) 00010000:00010000:2.0:1746142906.794185:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.794194:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 34 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.794205:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d3100 00000100:00100000:2.0:1746142906.794224:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1308 00000100:00100000:2.0:1746142906.794229:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867245312:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142906.800219:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.800348:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867245568 00000100:00100000:1.0:1746142906.800355:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867245568 00002000:00100000:1.0:1746142906.800388:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2408448->3145727) req@ffff8800938d0380 x1830962867245568/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.800397:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d0380 with x1830962867245568 ext(2408448->3145727) 00010000:00010000:1.0:1746142906.800405:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 36 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:1.0:1746142906.800415:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 36 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:1.0:1746142906.800421:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d0380 00000100:00100000:1.0:1746142906.800459:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1309 00000100:00100000:1.0:1746142906.800466:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867245568:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142906.800771:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.800969:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867245312:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6738us (6873us total) trans 0 rc 311296/311296 00000100:00100000:2.0:1746142906.800976:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1308 00002000:00100000:2.0:1746142906.800981:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2408447) req@ffff8800938d3100 x1830962867245312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:H/200/0 rc 311296/311296 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.800988:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3100 with x1830962867245312 ext(2097152->2408447) 00010000:00010000:2.0:1746142906.800993:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 36 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.801002:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 36 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.801007:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d3100 00000100:00100000:2.0:1746142906.801019:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867245824 00000100:00100000:2.0:1746142906.801021:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867245824 00002000:00100000:2.0:1746142906.801159:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800938d1880 x1830962867245824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.801167:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d1880 with x1830962867245824 ext(3145728->4194303) 00002000:00010000:2.0:1746142906.801170:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d1880 00000100:00100000:2.0:1746142906.801387:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4211 00000100:00100000:2.0:1746142906.801394:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867245824:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142906.802461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.802487:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867246080 00000100:00100000:0.0:1746142906.802489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.802491:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867246080 00000100:00100000:0.0:1746142906.802501:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867245952 00000100:00100000:0.0:1746142906.802503:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867245952 00000100:00100000:1.0:1746142906.802513:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13958 00000100:00100000:1.0:1746142906.802518:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32217:x1830962867246080:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142906.802527:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142906.802539:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0b5 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.802561:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.802568:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 42 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.802573:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 25 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.802578:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142906.802579:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142906.802582:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142906.802603:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 25 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.802615:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 25 pid: 1854 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.802624:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767040:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.802671:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 42 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.802677:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 42 pid: 1397 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.802684:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767168:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142906.802701:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142906.802707:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 13 pid: 11943 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.802713:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767296:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142906.802723:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142906.803139:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13959 00000100:00100000:0.0:1746142906.803146:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32221:x1830962867245952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142906.803154:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142906.803162:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0bc expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.803173:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142906.803177:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.803185:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 37 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142906.803193:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8fe00, rc 0) 00000100:00100000:0.0:1746142906.803216:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32221:x1830962867245952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 71us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142906.803221:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13959 00000100:00100000:2.0:1746142906.807673:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767040:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142906.808008:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.808030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.808089:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867246208 00000100:00100000:1.0:1746142906.808095:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867246208 00010000:00010000:1.0:1746142906.808122:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 26 pid: 1854 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.808148:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867246336 00000100:00100000:1.0:1746142906.808150:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867246336 00010000:00010000:1.0:1746142906.808159:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 14 pid: 11943 timeout: 780 lvb_type: 1 00000100:00100000:1.0:1746142906.808173:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6235 00000100:00100000:1.0:1746142906.808179:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867246208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142906.808188:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142906.808201:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 26 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746142906.808208:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 26 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746142906.808226:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccc2de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a006 expref: 26 pid: 1854 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746142906.808240:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142906.808269:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867246208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.808275:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6235 00000100:00100000:1.0:1746142906.808308:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6236 00000100:00100000:1.0:1746142906.808313:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867246336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142906.808318:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142906.808324:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 14 pid: 11943 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746142906.808331:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 14 pid: 11943 timeout: 780 lvb_type: 1 00010000:00010000:1.0:1746142906.808341:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142906.808353:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867246336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142906.808358:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6236 00000100:00100000:3.0:1746142906.808453:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767168:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.808462:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067ccc213 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc7 expref: 13 pid: 11943 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746142906.808485:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767296:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.808508:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->3420159] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.808521:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a0a00, rc 0) 00000100:00100000:3.0:1746142906.808544:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32217:x1830962867246080:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6025us (6085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.808550:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13958 00000100:00100000:2.0:1746142906.809759:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867245824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8363us (8985us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.809769:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4211 00002000:00100000:2.0:1746142906.809776:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800938d1880 x1830962867245824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.809785:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d1880 with x1830962867245824 ext(3145728->4194303) 00010000:00010000:2.0:1746142906.809790:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 40 pid: 1397 timeout: 780 lvb_type: 1 00010000:00010000:2.0:1746142906.809799:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 40 pid: 1397 timeout: 780 lvb_type: 1 00002000:00010000:2.0:1746142906.809808:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938d1880 00000100:00100000:2.0:1746142906.810178:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867245568:12345-192.168.204.50@tcp:4:cat.0 Request processed in 9712us (9966us total) trans 17179873885 rc 0/0 00000100:00100000:2.0:1746142906.810184:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1309 00002000:00100000:2.0:1746142906.810190:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2408448->3145727) req@ffff8800938d0380 x1830962867245568/t17179873885(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/448 e 0 to 0 dl 1746142917 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.810197:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d0380 with x1830962867245568 ext(2408448->3145727) 00010000:00010000:2.0:1746142906.810203:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 37 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.810211:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 37 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.810216:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d0380 00000100:00100000:0.0:1746142906.812699:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.812739:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.812796:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867246592 00000100:00100000:2.0:1746142906.812803:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867246592 00000100:00100000:3.0:1746142906.812812:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867246464 00000100:00100000:3.0:1746142906.812817:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867246464 00010000:00010000:3.0:1746142906.812837:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 40 pid: 1397 timeout: 780 lvb_type: 1 00000100:00100000:3.0:1746142906.812869:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6237 00000100:00100000:3.0:1746142906.812876:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867246464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142906.812885:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142906.812913:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 37 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.812916:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 40 pid: 1397 timeout: 780 lvb_type: 1 00010000:00010000:3.0:1746142906.812925:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 40 pid: 1397 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746142906.812940:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6238 00010000:00010000:3.0:1746142906.812944:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092732600/0x2fa243e067ccc31d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a045 expref: 40 pid: 1397 timeout: 780 lvb_type: 1 00000100:00100000:2.0:1746142906.812946:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867246592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.812953:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142906.812960:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142906.812961:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.812963:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 37 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.812968:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 39 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.812972:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 37 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.812979:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 39 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.812984:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc3a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2408448->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a099 expref: 37 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.812995:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.812997:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.813001:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.813004:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 39 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.813008:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142906.813013:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867767424:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142906.813014:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142906.813073:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00010000:00010000:2.0:1746142906.813338:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.813344:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.813355:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.813372:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.813380:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867767552:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142906.813418:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.813426:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867767680:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142906.813449:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:3.0:1746142906.814744:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867767424:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142906.814748:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867767552:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142906.814755:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142906.814755:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867767680:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142906.814768:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142906.814786:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867246464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1910us (2046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142906.814793:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6237 00000100:00100000:2.0:1746142906.814794:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867246592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1848us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.814800:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6238 00000100:00100000:0.0:1746142906.815797:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.816570:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867246848 00000100:00100000:2.0:1746142906.816577:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867246848 00002000:00100000:2.0:1746142906.816605:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3420159) req@ffff880092405c00 x1830962867246848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.816614:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405c00 with x1830962867246848 ext(3416064->3420159) 00002000:00010000:2.0:1746142906.816619:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405c00 00000100:00100000:2.0:1746142906.816644:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4212 00000100:00100000:2.0:1746142906.816650:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867246848:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142906.816750:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867246848:12345-192.168.204.50@tcp:3:cat.0 Request processed in 100us (955us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142906.816755:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4212 00002000:00100000:2.0:1746142906.816760:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3420159) req@ffff880092405c00 x1830962867246848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/4536 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.816767:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405c00 with x1830962867246848 ext(3416064->3420159) 00002000:00010000:2.0:1746142906.816769:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405c00 00000100:00100000:0.0:1746142906.818064:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.818863:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867247104 00000100:00100000:2.0:1746142906.818871:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867247104 00002000:00100000:2.0:1746142906.818894:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880092405880 x1830962867247104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.818922:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405880 with x1830962867247104 ext(2097152->3145727) 00002000:00010000:2.0:1746142906.818926:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092405880 00000100:00100000:2.0:1746142906.818939:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4213 00000100:00100000:2.0:1746142906.818945:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867247104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142906.820706:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.820743:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.820746:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867247360 00000100:00100000:0.0:1746142906.820753:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867247360 00002000:00100000:0.0:1746142906.820779:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880088d7d180 x1830962867247360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142906.820787:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7d180 with x1830962867247360 ext(2097152->3145727) 00002000:00010000:0.0:1746142906.820790:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7d180 00000100:00100000:2.0:1746142906.820815:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867247616 00000100:00100000:2.0:1746142906.820819:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867247616 00000100:00100000:2.0:1746142906.820843:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5218 00000100:00100000:2.0:1746142906.820848:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32217:x1830962867247616:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142906.820985:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4214 00000100:00100000:0.0:1746142906.820992:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867247360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142906.821009:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32217:x1830962867247616:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 159us (265us total) trans 8589936511 rc 0/0 00000100:00100000:2.0:1746142906.821019:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5218 00000100:00100000:2.0:1746142906.827453:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867247104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8486us (9369us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.827463:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4213 00002000:00100000:2.0:1746142906.827474:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880092405880 x1830962867247104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.827482:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405880 with x1830962867247104 ext(2097152->3145727) 00002000:00010000:2.0:1746142906.827487:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092405880 00000100:00100000:2.0:1746142906.828109:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867247360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7116us (7407us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142906.828115:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4214 00002000:00100000:2.0:1746142906.828119:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880088d7d180 x1830962867247360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.828126:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7d180 with x1830962867247360 ext(2097152->3145727) 00002000:00010000:2.0:1746142906.828129:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7d180 00000100:00100000:0.0:1746142906.831427:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.831531:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867247872 00000100:00100000:2.0:1746142906.831540:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867247872 00002000:00100000:2.0:1746142906.831576:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3420160->4194303) req@ffff88012e679c00 x1830962867247872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.831584:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679c00 with x1830962867247872 ext(3420160->4194303) 00002000:00010000:2.0:1746142906.831589:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e679c00 00000100:00100000:0.0:1746142906.831590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.831607:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4215 00000100:00100000:2.0:1746142906.831613:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867247872:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142906.831741:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867248000 00000100:00100000:3.0:1746142906.831744:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867248000 00000100:00100000:3.0:1746142906.831766:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13960 00000100:00100000:3.0:1746142906.831771:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:32218:x1830962867248000:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142906.831780:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142906.831792:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0c3 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.831810:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.831816:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142906.831818:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142906.831821:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.831843:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142906.831852:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 40 pid: 1852 timeout: 780 lvb_type: 0 00000100:00100000:3.0:1746142906.831861:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767808:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142906.831943:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142906.833251:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.833273:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867767808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142906.833293:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.833300:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867248256 00000100:00100000:2.0:1746142906.833304:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867248256 00010000:00010000:3.0:1746142906.833305:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714e00, rc 0) 00002000:00100000:2.0:1746142906.833326:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88013644d180 x1830962867248256/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.833334:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d180 with x1830962867248256 ext(3145728->4194303) 00002000:00010000:2.0:1746142906.833338:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644d180 00000100:00100000:3.0:1746142906.833348:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:32218:x1830962867248000:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1575us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.833349:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4216 00000100:00100000:2.0:1746142906.833354:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867248256:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142906.833355:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13960 00000100:00100000:0.0:1746142906.835037:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.835066:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.835121:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867248384 00000100:00100000:3.0:1746142906.835126:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867248384 00002000:00100000:3.0:1746142906.835149:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3420159) req@ffff88013644ea00 x1830962867248384/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.835157:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ea00 with x1830962867248384 ext(3145728->3420159) 00010000:00010000:3.0:1746142906.835165:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 41 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.835177:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 41 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:3.0:1746142906.835183:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644ea00 00000100:00100000:3.0:1746142906.835198:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1310 00000100:00100000:3.0:1746142906.835205:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867248384:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142906.835232:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867248512 00000100:00100000:2.0:1746142906.835236:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867248512 00000100:00100000:2.0:1746142906.835268:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13961 00000100:00100000:2.0:1746142906.835275:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32221:x1830962867248512:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142906.835283:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142906.835298:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0ca expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.835314:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142906.835318:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.835328:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.835336:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6000, rc 0) 00000100:00100000:2.0:1746142906.835357:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32221:x1830962867248512:12345-192.168.204.50@tcp:101:cat.0 Request processed in 83us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.835365:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13961 00000100:00100000:2.0:1746142906.835953:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867247872:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4338us (4532us total) trans 0 rc 774144/774144 00000100:00100000:2.0:1746142906.835960:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4215 00002000:00100000:2.0:1746142906.835965:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3420160->4194303) req@ffff88012e679c00 x1830962867247872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 774144/774144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.835972:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679c00 with x1830962867247872 ext(3420160->4194303) 00010000:00010000:2.0:1746142906.835978:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.835987:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:2.0:1746142906.835992:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e679c00 00000100:00100000:3.0:1746142906.838477:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867248384:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3266us (3438us total) trans 21474841149 rc 0/0 00000100:00100000:3.0:1746142906.838484:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1310 00002000:00100000:3.0:1746142906.838490:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3420159) req@ffff88013644ea00 x1830962867248384/t21474841149(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/448 e 0 to 0 dl 1746142917 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.838496:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ea00 with x1830962867248384 ext(3145728->3420159) 00010000:00010000:3.0:1746142906.838503:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:3.0:1746142906.838514:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00002000:00010000:3.0:1746142906.838518:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644ea00 00000100:00100000:3.0:1746142906.838860:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867248256:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5504us (5611us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.838867:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4216 00002000:00100000:3.0:1746142906.838872:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88013644d180 x1830962867248256/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.838885:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d180 with x1830962867248256 ext(3145728->4194303) 00002000:00010000:3.0:1746142906.838888:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644d180 00000100:00100000:0.0:1746142906.841981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.842104:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867248640 00000100:00100000:2.0:1746142906.842183:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867248640 00010000:00010000:2.0:1746142906.842211:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00000100:00100000:2.0:1746142906.842242:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6239 00000100:00100000:2.0:1746142906.842249:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867248640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142906.842261:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142906.842274:0:7219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142906 -> 1746142907 00002000:00010000:2.0:1746142906.842277:0:7219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142906 -> 1746142907 00010000:00010000:2.0:1746142906.842282:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.842294:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.842311:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0a00/0x2fa243e067ccc3c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3420159) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0b5 expref: 42 pid: 1852 timeout: 780 lvb_type: 0 00010000:00010000:2.0:1746142906.842330:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.842332:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.842338:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.842345:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.842356:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.842357:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142906.842360:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.842366:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142906.842391:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.842402:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867767936:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142906.842513:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142906.842521:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867768064:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142906.842551:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142906.843688:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867767936:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142906.843696:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867768064:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142906.843710:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142906.843745:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867248640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1495us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142906.843751:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6239 00000100:00100000:2.0:1746142906.845579:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142906.845664:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867248896 00000100:00100000:3.0:1746142906.845674:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867248896 00002000:00100000:3.0:1746142906.845701:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880093bcdf80 x1830962867248896/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.845710:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcdf80 with x1830962867248896 ext(3145728->4194303) 00002000:00010000:3.0:1746142906.845713:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcdf80 00000100:00100000:3.0:1746142906.845734:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4217 00000100:00100000:3.0:1746142906.845740:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867248896:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142906.850348:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142906.850394:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142906.850425:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867249280 00000100:00100000:2.0:1746142906.850443:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867249280 00002000:00100000:2.0:1746142906.850483:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88013644f100 x1830962867249280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.850492:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f100 with x1830962867249280 ext(3145728->4194303) 00002000:00010000:2.0:1746142906.850497:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644f100 00000100:00100000:2.0:1746142906.850525:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867249408 00000100:00100000:2.0:1746142906.850531:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867249408 00002000:00100000:2.0:1746142906.850543:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88013644ca80 x1830962867249408/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.850549:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ca80 with x1830962867249408 ext(3145728->4194303) 00002000:00010000:2.0:1746142906.850553:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644ca80 00000100:00100000:1.0:1746142906.850562:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4218 00000100:00100000:2.0:1746142906.850566:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4219 00000100:00100000:1.0:1746142906.850569:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867249280:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142906.850570:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867249408:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142906.851690:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867248896:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5947us (6112us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142906.851698:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4217 00002000:00100000:3.0:1746142906.851704:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880093bcdf80 x1830962867248896/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.851711:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcdf80 with x1830962867248896 ext(3145728->4194303) 00002000:00010000:3.0:1746142906.851715:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcdf80 00000100:00100000:1.0:1746142906.859300:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867249280:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8723us (8953us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142906.859309:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4218 00002000:00100000:1.0:1746142906.859322:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88013644f100 x1830962867249280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.859331:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f100 with x1830962867249280 ext(3145728->4194303) 00002000:00010000:1.0:1746142906.859335:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644f100 00000100:00100000:0.0:1746142906.860038:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.860098:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867249664 00000100:00100000:1.0:1746142906.860105:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867249664 00002000:00100000:1.0:1746142906.860132:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88013644fb80 x1830962867249664/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142906.860139:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644fb80 with x1830962867249664 ext(4194304->5033983) 00000100:00100000:3.0:1746142906.860141:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867249408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9568us (9746us total) trans 0 rc 1048576/1048576 00002000:00010000:1.0:1746142906.860143:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644fb80 00000100:00100000:3.0:1746142906.860149:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4219 00002000:00100000:3.0:1746142906.860154:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88013644ca80 x1830962867249408/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142906.860161:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ca80 with x1830962867249408 ext(3145728->4194303) 00002000:00010000:3.0:1746142906.860165:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644ca80 00000100:00100000:1.0:1746142906.860165:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4220 00000100:00100000:1.0:1746142906.860171:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867249664:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142906.866426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.866495:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867249664:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6320us (6456us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142906.866504:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4220 00000100:00100000:2.0:1746142906.866509:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867249920 00002000:00100000:1.0:1746142906.866513:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88013644fb80 x1830962867249664/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142906.866516:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867249920 00002000:00100000:1.0:1746142906.866522:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644fb80 with x1830962867249664 ext(4194304->5033983) 00002000:00010000:1.0:1746142906.866526:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644fb80 00002000:00100000:2.0:1746142906.866545:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88013644f800 x1830962867249920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/0 e 0 to 0 dl 1746142917 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.866552:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f800 with x1830962867249920 ext(4194304->5033983) 00002000:00010000:2.0:1746142906.866556:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644f800 00000100:00100000:2.0:1746142906.866788:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4221 00000100:00100000:2.0:1746142906.866795:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867249920:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142906.871494:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867249920:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4689us (5066us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746142906.871504:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4221 00002000:00100000:2.0:1746142906.871513:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88013644f800 x1830962867249920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:57/0 lens 488/440 e 0 to 0 dl 1746142917 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142906.871526:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f800 with x1830962867249920 ext(4194304->5033983) 00002000:00010000:2.0:1746142906.871531:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644f800 00000100:00100000:0.0:1746142906.873191:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.873253:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867250176 00000100:00100000:1.0:1746142906.873261:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867250176 00000100:00100000:1.0:1746142906.873298:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5219 00000100:00100000:1.0:1746142906.873305:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32221:x1830962867250176:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142906.873462:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32221:x1830962867250176:12345-192.168.204.50@tcp:35:cat.0 Request processed in 157us (275us total) trans 8589936512 rc 0/0 00000100:00100000:1.0:1746142906.873468:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5219 00000100:00100000:0.0:1746142906.877246:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142906.878400:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867250432 00000100:00100000:1.0:1746142906.878409:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867250432 00000100:00100000:1.0:1746142906.878469:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5220 00000100:00100000:1.0:1746142906.878477:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4852850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:32218:x1830962867250432:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142906.878639:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4852850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:32218:x1830962867250432:12345-192.168.204.50@tcp:35:cat.0 Request processed in 162us (1399us total) trans 8589936513 rc 0/0 00000100:00100000:1.0:1746142906.878646:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5220 00000100:00100000:0.0:1746142906.999648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.000030:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867250688 00000100:00100000:3.0:1746142907.000039:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867250688 00000100:00100000:3.0:1746142907.000113:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14370 00000100:00100000:3.0:1746142907.000121:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32234:x1830962867250688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.000140:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.000155:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715e00/0x2fa243e067ccc3e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0d1 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.000216:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000226:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000235:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000246:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000250:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000255:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000330:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000338:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000347:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142907.000354:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.000405:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000410:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000414:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000419:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000423:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.000426:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000457:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000466:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.000468:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.000471:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000475:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc3e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000487:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000494:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000498:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000501:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094715c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.000503:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000507:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000511:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdd00) 00010000:00010000:3.0:1746142907.000513:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.000514:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000518:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc3ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.000544:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715e00/0x2fa243e067ccc3e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 32 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.000553:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 31 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.000558:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.000559:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142907.000561:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715200, rc 0) 00000100:00100000:3.0:1746142907.000614:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32234:x1830962867250688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 493us (974us total) trans 8589936514 rc 0/0 00000100:00100000:3.0:1746142907.000620:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14370 00000100:00080000:0.0:1746142907.000679:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142907.010935:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.010951:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.010975:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867251072 00000100:00100000:2.0:1746142907.010982:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867251072 00000100:00080000:0.0:1746142907.011006:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746142907.011026:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867251200 00002000:00100000:2.0:1746142907.011030:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880093bcd500 x1830962867251072/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142907.011031:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867251200 00002000:00100000:2.0:1746142907.011038:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd500 with x1830962867251072 ext(0->1048575) 00002000:00010000:2.0:1746142907.011042:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcd500 00000100:00100000:2.0:1746142907.011065:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4222 00000100:00100000:3.0:1746142907.011070:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14371 00000100:00080000:0.0:1746142907.011071:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746142907.011074:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867251072:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142907.011077:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:32233:x1830962867251200:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142907.011091:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.011117:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc404 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0d8 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.011176:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011190:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011201:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011211:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011216:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011221:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011329:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011338:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011344:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142907.011352:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.011415:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011421:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011426:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011443:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011448:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.011452:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011457:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011467:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.011470:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.011473:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011477:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc40b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011504:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011512:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011516:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011519:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.011521:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011526:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011531:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdd00) 00010000:00010000:3.0:1746142907.011533:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.011535:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011548:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.011588:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccc404 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 13 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.011618:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 12 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.011625:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.011627:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142907.011629:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714000, rc 0) 00000100:00100000:3.0:1746142907.011673:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:32233:x1830962867251200:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 596us (778us total) trans 8589936515 rc 0/0 00000100:00100000:3.0:1746142907.011680:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14371 00000100:00100000:2.0:1746142907.017087:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867251072:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6006us (6127us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.017098:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4222 00002000:00100000:2.0:1746142907.017108:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880093bcd500 x1830962867251072/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.017117:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd500 with x1830962867251072 ext(0->1048575) 00002000:00010000:2.0:1746142907.017122:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcd500 00000100:00100000:0.0:1746142907.029641:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.029738:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867251456 00000100:00100000:2.0:1746142907.029746:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867251456 00002000:00100000:2.0:1746142907.029785:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88013644c380 x1830962867251456/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.029794:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644c380 with x1830962867251456 ext(2097152->3145727) 00002000:00010000:2.0:1746142907.029800:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644c380 00000100:00100000:2.0:1746142907.030812:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4223 00000100:00100000:2.0:1746142907.030820:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867251456:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.038357:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867251456:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7530us (8716us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.038367:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4223 00002000:00100000:2.0:1746142907.038377:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88013644c380 x1830962867251456/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.038386:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644c380 with x1830962867251456 ext(2097152->3145727) 00002000:00010000:2.0:1746142907.038392:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644c380 00000100:00100000:0.0:1746142907.047323:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.047385:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867251712 00000100:00100000:2.0:1746142907.047393:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867251712 00000100:00100000:2.0:1746142907.047466:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5221 00000100:00100000:2.0:1746142907.047474:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32234:x1830962867251712:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142907.047635:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32234:x1830962867251712:12345-192.168.204.50@tcp:35:cat.0 Request processed in 162us (317us total) trans 8589936516 rc 0/0 00000100:00100000:2.0:1746142907.047641:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5221 00000100:00100000:2.0:1746142907.047844:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.048043:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867251968 00000100:00100000:3.0:1746142907.048048:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867251968 00000100:00100000:3.0:1746142907.048072:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14372 00000100:00100000:3.0:1746142907.048078:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32236:x1830962867251968:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142907.048087:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.048100:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc427 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0df expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048157:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.048167:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 8 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048172:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048178:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048183:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.048206:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 11 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048215:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 11 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.048229:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867768192:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.048284:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048397:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 33 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.048404:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867768320:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.048428:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 8 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.048449:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 8 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.048456:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867768448:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.048470:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.053365:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.053485:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867768192:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.053494:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867768320:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.053552:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.053557:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867252096 00000100:00100000:2.0:1746142907.053563:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867252096 00010000:00010000:2.0:1746142907.053592:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 12 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.053599:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867252224 00000100:00100000:0.0:1746142907.053602:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867252224 00010000:00010000:0.0:1746142907.053613:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 34 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.053630:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6240 00000100:00100000:2.0:1746142907.053637:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867252096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142907.053638:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6241 00000100:00100000:0.0:1746142907.053643:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867252224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.053647:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.053647:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.053652:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 12 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.053652:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 34 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.053661:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 12 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.053668:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 34 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.053687:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccc419 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d8 expref: 12 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.053691:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715200/0x2fa243e067ccc3f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0d1 expref: 34 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.053701:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.053705:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.053711:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.053716:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142907.053718:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.053720:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.053724:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.053727:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.053747:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2004:x1830962867252096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.053747:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867252224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.053752:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6240 00000100:00100000:0.0:1746142907.053754:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6241 00000100:00100000:3.0:1746142907.053810:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867768448:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.053829:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:2.0:1746142907.053849:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.053863:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867252352 00000100:00100000:0.0:1746142907.053866:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867252352 00010000:00010000:0.0:1746142907.053875:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 9 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.053886:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6242 00000100:00100000:0.0:1746142907.053891:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867252352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.053897:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.053918:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 9 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.053925:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 9 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.053941:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714400/0x2fa243e067ccc39b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a092 expref: 9 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.053948:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.053954:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.053960:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.053965:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.053978:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.053995:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867252352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.053999:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6242 00010000:00010000:3.0:1746142907.054091:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.054100:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142907.054115:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.054209:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccc427 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 34 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.054237:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 33 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.054243:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.054245:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142907.054247:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714800, rc 0) 00000100:00100000:3.0:1746142907.054267:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32236:x1830962867251968:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6189us (6424us total) trans 8589936517 rc 0/0 00000100:00100000:3.0:1746142907.054272:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14372 00010000:00010000:2.0:1746142907.102069:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142907.114274:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.114368:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867252608 00000100:00100000:3.0:1746142907.114376:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867252608 00000100:00100000:3.0:1746142907.115159:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14373 00000100:00100000:3.0:1746142907.115168:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:32240:x1830962867252608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.115190:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.115204:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccc43c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0e6 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.115265:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115276:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115284:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115295:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115299:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115304:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115373:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115381:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115387:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142907.115393:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.115465:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115471:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115476:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115480:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115484:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.115488:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115493:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115501:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.115503:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.115507:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115511:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115524:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115529:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115533:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115537:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.115539:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115543:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115547:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd400) 00010000:00010000:3.0:1746142907.115548:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.115550:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115557:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc44a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.115586:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccc43c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 14 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.115596:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 13 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.115601:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.115603:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142907.115605:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75600, rc 0) 00000100:00100000:3.0:1746142907.115651:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:32240:x1830962867252608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 484us (1383us total) trans 8589936518 rc 0/0 00000100:00100000:3.0:1746142907.115658:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14373 00000100:00100000:0.0:1746142907.125401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.125931:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867252864 00000100:00100000:2.0:1746142907.125943:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867252864 00000100:00080000:0.0:1746142907.125986:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746142907.125998:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938dd500 x1830962867252864/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.126007:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dd500 with x1830962867252864 ext(0->1048575) 00002000:00010000:2.0:1746142907.126011:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dd500 00000100:00100000:2.0:1746142907.126037:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4224 00000100:00100000:2.0:1746142907.126043:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867252864:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.134427:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867252864:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8373us (9023us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.134446:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4224 00002000:00100000:2.0:1746142907.134457:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938dd500 x1830962867252864/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.134466:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dd500 with x1830962867252864 ext(0->1048575) 00002000:00010000:2.0:1746142907.134471:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dd500 00000100:00100000:0.0:1746142907.158605:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.158714:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867253120 00000100:00100000:2.0:1746142907.158722:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867253120 00002000:00100000:2.0:1746142907.158758:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800938ddc00 x1830962867253120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.158767:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938ddc00 with x1830962867253120 ext(2097152->3145727) 00002000:00010000:2.0:1746142907.158771:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938ddc00 00000100:00100000:2.0:1746142907.158805:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4225 00000100:00100000:2.0:1746142907.158812:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867253120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.177324:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.177617:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867253248 00000100:00100000:2.0:1746142907.177626:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867253248 00000100:00100000:2.0:1746142907.177691:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13962 00000100:00100000:2.0:1746142907.177702:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:32233:x1830962867253248:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142907.177801:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.177819:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0ed expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.177845:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.177854:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 35 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.177861:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.177862:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.177866:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.177893:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 35 pid: 9580 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746142907.178006:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746142907.178081:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 35 pid: 9580 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.178093:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867768576:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.178650:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867253120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19837us (20052us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142907.178658:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4225 00010000:00010000:2.0:1746142907.178661:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746142907.178667:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800938ddc00 x1830962867253120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746142907.178670:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 19 pid: 9580 timeout: 781 lvb_type: 0 00002000:00100000:3.0:1746142907.178674:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938ddc00 with x1830962867253120 ext(2097152->3145727) 00002000:00010000:3.0:1746142907.178678:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938ddc00 00000100:00100000:2.0:1746142907.178679:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867768704:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.178703:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.182070:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.182288:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867768576:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.182300:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867768704:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.182325:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.182340:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600a00, rc 0) 00000100:00100000:2.0:1746142907.182379:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:32233:x1830962867253248:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4679us (5062us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.182387:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13962 00000100:00100000:2.0:1746142907.182409:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867253376 00000100:00100000:2.0:1746142907.182414:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867253376 00000100:00100000:2.0:1746142907.182453:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13963 00000100:00100000:2.0:1746142907.182460:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:32240:x1830962867253376:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.182472:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.182484:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0f4 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.182500:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.182505:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.182510:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142907.182512:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.182535:0:1852:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.182543:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.182550:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7a00, rc 0) 00000100:00100000:2.0:1746142907.182566:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:32240:x1830962867253376:12345-192.168.204.50@tcp:101:cat.0 Request processed in 107us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.182571:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13963 00000100:00100000:0.0:1746142907.186811:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.186851:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.186923:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867253504 00000100:00100000:2.0:1746142907.186930:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867253504 00010000:00010000:2.0:1746142907.186972:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.187286:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867253632 00000100:00100000:2.0:1746142907.187290:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867253632 00010000:00010000:2.0:1746142907.187303:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 20 pid: 9580 timeout: 781 lvb_type: 0 00000100:00080000:0.0:1746142907.187337:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746142907.187475:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6243 00000100:00100000:3.0:1746142907.187484:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867253504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.187495:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.187515:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.187526:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.187546:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067ccc3cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0bc expref: 36 pid: 9580 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.187608:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6244 00000100:00100000:2.0:1746142907.187614:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867253632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.187621:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.187629:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 20 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.187637:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 20 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.187647:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093379000/0x2fa243e067ccc3b0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0a7 expref: 20 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.187805:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.187807:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.187813:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.187821:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.187849:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.187859:0:7219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.187868:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867768960:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142907.188372:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.188416:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867253632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 802us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.188422:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6244 00000100:00100000:3.0:1746142907.188440:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.188933:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.188959:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867253760 00000100:00100000:1.0:1746142907.188963:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867253760 00000100:00100000:1.0:1746142907.189030:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13964 00000100:00100000:1.0:1746142907.189035:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32236:x1830962867253760:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142907.189047:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.189056:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a0fb expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.189068:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142907.189070:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142907.189072:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3276800->4055039] (req 3276800->4055039) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.189080:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3276800->4055039] (req 3276800->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.189087:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba800, rc 0) 00000100:00100000:1.0:1746142907.189108:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32236:x1830962867253760:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.189113:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13964 00000100:00100000:0.0:1746142907.191486:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.191554:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867254016 00000100:00100000:2.0:1746142907.191561:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867254016 00002000:00100000:2.0:1746142907.191592:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2625536->2629631) req@ffff8800968e8380 x1830962867254016/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.191606:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8380 with x1830962867254016 ext(2625536->2629631) 00010000:00010000:2.0:1746142907.191613:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.191625:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.191631:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e8380 00000100:00100000:2.0:1746142907.191659:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1311 00000100:00100000:2.0:1746142907.191666:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867254016:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.191778:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867254016:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 112us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142907.191784:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1311 00002000:00100000:2.0:1746142907.191789:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2625536->2629631) req@ffff8800968e8380 x1830962867254016/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.191796:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8380 with x1830962867254016 ext(2625536->2629631) 00010000:00010000:2.0:1746142907.191800:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.191809:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.191813:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e8380 00000100:00100000:3.0:1746142907.192243:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867768960:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142907.192259:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.192280:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867253504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4798us (5476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.192287:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6243 00000100:00100000:0.0:1746142907.200851:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.200896:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.200987:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867254272 00000100:00100000:1.0:1746142907.200995:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867254272 00002000:00100000:1.0:1746142907.201028:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2625536->3145727) req@ffff8800968ead80 x1830962867254272/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.201037:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ead80 with x1830962867254272 ext(2625536->3145727) 00010000:00010000:1.0:1746142907.201044:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.201271:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867254400 00000100:00100000:2.0:1746142907.201276:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867254400 00000100:00100000:2.0:1746142907.201307:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13965 00000100:00100000:2.0:1746142907.201314:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:32233:x1830962867254400:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142907.201326:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.201340:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a102 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.201363:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.201371:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.201376:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.201378:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.201381:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3571711] (req 3145728->3571711) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.201404:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.201413:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 40 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.201424:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867769088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.201680:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.201693:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.201701:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867769216:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.201721:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b780 going to sleep for 11 seconds 00010000:00010000:1.0:1746142907.201990:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 19 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746142907.201996:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968ead80 00000100:00100000:1.0:1746142907.202019:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1312 00000100:00100000:1.0:1746142907.202025:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867254272:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142907.205779:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867769088:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.205791:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867769216:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.205813:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3571711] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.205827:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7e00, rc 0) 00000100:00100000:3.0:1746142907.205859:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+27:32233:x1830962867254400:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4545us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.205866:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13965 00000100:00100000:2.0:1746142907.208181:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.208223:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.208341:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867254528 00000100:00100000:0.0:1746142907.208348:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867254528 00010000:00010000:0.0:1746142907.208373:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.208401:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867254656 00000100:00100000:0.0:1746142907.208403:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867254656 00010000:00010000:0.0:1746142907.208411:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.208423:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6245 00000100:00100000:0.0:1746142907.208441:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867254528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142907.208443:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6246 00000100:00100000:1.0:1746142907.208451:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867254656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.208452:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.208459:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.208464:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.208468:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.208473:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.208484:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.208501:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714e00/0x2fa243e067ccc3d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0c3 expref: 27 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.208507:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc3da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ca expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.208521:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.208523:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.208528:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.208535:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.208543:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142907.208561:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.208570:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867254528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 141us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.208571:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867769344:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142907.208576:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6245 00000100:00100000:1.0:1746142907.208616:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c5159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.208719:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867254272:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6693us (7875us total) trans 17179873886 rc 0/0 00000100:00100000:2.0:1746142907.208726:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1312 00002000:00100000:2.0:1746142907.208733:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2625536->3145727) req@ffff8800968ead80 x1830962867254272/t17179873886(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.208740:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ead80 with x1830962867254272 ext(2625536->3145727) 00010000:00010000:2.0:1746142907.208746:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.208755:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.208761:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968ead80 00000100:00100000:1.0:1746142907.211186:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867769344:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.211202:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.211245:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867254656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2794us (3021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.211253:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6246 00000100:00100000:0.0:1746142907.211954:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.212174:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867254784 00000100:00100000:1.0:1746142907.212179:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867254784 00010000:00010000:1.0:1746142907.212205:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.212234:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6247 00000100:00100000:1.0:1746142907.212241:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867254784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.212250:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.212265:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.212275:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.212294:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130600a00/0x2fa243e067ccc45f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2625536->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0ed expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.212306:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.212308:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.212314:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.212320:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.212326:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.212327:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.212330:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.212336:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.212363:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.212373:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867769472:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.212451:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.212462:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867769600:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142907.212785:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c5159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.213749:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.213918:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867255040 00000100:00100000:2.0:1746142907.213923:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867255040 00002000:00100000:2.0:1746142907.213949:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3567616->3571711) req@ffff8800968ebb80 x1830962867255040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.213962:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ebb80 with x1830962867255040 ext(3567616->3571711) 00002000:00010000:2.0:1746142907.213966:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ebb80 00000100:00100000:2.0:1746142907.214027:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4226 00000100:00100000:2.0:1746142907.214033:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867255040:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142907.214157:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867769472:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142907.214165:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867769600:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.214177:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.214202:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867254784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1962us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.214209:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6247 00000100:00100000:2.0:1746142907.214549:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867255040:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 515us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142907.214554:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4226 00002000:00100000:2.0:1746142907.214559:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3567616->3571711) req@ffff8800968ebb80 x1830962867255040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.214565:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ebb80 with x1830962867255040 ext(3567616->3571711) 00002000:00010000:2.0:1746142907.214568:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ebb80 00000100:00100000:0.0:1746142907.215418:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.215970:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867255296 00000100:00100000:2.0:1746142907.215976:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867255296 00002000:00100000:2.0:1746142907.215996:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3276800->3280895) req@ffff8800968e8a80 x1830962867255296/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.216003:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8a80 with x1830962867255296 ext(3276800->3280895) 00002000:00010000:2.0:1746142907.216007:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8a80 00000100:00100000:2.0:1746142907.216029:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4227 00000100:00100000:2.0:1746142907.216035:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867255296:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.216110:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867255296:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 75us (693us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142907.216116:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4227 00002000:00100000:2.0:1746142907.216120:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3276800->3280895) req@ffff8800968e8a80 x1830962867255296/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.216125:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8a80 with x1830962867255296 ext(3276800->3280895) 00002000:00010000:2.0:1746142907.216128:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8a80 00000100:00100000:2.0:1746142907.216286:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.216335:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867255552 00000100:00100000:3.0:1746142907.216339:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867255552 00002000:00100000:3.0:1746142907.216354:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880093bcf800 x1830962867255552/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.216360:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcf800 with x1830962867255552 ext(2097152->3145727) 00002000:00010000:3.0:1746142907.216363:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bcf800 00000100:00100000:3.0:1746142907.216373:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4228 00000100:00100000:3.0:1746142907.216378:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867255552:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142907.217075:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.217713:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867255808 00000100:00100000:3.0:1746142907.217719:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867255808 00000100:00100000:3.0:1746142907.217757:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5222 00000100:00100000:3.0:1746142907.217763:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:32233:x1830962867255808:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142907.217941:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:32233:x1830962867255808:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 177us (866us total) trans 8589936519 rc 0/0 00000100:00100000:3.0:1746142907.217948:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5222 00000100:00100000:3.0:1746142907.221801:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867255552:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 5413us (5505us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142907.221811:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4228 00002000:00100000:3.0:1746142907.221821:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880093bcf800 x1830962867255552/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.221830:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcf800 with x1830962867255552 ext(2097152->3145727) 00002000:00010000:3.0:1746142907.221834:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bcf800 00000100:00100000:0.0:1746142907.224391:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.224497:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867256064 00000100:00100000:3.0:1746142907.224505:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867256064 00002000:00100000:3.0:1746142907.224541:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (4050944->4055039) req@ffff8800968eb800 x1830962867256064/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.224550:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb800 with x1830962867256064 ext(4050944->4055039) 00002000:00010000:3.0:1746142907.224555:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eb800 00000100:00100000:3.0:1746142907.224583:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4229 00000100:00100000:3.0:1746142907.224591:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867256064:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142907.224720:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867256064:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 129us (335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142907.224726:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4229 00002000:00100000:3.0:1746142907.224732:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (4050944->4055039) req@ffff8800968eb800 x1830962867256064/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.224738:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb800 with x1830962867256064 ext(4050944->4055039) 00002000:00010000:3.0:1746142907.224746:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eb800 00000100:00100000:0.0:1746142907.226862:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.228057:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867256320 00000100:00100000:3.0:1746142907.228066:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867256320 00002000:00100000:3.0:1746142907.228106:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3571712->4194303) req@ffff8800968ea680 x1830962867256320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.228116:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea680 with x1830962867256320 ext(3571712->4194303) 00002000:00010000:3.0:1746142907.228121:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea680 00000100:00100000:3.0:1746142907.228155:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4230 00000100:00100000:3.0:1746142907.228163:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867256320:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142907.233496:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867256320:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 4865us (6171us total) trans 0 rc 622592/622592 00000100:00100000:3.0:1746142907.233507:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4230 00002000:00100000:3.0:1746142907.233518:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3571712->4194303) req@ffff8800968ea680 x1830962867256320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 622592/622592 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.233527:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea680 with x1830962867256320 ext(3571712->4194303) 00002000:00010000:3.0:1746142907.233533:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea680 00000100:00100000:0.0:1746142907.238329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.238659:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867256448 00000100:00100000:3.0:1746142907.238667:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867256448 00000100:00100000:3.0:1746142907.238719:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13966 00000100:00100000:3.0:1746142907.238727:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:32240:x1830962867256448:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.238740:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.238754:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a109 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.238778:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.238789:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.238790:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.238793:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.238814:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.238823:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 35 pid: 9579 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.238832:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867769728:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.238925:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.241521:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.241540:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867769728:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.241563:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.241578:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74000, rc 0) 00000100:00100000:2.0:1746142907.241583:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867256576 00000100:00100000:2.0:1746142907.241589:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867256576 00002000:00100000:2.0:1746142907.241623:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3276800->4055039) req@ffff8800968e9c00 x1830962867256576/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746142907.241625:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:32240:x1830962867256448:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2897us (3303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.241632:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13966 00002000:00100000:2.0:1746142907.241632:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9c00 with x1830962867256576 ext(3276800->4055039) 00010000:00010000:2.0:1746142907.241639:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 36 pid: 9579 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.241651:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 36 pid: 9579 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.241656:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e9c00 00000100:00100000:2.0:1746142907.241670:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1313 00000100:00100000:2.0:1746142907.241676:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867256576:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142907.248614:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867256576:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6929us (7091us total) trans 17179873887 rc 0/0 00000100:00100000:0.0:1746142907.248624:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1313 00002000:00100000:0.0:1746142907.248635:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3276800->4055039) req@ffff8800968e9c00 x1830962867256576/t17179873887(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.248643:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9c00 with x1830962867256576 ext(3276800->4055039) 00010000:00010000:0.0:1746142907.248652:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 38 pid: 9579 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.248826:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 38 pid: 9579 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746142907.248834:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e9c00 00000100:00100000:0.0:1746142907.253630:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.253727:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867256704 00000100:00100000:1.0:1746142907.253735:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867256704 00010000:00010000:1.0:1746142907.253776:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 38 pid: 9579 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.253855:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6248 00000100:00100000:1.0:1746142907.253862:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867256704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.253873:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.253891:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 38 pid: 9579 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.253923:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 38 pid: 9579 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.253942:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccc46d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3276800->18446744073709551615] (req 3276800->4055039) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0fb expref: 38 pid: 9579 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.253977:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.253978:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.253985:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.253992:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.254019:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.254030:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867769856:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142907.255365:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c5159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.259316:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867769856:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.259334:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.259369:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867256704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5507us (5746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.259378:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6248 00000100:00100000:0.0:1746142907.259590:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.259662:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867256960 00000100:00100000:2.0:1746142907.259667:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867256960 00002000:00100000:2.0:1746142907.259708:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88012dbf5f80 x1830962867256960/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.259716:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5f80 with x1830962867256960 ext(3145728->4194303) 00002000:00010000:2.0:1746142907.259720:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf5f80 00000100:00100000:2.0:1746142907.259746:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4231 00000100:00100000:2.0:1746142907.259752:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867256960:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.265295:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867256960:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 5535us (5697us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.265306:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4231 00002000:00100000:2.0:1746142907.265315:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88012dbf5f80 x1830962867256960/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.265323:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5f80 with x1830962867256960 ext(3145728->4194303) 00002000:00010000:2.0:1746142907.265328:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf5f80 00000100:00100000:0.0:1746142907.276363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.277102:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867257216 00000100:00100000:2.0:1746142907.277111:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867257216 00002000:00100000:2.0:1746142907.277146:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012dbf4700 x1830962867257216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.277154:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4700 with x1830962867257216 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.277159:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4700 00000100:00100000:2.0:1746142907.277191:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4232 00000100:00100000:2.0:1746142907.277197:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867257216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.283141:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.283239:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867257472 00000100:00100000:3.0:1746142907.283247:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867257472 00000100:00100000:3.0:1746142907.283285:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14374 00000100:00100000:3.0:1746142907.283292:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32245:x1830962867257472:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.283313:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.283328:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc482 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a110 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.283399:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283411:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283419:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283441:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283446:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283452:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283528:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283536:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283541:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142907.283548:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.283606:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283614:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283619:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283624:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283628:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.283632:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283637:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283646:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.283648:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.283652:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283656:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc489 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283684:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283689:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283693:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283697:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.283700:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283704:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283710:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdf00) 00010000:00010000:3.0:1746142907.283712:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.283713:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283716:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc490 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.283745:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc482 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 36 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.283755:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 35 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.283760:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.283762:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142907.283764:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74200, rc 0) 00000100:00100000:3.0:1746142907.283805:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32245:x1830962867257472:12345-192.168.204.50@tcp:101:cat.0 Request processed in 513us (671us total) trans 8589936520 rc 0/0 00000100:00100000:3.0:1746142907.283810:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14374 00000100:00100000:2.0:1746142907.284728:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867257216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7529us (8372us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746142907.284736:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4232 00002000:00100000:2.0:1746142907.284744:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012dbf4700 x1830962867257216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.284752:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4700 with x1830962867257216 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.284756:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4700 00000100:00100000:0.0:1746142907.288396:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.288455:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.288507:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867257728 00000100:00100000:1.0:1746142907.288514:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867257728 00000100:00100000:1.0:1746142907.288560:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867257600 00000100:00100000:1.0:1746142907.288563:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867257600 00000100:00100000:1.0:1746142907.288577:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13967 00000100:00100000:1.0:1746142907.288584:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867257728:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142907.288598:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.288614:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a11e expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.288635:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.288637:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.288644:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 38 pid: 9579 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142907.288659:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13968 00010000:00010000:1.0:1746142907.288661:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 38 pid: 9579 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142907.288669:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867257600:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142907.288669:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495c600, rc 0) 00010000:00010000:2.0:1746142907.288677:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.288685:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccc4ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a117 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.288706:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867257728:12345-192.168.204.50@tcp:101:cat.0 Request processed in 122us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.288712:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13967 00000100:00100000:2.0:1746142907.288718:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867769984:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142907.288775:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00002000:00010000:2.0:1746142907.292106:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142905 -> 1746142907 00000100:00100000:2.0:1746142907.292131:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867769984:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142907.292156:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccc4ac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a117 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.292169:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccc4ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a117 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.292185:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b200, rc 0) 00000100:00100000:2.0:1746142907.292234:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867257600:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3567us (3778us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142907.292242:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13968 00000100:00100000:0.0:1746142907.292824:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.292895:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867257984 00000100:00100000:2.0:1746142907.293292:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867257984 00000100:00100000:2.0:1746142907.293370:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5223 00000100:00100000:2.0:1746142907.293378:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:32240:x1830962867257984:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142907.294807:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:32240:x1830962867257984:12345-192.168.204.50@tcp:35:cat.0 Request processed in 1424us (1978us total) trans 8589936521 rc 0/0 00000100:00100000:2.0:1746142907.294816:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5223 00000100:00100000:0.0:1746142907.299489:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.299761:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867258112 00000100:00100000:2.0:1746142907.299769:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867258112 00000100:00100000:2.0:1746142907.299803:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13969 00000100:00100000:2.0:1746142907.299810:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32245:x1830962867258112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.299824:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.299837:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a125 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.299860:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.299867:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142907.299868:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142907.299871:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.299893:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.299925:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 25 pid: 11421 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.299936:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867770112:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.300010:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.303949:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867770112:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.303974:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.303990:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a600, rc 0) 00000100:00100000:2.0:1746142907.304036:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32245:x1830962867258112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4226us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.304043:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13969 00000100:00100000:0.0:1746142907.307747:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.310314:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867258240 00000100:00100000:2.0:1746142907.310324:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867258240 00002000:00100000:2.0:1746142907.310365:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3571711) req@ffff88012dbf4380 x1830962867258240/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.310374:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4380 with x1830962867258240 ext(3145728->3571711) 00010000:00010000:2.0:1746142907.310382:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 26 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.310394:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 26 pid: 11421 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.310401:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf4380 00000100:00100000:2.0:1746142907.310452:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1314 00000100:00100000:2.0:1746142907.310459:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867258240:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142907.316234:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867258240:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5768us (8484us total) trans 21474841150 rc 0/0 00000100:00100000:0.0:1746142907.316244:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1314 00002000:00100000:0.0:1746142907.316253:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3571711) req@ffff88012dbf4380 x1830962867258240/t21474841150(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.316262:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4380 with x1830962867258240 ext(3145728->3571711) 00010000:00010000:0.0:1746142907.316270:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 28 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.316283:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 28 pid: 11421 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746142907.316290:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf4380 00000100:00100000:0.0:1746142907.324591:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.324686:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867258368 00000100:00100000:1.0:1746142907.324694:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867258368 00010000:00010000:1.0:1746142907.324725:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 28 pid: 11421 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.324747:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6249 00000100:00100000:1.0:1746142907.324753:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867258368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.324764:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.324780:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 28 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.324791:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 28 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.324815:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7e00/0x2fa243e067ccc474 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3571711) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a102 expref: 28 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.326193:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.326197:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.326206:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.326214:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.326250:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.326261:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867770240:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142907.326942:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c5159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.329821:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867770240:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.329839:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.329987:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867258368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5232us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.329996:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6249 00000100:00100000:0.0:1746142907.339122:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.339174:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.339268:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867258752 00000100:00100000:2.0:1746142907.339276:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867258752 00002000:00100000:2.0:1746142907.339317:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012dbf6300 x1830962867258752/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.339326:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6300 with x1830962867258752 ext(2097152->4194303) 00002000:00010000:2.0:1746142907.339331:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf6300 00000100:00100000:2.0:1746142907.339346:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867258880 00000100:00100000:2.0:1746142907.339348:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867258880 00002000:00100000:2.0:1746142907.339360:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012dbf7b80 x1830962867258880/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.339367:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7b80 with x1830962867258880 ext(2097152->4194303) 00002000:00010000:2.0:1746142907.339370:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf7b80 00000100:00100000:2.0:1746142907.339382:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4233 00000100:00100000:2.0:1746142907.339389:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867258752:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142907.340132:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4234 00000100:00100000:3.0:1746142907.340141:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867258880:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142907.348967:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.349047:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867259136 00000100:00100000:0.0:1746142907.349056:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867259136 00000100:00100000:0.0:1746142907.349104:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14375 00000100:00100000:0.0:1746142907.349112:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:32248:x1830962867259136:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142907.349132:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142907.349148:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccc4ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a12c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.349214:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349225:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349234:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349243:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349248:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349253:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349331:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccc4cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349339:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccc4cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349345:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccc4cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142907.349352:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142907.349408:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349413:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349421:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349441:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349445:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fba600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.349448:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349452:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349461:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142907.349463:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142907.349467:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349471:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fba600/0x2fa243e067ccc4c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349496:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349501:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349505:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349509:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fbba00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.349511:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349519:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349525:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880136ad3600) 00010000:00010000:0.0:1746142907.349526:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142907.349528:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349532:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc4c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.349562:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccc4ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a12c expref: 18 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.349572:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccc4cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a12c expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.349577:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.349579:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142907.349582:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbb400, rc 0) 00000100:00100000:0.0:1746142907.349615:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:32248:x1830962867259136:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 503us (655us total) trans 8589936522 rc 0/0 00000100:00100000:0.0:1746142907.349621:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14375 00000100:00100000:3.0:1746142907.357494:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867258880:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17346us (18312us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142907.357506:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4234 00002000:00100000:3.0:1746142907.357516:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012dbf7b80 x1830962867258880/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.357526:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7b80 with x1830962867258880 ext(2097152->4194303) 00002000:00010000:3.0:1746142907.357531:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf7b80 00000100:00100000:0.0:1746142907.366643:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.366705:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867259264 00000100:00100000:1.0:1746142907.366712:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867259264 00000100:00100000:2.0:1746142907.366740:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867258752:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27350us (27626us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142907.366749:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4233 00000100:00100000:1.0:1746142907.366751:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 757 00002000:00100000:2.0:1746142907.366758:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012dbf6300 x1830962867258752/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746142907.366759:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867259264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746142907.366766:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6300 with x1830962867258752 ext(2097152->4194303) 00002000:00010000:2.0:1746142907.366770:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf6300 00010000:00010000:1.0:1746142907.366772:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.366792:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccc4cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a12c expref: 17 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.366814:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.366819:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.366837:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867259264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.366842:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 757 00000100:00100000:0.0:1746142907.367938:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.367983:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867259520 00000100:00100000:2.0:1746142907.367987:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867259520 00002000:00100000:2.0:1746142907.368009:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012dbf6680 x1830962867259520/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.368017:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6680 with x1830962867259520 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.368020:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf6680 00000100:00100000:2.0:1746142907.368041:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4235 00000100:00100000:2.0:1746142907.368046:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867259520:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.371047:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.371114:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867259648 00000100:00100000:2.0:1746142907.371127:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867259648 00000100:00100000:2.0:1746142907.371171:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13970 00000100:00100000:2.0:1746142907.371179:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:32248:x1830962867259648:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142907.371194:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.371213:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a133 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.371238:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.371247:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.371249:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.371252:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.371274:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.371284:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 42 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.371294:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867770368:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.371378:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.373308:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867259520:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5254us (5365us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746142907.373321:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4235 00002000:00100000:0.0:1746142907.373330:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012dbf6680 x1830962867259520/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.373338:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6680 with x1830962867259520 ext(4194304->5033983) 00010000:00010000:0.0:1746142907.373346:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.373357:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746142907.373362:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf6680 00000100:00100000:2.0:1746142907.375600:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867770368:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.375627:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.375640:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131200, rc 0) 00000100:00100000:2.0:1746142907.375670:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+28:32248:x1830962867259648:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4492us (4630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.375676:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13970 00000100:00100000:0.0:1746142907.377602:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.377785:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867259776 00000100:00100000:2.0:1746142907.377792:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867259776 00000100:00100000:2.0:1746142907.377830:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13971 00000100:00100000:2.0:1746142907.377837:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32245:x1830962867259776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.377851:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.377863:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a13a expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.377880:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.377882:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.377887:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.377919:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.377928:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131400, rc 0) 00000100:00100000:2.0:1746142907.378333:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32245:x1830962867259776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 495us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.378339:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13971 00000100:00100000:0.0:1746142907.381703:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.381818:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260032 00000100:00100000:2.0:1746142907.381824:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260032 00002000:00100000:2.0:1746142907.381858:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4206592->5033983) req@ffff880130120a80 x1830962867260032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.381867:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120a80 with x1830962867260032 ext(4206592->5033983) 00010000:00010000:2.0:1746142907.381874:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 42 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.381887:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 42 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.381893:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130120a80 00000100:00100000:2.0:1746142907.381941:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1315 00000100:00100000:2.0:1746142907.381948:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867260032:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.382516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.383165:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260160 00000100:00100000:2.0:1746142907.383169:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260160 00010000:00010000:2.0:1746142907.383191:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 44 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.383217:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6250 00000100:00100000:2.0:1746142907.383224:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867260160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.383233:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.383245:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 44 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.383254:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 44 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.383273:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a600/0x2fa243e067ccc4b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a125 expref: 44 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.383299:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.383301:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.383305:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.383313:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.383339:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.383349:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867770496:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142907.383479:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.387302:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867770496:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142907.387320:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.387371:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867260160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4146us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.387379:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6250 00000100:00100000:0.0:1746142907.387628:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.387698:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260416 00000100:00100000:3.0:1746142907.387703:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260416 00002000:00100000:3.0:1746142907.387733:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3055616->3059711) req@ffff880130123480 x1830962867260416/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.387741:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123480 with x1830962867260416 ext(3055616->3059711) 00002000:00010000:3.0:1746142907.387745:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130123480 00000100:00100000:3.0:1746142907.387764:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4236 00000100:00100000:3.0:1746142907.387769:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867260416:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142907.387859:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867260416:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 90us (232us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142907.387864:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4236 00002000:00100000:3.0:1746142907.387868:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3055616->3059711) req@ffff880130123480 x1830962867260416/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.387878:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123480 with x1830962867260416 ext(3055616->3059711) 00002000:00010000:3.0:1746142907.387880:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130123480 00000100:00100000:2.0:1746142907.391248:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867260032:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9292us (9544us total) trans 0 rc 827392/827392 00000100:00100000:2.0:1746142907.391258:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1315 00002000:00100000:2.0:1746142907.391267:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4206592->5033983) req@ffff880130120a80 x1830962867260032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 827392/827392 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.391276:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120a80 with x1830962867260032 ext(4206592->5033983) 00002000:00010000:2.0:1746142907.391285:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120a80 00000100:00100000:1.0:1746142907.391570:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.391633:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260544 00000100:00100000:0.0:1746142907.391640:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260544 00000100:00100000:0.0:1746142907.391678:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13972 00000100:00100000:0.0:1746142907.391685:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:32248:x1830962867260544:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142907.391697:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142907.391709:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a141 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.391730:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.391738:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.391745:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 37 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.391751:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142907.391752:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142907.391755:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->2203647] (req 2097152->2203647) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.391778:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 37 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.391789:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 37 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.391799:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867770624:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142907.391867:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.391875:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 22 pid: 11421 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.391882:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867770752:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142907.391925:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.391936:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 22 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.391943:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096070a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867770880:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.391965:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.397184:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.397208:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867770624:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.397218:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867770752:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.397223:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.397225:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096070a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867770880:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.397253:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->2203647] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.397301:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260672 00000100:00100000:1.0:1746142907.397307:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260672 00010000:00010000:1.0:1746142907.397329:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 23 pid: 11421 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.397347:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260800 00000100:00100000:1.0:1746142907.397349:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260800 00010000:00010000:1.0:1746142907.397356:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 38 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.397381:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6251 00000100:00100000:1.0:1746142907.397387:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867260672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.397397:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.397411:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 23 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.397433:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 23 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.397452:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc47b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a109 expref: 23 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.397468:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.397490:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6252 00000100:00100000:0.0:1746142907.397497:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867260800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142907.397501:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867260672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 113us (324us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142907.397505:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142907.397506:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6251 00010000:00010000:0.0:1746142907.397514:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 38 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.397523:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 38 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.397534:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009495c600/0x2fa243e067ccc4a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a11e expref: 38 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.397546:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.397560:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867260800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.397565:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6252 00010000:00010000:2.0:1746142907.397672:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2ea00, rc 0) 00000100:00100000:2.0:1746142907.397694:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:32248:x1830962867260544:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6010us (6124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.397699:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13972 00000100:00100000:0.0:1746142907.398438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.398473:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867260928 00000100:00100000:3.0:1746142907.398477:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867260928 00010000:00010000:3.0:1746142907.398490:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.398508:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6253 00000100:00100000:3.0:1746142907.398512:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867260928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.398519:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.398526:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.398534:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.398544:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067ccc466 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0f4 expref: 21 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.398566:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.398567:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.398573:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.398580:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.398610:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 20 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.398620:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867771008:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142907.398679:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.400778:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.401997:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867261056 00000100:00100000:2.0:1746142907.402005:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867261056 00000100:00100000:2.0:1746142907.402052:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13973 00000100:00100000:2.0:1746142907.402059:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867261056:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.402072:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.402084:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc4f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a148 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.402102:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142907.402107:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc4f2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a148 expref: 42 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.402116:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130800/0x2fa243e067ccc4f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a148 expref: 42 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.402138:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130800, rc 0) 00000100:00100000:2.0:1746142907.402179:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867261056:12345-192.168.204.50@tcp:101:cat.0 Request processed in 121us (1407us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142907.402185:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13973 00000100:00100000:2.0:1746142907.402197:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867261184 00000100:00100000:2.0:1746142907.402200:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867261184 00000100:00100000:2.0:1746142907.402303:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13974 00000100:00100000:2.0:1746142907.402329:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867261184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.402340:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.402349:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096131000/0x2fa243e067ccc4f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a14f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.402380:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867771136:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142907.403238:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.403495:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.403648:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867261440 00000100:00100000:2.0:1746142907.403652:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867261440 00002000:00100000:2.0:1746142907.403678:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2199552->2203647) req@ffff880096072d80 x1830962867261440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.403686:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072d80 with x1830962867261440 ext(2199552->2203647) 00002000:00010000:2.0:1746142907.403690:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096072d80 00000100:00100000:2.0:1746142907.403702:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4237 00000100:00100000:2.0:1746142907.403707:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867261440:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.403959:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867261440:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 250us (464us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142907.403968:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4237 00002000:00100000:2.0:1746142907.403973:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2199552->2203647) req@ffff880096072d80 x1830962867261440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746142907.403980:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867771008:192.168.204.50@tcp:105: 00002000:00100000:2.0:1746142907.403980:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072d80 with x1830962867261440 ext(2199552->2203647) 00002000:00010000:2.0:1746142907.403982:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096072d80 00010000:00010000:3.0:1746142907.403993:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.404016:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867260928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5502us (5578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.404023:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6253 00002000:00010000:2.0:1746142907.404379:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142907 -> 1746142908 00002000:00010000:2.0:1746142907.404382:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142907 -> 1746142908 00000100:00100000:2.0:1746142907.404391:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867771136:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142907.404408:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096131000/0x2fa243e067ccc4f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a14f expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.404418:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096131000/0x2fa243e067ccc4f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a14f expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.404437:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131000, rc 0) 00000100:00100000:2.0:1746142907.404459:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867261184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2132us (2368us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142907.404464:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13974 00000100:00100000:0.0:1746142907.407749:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.407787:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.407821:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.408038:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867261824 00000100:00100000:3.0:1746142907.408044:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867261824 00000100:00100000:3.0:1746142907.408072:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867261952 00000100:00100000:3.0:1746142907.408073:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867261952 00000100:00100000:3.0:1746142907.408095:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13975 00000100:00100000:3.0:1746142907.408102:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867261824:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.408115:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.408128:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc500 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a156 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.408153:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc500 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a156 expref: 42 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.408162:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc500 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a156 expref: 42 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.408172:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74a00, rc 0) 00000100:00100000:3.0:1746142907.408206:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867261824:12345-192.168.204.50@tcp:101:cat.0 Request processed in 104us (418us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142907.408210:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13975 00000100:00100000:3.0:1746142907.408221:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13976 00000100:00100000:3.0:1746142907.408226:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867261952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.408232:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.408239:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccc507 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a15d expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.408271:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867771264:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142907.408317:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.408448:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867261696 00000100:00100000:2.0:1746142907.408452:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867261696 00000100:00100000:2.0:1746142907.408475:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5224 00000100:00100000:2.0:1746142907.408481:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:32248:x1830962867261696:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142907.408621:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:32248:x1830962867261696:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 140us (878us total) trans 8589936523 rc 0/0 00000100:00100000:2.0:1746142907.408630:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5224 00000100:00100000:3.0:1746142907.411889:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867771264:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142907.411965:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccc507 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a15d expref: 38 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.411978:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74800/0x2fa243e067ccc507 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a15d expref: 38 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.411988:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74800, rc 0) 00000100:00100000:3.0:1746142907.412025:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867261952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3797us (4202us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142907.412031:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13976 00000100:00100000:0.0:1746142907.419506:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.419559:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867262208 00000100:00100000:3.0:1746142907.419566:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867262208 00000100:00100000:3.0:1746142907.419613:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5225 00000100:00100000:3.0:1746142907.419620:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32245:x1830962867262208:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142907.419770:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32245:x1830962867262208:12345-192.168.204.50@tcp:35:cat.0 Request processed in 150us (269us total) trans 8589936524 rc 0/0 00000100:00100000:3.0:1746142907.419777:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5225 00000100:00100000:0.0:1746142907.421323:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.421415:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867262464 00000100:00100000:3.0:1746142907.421420:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867262464 00000100:00100000:3.0:1746142907.421564:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14376 00000100:00100000:3.0:1746142907.421570:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:32252:x1830962867262464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.421584:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.421597:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccc50e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a164 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.421647:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421657:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421665:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421674:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421678:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421683:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421752:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc523 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421760:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc523 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421766:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc523 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142907.421775:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.421818:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421822:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421826:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421831:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421835:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.421838:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421843:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421850:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.421853:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.421856:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421859:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421867:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421871:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421878:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421881:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.421883:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421887:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421892:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd100) 00010000:00010000:3.0:1746142907.421893:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.421895:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421919:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067ccc51c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.421946:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75200/0x2fa243e067ccc50e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a164 expref: 20 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.421955:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc523 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a164 expref: 19 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.421960:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.421962:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142907.421964:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74c00, rc 0) 00000100:00100000:3.0:1746142907.422007:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+19:32252:x1830962867262464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 437us (687us total) trans 8589936525 rc 0/0 00000100:00100000:3.0:1746142907.422013:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14376 00000100:00100000:0.0:1746142907.424796:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.424835:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.425010:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867262720 00000100:00100000:2.0:1746142907.425017:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867262720 00000100:00100000:2.0:1746142907.425051:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 758 00000100:00100000:2.0:1746142907.425056:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867262720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.425068:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.425086:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74c00/0x2fa243e067ccc523 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a164 expref: 19 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.425103:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.425106:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.425151:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867262720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.425156:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 758 00000100:00100000:3.0:1746142907.425467:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867262592 00000100:00100000:3.0:1746142907.425471:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867262592 00000100:00100000:3.0:1746142907.425696:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13977 00000100:00100000:3.0:1746142907.425702:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867262592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.425714:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.425725:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74800/0x2fa243e067ccc531 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a16b expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.425747:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74800/0x2fa243e067ccc531 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a16b expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.425755:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74800/0x2fa243e067ccc531 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a16b expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.425762:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74800, rc 0) 00000100:00100000:3.0:1746142907.425796:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867262592:12345-192.168.204.50@tcp:101:cat.0 Request processed in 94us (1005us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142907.425801:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13977 00000100:00100000:0.0:1746142907.440405:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.440465:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867262848 00000100:00100000:3.0:1746142907.440473:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867262848 00000100:00100000:3.0:1746142907.440550:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13978 00000100:00100000:3.0:1746142907.440557:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:32252:x1830962867262848:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.440572:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.440586:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a172 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.440609:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.440616:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.440618:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.440620:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.440644:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.440653:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 29 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.440663:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867771392:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.441187:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.442140:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867771392:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.442466:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.442565:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867262976 00000100:00100000:2.0:1746142907.442570:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867262976 00002000:00100000:2.0:1746142907.442599:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3055616->3145727) req@ffff88012c0e0e00 x1830962867262976/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.442607:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0e00 with x1830962867262976 ext(3055616->3145727) 00010000:00010000:2.0:1746142907.442614:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 30 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.442624:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 30 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.442630:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0e0e00 00000100:00100000:2.0:1746142907.442643:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1316 00000100:00100000:2.0:1746142907.442649:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867262976:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:3.0:1746142907.442744:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 31 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.442756:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74a00, rc 0) 00000100:00100000:3.0:1746142907.442781:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+31:32252:x1830962867262848:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2224us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.442787:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13978 00000100:00100000:0.0:1746142907.445775:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867262976:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3120us (3303us total) trans 21474841151 rc 0/0 00000100:00100000:0.0:1746142907.445784:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1316 00002000:00100000:0.0:1746142907.445792:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3055616->3145727) req@ffff88012c0e0e00 x1830962867262976/t21474841151(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.445801:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0e00 with x1830962867262976 ext(3055616->3145727) 00010000:00010000:0.0:1746142907.445810:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 31 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.445823:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 31 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746142907.445828:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0e0e00 00000100:00100000:0.0:1746142907.448777:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.449936:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867263104 00000100:00100000:2.0:1746142907.449947:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867263104 00010000:00010000:2.0:1746142907.449979:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 31 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.450012:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6254 00000100:00100000:2.0:1746142907.450019:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867263104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.450032:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142907.450046:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142907 -> 1746142908 00010000:00010000:2.0:1746142907.450052:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 31 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.450063:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 31 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.450083:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc4dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3055616->3145727] (req 3055616->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a133 expref: 31 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.450115:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.450117:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.450123:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.450131:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.450166:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.450177:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867771520:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142907.450265:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.453716:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.453948:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867771520:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142907.453965:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.454003:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867263104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3984us (5233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.454014:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6254 00000100:00100000:0.0:1746142907.454099:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867263360 00000100:00100000:0.0:1746142907.454107:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867263360 00000100:00100000:0.0:1746142907.454151:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14377 00000100:00100000:0.0:1746142907.454158:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32255:x1830962867263360:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142907.454178:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142907.454193:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e000/0x2fa243e067ccc53f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a179 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.454255:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454266:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454275:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454286:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454291:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454297:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454378:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f200/0x2fa243e067ccc554 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454386:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f200/0x2fa243e067ccc554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454392:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f200/0x2fa243e067ccc554 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142907.454400:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142907.454470:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454475:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454480:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454485:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454490:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2e800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.454493:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454498:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454507:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142907.454509:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142907.454512:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454517:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccc546 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454534:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454539:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454543:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454550:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2f600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.454552:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454556:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454561:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091e97a00) 00010000:00010000:0.0:1746142907.454563:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142907.454565:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454569:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f600/0x2fa243e067ccc54d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.454597:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e000/0x2fa243e067ccc53f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a179 expref: 39 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.454606:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f200/0x2fa243e067ccc554 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a179 expref: 38 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.454612:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.454614:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142907.454616:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2f200, rc 0) 00000100:00100000:0.0:1746142907.454650:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32255:x1830962867263360:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 492us (941us total) trans 8589936526 rc 0/0 00000100:00100000:0.0:1746142907.454656:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14377 00000100:00100000:0.0:1746142907.456277:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.456315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.456384:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867263616 00000100:00100000:3.0:1746142907.456390:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867263616 00000100:00100000:3.0:1746142907.456684:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5226 00000100:00100000:3.0:1746142907.456692:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4852450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32255:x1830962867263616:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142907.456698:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867263744 00000100:00100000:2.0:1746142907.456702:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867263744 00000100:00100000:2.0:1746142907.456796:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 759 00000100:00100000:2.0:1746142907.456830:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867263744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.456839:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.456854:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f200/0x2fa243e067ccc554 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a179 expref: 39 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.456890:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.456893:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.456987:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867263744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 185us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.456993:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 759 00000100:00100000:3.0:1746142907.457634:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4852450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32255:x1830962867263616:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 941us (1359us total) trans 8589936527 rc 0/0 00000100:00100000:3.0:1746142907.457641:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5226 00000100:00100000:2.0:1746142907.464469:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.464512:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.464531:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867264128 00000100:00100000:0.0:1746142907.464538:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867264128 00000100:00100000:1.0:1746142907.464559:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867264256 00000100:00100000:1.0:1746142907.464563:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867264256 00002000:00100000:0.0:1746142907.464572:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2203648->4194303) req@ffff880093bcd880 x1830962867264128/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.464581:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd880 with x1830962867264128 ext(2203648->4194303) 00002000:00100000:1.0:1746142907.464582:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880093bcf480 x1830962867264256/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746142907.464585:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bcd880 00002000:00100000:1.0:1746142907.464590:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcf480 with x1830962867264256 ext(2097152->4194303) 00002000:00010000:1.0:1746142907.464593:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcf480 00000100:00100000:0.0:1746142907.464614:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4238 00000100:00100000:0.0:1746142907.464621:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867264128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.464627:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4239 00000100:00100000:1.0:1746142907.464633:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867264256:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.480400:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867264128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15773us (15931us total) trans 0 rc 1990656/1990656 00000100:00100000:2.0:1746142907.480410:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4238 00002000:00100000:2.0:1746142907.480433:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2203648->4194303) req@ffff880093bcd880 x1830962867264128/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1990656/1990656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.480447:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd880 with x1830962867264128 ext(2203648->4194303) 00002000:00010000:2.0:1746142907.480451:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bcd880 00000100:00100000:1.0:1746142907.485712:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867264256:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21070us (21189us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142907.485723:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4239 00002000:00100000:1.0:1746142907.485733:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880093bcf480 x1830962867264256/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.485742:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcf480 with x1830962867264256 ext(2097152->4194303) 00002000:00010000:1.0:1746142907.485747:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcf480 00000100:00100000:0.0:1746142907.492083:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.493719:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867264512 00000100:00100000:1.0:1746142907.493729:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867264512 00002000:00100000:1.0:1746142907.493773:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012c0e2d80 x1830962867264512/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.493783:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e2d80 with x1830962867264512 ext(4194304->5033983) 00002000:00010000:1.0:1746142907.493789:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e2d80 00000100:00100000:1.0:1746142907.493827:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4240 00000100:00100000:1.0:1746142907.493837:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867264512:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.507438:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867264512:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13585us (15344us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746142907.507450:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4240 00002000:00100000:2.0:1746142907.507460:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88012c0e2d80 x1830962867264512/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.507470:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e2d80 with x1830962867264512 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.507475:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e2d80 00000100:00100000:0.0:1746142907.517329:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.520105:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867264640 00000100:00100000:2.0:1746142907.520115:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867264640 00000100:00100000:2.0:1746142907.520175:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14378 00000100:00100000:2.0:1746142907.520183:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32256:x1830962867264640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142907.520204:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.520219:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a180 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.520269:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520279:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520287:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520298:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520303:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520308:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520367:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520377:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 37 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.520383:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.520408:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 37 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.520417:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 37 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.520438:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867771648:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.520520:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.520527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.520547:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867264896 00000100:00100000:2.0:1746142907.520550:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867264896 00000100:00100000:2.0:1746142907.520571:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5227 00000100:00100000:2.0:1746142907.520576:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32252:x1830962867264896:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142907.520717:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32252:x1830962867264896:12345-192.168.204.50@tcp:35:cat.0 Request processed in 139us (188us total) trans 8589936528 rc 0/0 00000100:00100000:2.0:1746142907.520725:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5227 00000100:00100000:2.0:1746142907.523754:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867771648:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.523777:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142907.525606:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.525662:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265024 00000100:00100000:2.0:1746142907.525668:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265024 00010000:00010000:2.0:1746142907.525695:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 38 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.525730:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6255 00000100:00100000:2.0:1746142907.525736:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867265024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.525746:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.525750:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 38 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.525759:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 38 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.525777:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccc42e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0df expref: 38 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.525805:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.525809:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.525818:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.525835:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.525869:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.525922:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867265024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 185us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.525928:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6255 00010000:00010000:3.0:1746142907.526617:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526625:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142907.526664:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:3.0:1746142907.526668:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142907.526682:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526691:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526699:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526703:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526707:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526715:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526719:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130de3800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.526722:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526728:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526736:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.526738:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.526741:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526744:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccc569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526770:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526775:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526780:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526784:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130de2e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.526786:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526790:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526799:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091eb9e00) 00010000:00010000:3.0:1746142907.526801:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.526803:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526807:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130de2e00/0x2fa243e067ccc570 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.526833:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.526843:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.526848:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.526849:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142907.526851:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098f0a800, rc 0) 00000100:00100000:3.0:1746142907.526891:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32256:x1830962867264640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6709us (9568us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.526897:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14378 00000100:00100000:0.0:1746142907.531517:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.531559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.531632:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.531659:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265152 00000100:00100000:0.0:1746142907.531667:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265152 00000100:00100000:0.0:1746142907.531710:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265280 00000100:00100000:0.0:1746142907.531712:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265280 00000100:00100000:0.0:1746142907.531737:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265408 00000100:00100000:0.0:1746142907.531739:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265408 00000100:00100000:0.0:1746142907.531755:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13979 00000100:00100000:0.0:1746142907.531761:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32255:x1830962867265152:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:1.0:1746142907.531770:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13980 00010000:00010000:0.0:1746142907.531775:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142907.531778:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867265280:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.531786:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142907.531790:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a187 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.531795:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a18e expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.531810:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.531812:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.531813:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.531818:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 14 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.531819:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142907.531820:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746142907.531821:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13981 00010000:00010000:0.0:1746142907.531823:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2514944->3117055] (req 2514944->3117055) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.531828:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867265408:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.531830:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 14 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.531834:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.531839:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067ccc58c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a195 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.531839:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fea400, rc 0) 00010000:00010000:0.0:1746142907.531843:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.531852:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 19 pid: 9580 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.531874:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867265280:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.531879:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13980 00000100:00100000:3.0:1746142907.532846:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867771904:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142907.533179:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867771776:192.168.204.50@tcp:104: 00000100:00080000:3.0:1746142907.533505:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746142907.533508:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142907.533774:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06480 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.533931:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.534971:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867771776:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.534997:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2514944->3117055] (req 2514944->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142907.535001:0:11421:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142907 -> 1746142908 00010000:00010000:1.0:1746142907.535009:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06400, rc 0) 00000100:00100000:3.0:1746142907.535017:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867771904:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142907.535032:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067ccc58c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a195 expref: 17 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.535041:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74c00/0x2fa243e067ccc58c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a195 expref: 17 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.535054:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74c00, rc 0) 00000100:00100000:3.0:1746142907.535133:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867265408:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3304us (3500us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142907.535133:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32255:x1830962867265152:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3371us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.535139:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13981 00000100:00100000:1.0:1746142907.535142:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13979 00000100:00100000:0.0:1746142907.536079:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.536144:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265536 00000100:00100000:2.0:1746142907.536149:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265536 00002000:00100000:2.0:1746142907.536178:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2203647) req@ffff880092d0b100 x1830962867265536/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.536187:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0b100 with x1830962867265536 ext(2097152->2203647) 00010000:00010000:2.0:1746142907.536193:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 20 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.536217:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 20 pid: 9580 timeout: 781 lvb_type: 0 00002000:00010000:2.0:1746142907.536222:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092d0b100 00000100:00100000:2.0:1746142907.536245:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1317 00000100:00100000:2.0:1746142907.536251:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867265536:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142907.537734:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.537958:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265792 00000100:00100000:3.0:1746142907.537963:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265792 00000100:00100000:3.0:1746142907.537996:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14379 00000100:00100000:3.0:1746142907.538002:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32256:x1830962867265792:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142907.538012:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.538025:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a19c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.538172:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.538184:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.538191:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.538213:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.538222:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 10 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.538232:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867772032:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.538301:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.538969:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867265536:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2716us (2889us total) trans 17179873888 rc 0/0 00000100:00100000:0.0:1746142907.538977:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1317 00002000:00100000:0.0:1746142907.538983:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2203647) req@ffff880092d0b100 x1830962867265536/t17179873888(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.538990:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0b100 with x1830962867265536 ext(2097152->2203647) 00010000:00010000:0.0:1746142907.538996:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.539005:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746142907.539009:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092d0b100 00000100:00100000:0.0:1746142907.540448:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.540648:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867772032:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.540663:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:1.0:1746142907.540894:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867265920 00000100:00100000:1.0:1746142907.541039:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867265920 00010000:00010000:1.0:1746142907.541059:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 11 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.541074:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6256 00000100:00100000:1.0:1746142907.541079:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867265920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.541175:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.541181:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 11 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.541189:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 11 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.541203:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098f0a800/0x2fa243e067ccc577 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a180 expref: 11 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.541220:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.541223:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.541229:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.541234:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.541253:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.541280:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867265920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 199us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.541286:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6256 00010000:00010000:3.0:1746142907.541437:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.541446:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142907.541460:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.541547:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75800/0x2fa243e067ccc593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.541558:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.541563:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.541566:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142907.541569:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74600, rc 0) 00000100:00100000:3.0:1746142907.541601:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32256:x1830962867265792:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3598us (3869us total) trans 8589936529 rc 0/0 00000100:00100000:3.0:1746142907.541607:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14379 00000100:00100000:0.0:1746142907.542886:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.542966:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867266048 00000100:00100000:1.0:1746142907.542971:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867266048 00010000:00010000:1.0:1746142907.542986:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.543232:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6257 00000100:00100000:1.0:1746142907.543239:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867266048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.543249:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.543264:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.543274:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.543294:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2ea00/0x2fa243e067ccc4eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a141 expref: 22 pid: 9580 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.543305:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.543307:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.543313:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.543319:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.543347:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.543357:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867772160:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142907.543431:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.543835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.543877:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867266176 00000100:00100000:3.0:1746142907.543881:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867266176 00000100:00100000:3.0:1746142907.543924:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14380 00000100:00100000:3.0:1746142907.543930:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32256:x1830962867266176:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142907.543945:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.543955:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067ccc5a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1a3 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.544010:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.544020:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.544026:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.544043:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.544052:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 11 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.544059:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867772288:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.544108:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.545415:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.545538:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867772160:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.545551:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.545575:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867266048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2336us (2690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.545581:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6257 00000100:00100000:2.0:1746142907.545640:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867266432 00000100:00100000:2.0:1746142907.545644:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867266432 00000100:00100000:3.0:1746142907.545652:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867772288:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.545662:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00002000:00100000:2.0:1746142907.545667:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2514944->2519039) req@ffff880092d08a80 x1830962867266432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.545675:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08a80 with x1830962867266432 ext(2514944->2519039) 00002000:00010000:2.0:1746142907.545679:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d08a80 00000100:00100000:2.0:1746142907.545692:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4241 00000100:00100000:2.0:1746142907.545697:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867266432:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.545780:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867266432:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 83us (367us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142907.545785:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4241 00002000:00100000:2.0:1746142907.545789:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2514944->2519039) req@ffff880092d08a80 x1830962867266432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.545795:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08a80 with x1830962867266432 ext(2514944->2519039) 00002000:00010000:2.0:1746142907.545798:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d08a80 00000100:00100000:0.0:1746142907.546254:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.546379:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867266560 00000100:00100000:1.0:1746142907.546382:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867266560 00010000:00010000:1.0:1746142907.546395:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 12 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.546436:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6258 00000100:00100000:1.0:1746142907.546442:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867266560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.546449:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.546454:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 12 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.546461:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 12 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.546476:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccc59a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a19c expref: 12 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.546485:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.546489:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.546496:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.546502:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.546525:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.546557:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867266560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.546563:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6258 00010000:00010000:3.0:1746142907.546731:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.546737:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142907.546773:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:3.0:1746142907.546777:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142907.546788:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.546812:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067ccc5a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1a3 expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.546823:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1a3 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.546829:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.546831:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142907.546833:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6400, rc 0) 00000100:00100000:3.0:1746142907.547358:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32256:x1830962867266176:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3427us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.547364:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14380 00000100:00100000:0.0:1746142907.548819:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.548925:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867266688 00000100:00100000:1.0:1746142907.548930:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867266688 00000100:00100000:1.0:1746142907.548966:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13982 00000100:00100000:1.0:1746142907.548972:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867266688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.548985:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.548996:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067ccc5b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1aa expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.549034:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867772416:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142907.549099:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.551482:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.551534:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867266944 00000100:00100000:1.0:1746142907.551540:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867266944 00000100:00100000:2.0:1746142907.551622:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867772416:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142907.551647:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067ccc5b6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1aa expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.551660:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091feba00/0x2fa243e067ccc5b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1aa expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.551681:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091feba00, rc 0) 00000100:00100000:2.0:1746142907.551713:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867266688:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2741us (2896us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142907.551719:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13982 00002000:00100000:1.0:1746142907.551770:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3112960->3117055) req@ffff880091de0a80 x1830962867266944/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.551778:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0a80 with x1830962867266944 ext(3112960->3117055) 00002000:00010000:1.0:1746142907.551781:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091de0a80 00000100:00100000:1.0:1746142907.551792:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4242 00000100:00100000:1.0:1746142907.551797:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867266944:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142907.552619:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867266944:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 820us (1139us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142907.552626:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4242 00002000:00100000:1.0:1746142907.552631:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (3112960->3117055) req@ffff880091de0a80 x1830962867266944/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.552637:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0a80 with x1830962867266944 ext(3112960->3117055) 00002000:00010000:1.0:1746142907.552640:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091de0a80 00000100:00100000:0.0:1746142907.556138:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.556190:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867267200 00000100:00100000:3.0:1746142907.556199:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867267200 00000100:00100000:3.0:1746142907.556243:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14381 00000100:00100000:3.0:1746142907.556250:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32256:x1830962867267200:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142907.556266:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.556281:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccc5bd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1b1 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.556391:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.556409:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867267456 00000100:00100000:0.0:1746142907.556412:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867267456 00000100:00100000:0.0:1746142907.556459:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5228 00000100:00100000:0.0:1746142907.556464:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32255:x1830962867267456:12345-192.168.204.50@tcp:35:multiop.0 00010000:00010000:3.0:1746142907.556553:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.556566:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.556574:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142907.556582:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.556621:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccc5bd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.556632:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 12 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.556637:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32255:x1830962867267456:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 172us (246us total) trans 8589936530 rc 0/0 00010000:00010000:3.0:1746142907.556639:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.556641:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:0.0:1746142907.556643:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5228 00010000:00010000:3.0:1746142907.556644:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6000, rc 0) 00000100:00100000:3.0:1746142907.556660:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:32256:x1830962867267200:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 411us (532us total) trans 8589936531 rc 0/0 00000100:00100000:3.0:1746142907.556664:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14381 00000100:00100000:0.0:1746142907.559265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.559689:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.559718:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.559731:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.560017:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.560347:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867267584 00000100:00100000:2.0:1746142907.560354:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867267584 00000100:00100000:2.0:1746142907.560389:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867267712 00000100:00100000:2.0:1746142907.560391:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867267712 00000100:00100000:2.0:1746142907.560409:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867267840 00000100:00100000:2.0:1746142907.560411:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867267840 00000100:00100000:2.0:1746142907.560432:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867267968 00000100:00100000:2.0:1746142907.560433:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867267968 00000100:00100000:2.0:1746142907.560443:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268096 00000100:00100000:2.0:1746142907.560445:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268096 00000100:00100000:2.0:1746142907.560457:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13983 00000100:00100000:2.0:1746142907.560464:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867267584:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142907.560496:0:1852:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.560510:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.560517:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 40 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.560522:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 29 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.560528:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.560530:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.560532:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.560555:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 29 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.560566:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 29 pid: 9578 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746142907.560577:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867772544:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.560658:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13984 00000100:00100000:1.0:1746142907.560666:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867267712:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142907.560689:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.560699:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 17 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.560705:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.560711:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 20 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.560715:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.560717:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.560718:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.560733:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 20 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.560740:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 20 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.560748:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867772672:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.560806:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13985 00000100:00100000:0.0:1746142907.560812:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867267840:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142907.560827:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.560836:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 17 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.560842:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.560848:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 20 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.560852:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.560853:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.560855:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.560867:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 20 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.560874:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 20 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.560881:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867772800:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.560943:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13986 00000100:00100000:3.0:1746142907.560949:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867267968:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142907.560963:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.560970:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.560975:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 40 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.560980:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.560984:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.560985:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.560987:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.560998:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.561004:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 29 pid: 1854 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142907.561010:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867772928:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.561105:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.561117:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 37 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.561125:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867773056:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142907.561742:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.561751:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 37 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.561762:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867773184:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142907.561816:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 17 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.561822:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.561828:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867773312:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.561839:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.561884:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142907.562090:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 40 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.562103:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 40 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142907.562110:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867773440:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.562135:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.562143:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 16 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142907.562150:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867773568:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.562166:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.562186:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268224 00000100:00100000:3.0:1746142907.562190:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268224 00000100:00100000:3.0:1746142907.562208:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13987 00000100:00100000:3.0:1746142907.562213:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867268096:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142907.562230:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562239:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562245:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.562254:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562258:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.562260:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.562261:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562274:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562282:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 40 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.562288:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867773696:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.562311:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.562319:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 16 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142907.562325:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867773824:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.562342:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562353:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 29 pid: 11421 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.562359:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867773952:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.562369:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.562381:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 13988 00000100:00100000:3.0:1746142907.562385:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867268224:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142907.562397:0:9578:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562406:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562411:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.562412:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142907.562414:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562436:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.562443:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.562449:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867774080:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.562461:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00010000:00010000:2.0:1746142907.562746:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 40 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.562754:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 40 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746142907.562762:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867774208:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.562785:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.562791:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 16 pid: 1853 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746142907.562798:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867774336:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.562810:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b780 going to sleep for 11 seconds 00010000:00010000:1.0:1746142907.563360:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 18 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.563368:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 18 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.563377:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867774464:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.563395:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c515e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.571110:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867772672:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.572380:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867772800:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.572389:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867773184:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.572396:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867773312:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142907.572416:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.572492:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867772928:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.572500:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867773440:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.572507:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867773568:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.572518:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.573370:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867773696:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.573379:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867773824:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.573398:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867773056:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.573409:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867773952:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.573434:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.573453:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867774464:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.573455:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142907.573468:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.573478:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.573483:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268352 00000100:00100000:2.0:1746142907.573487:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268352 00000100:00100000:0.0:1746142907.573491:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.573501:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268608 00000100:00100000:0.0:1746142907.573503:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268608 00010000:00010000:2.0:1746142907.573512:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 38 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.573514:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 30 pid: 1854 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746142907.573529:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268864 00000100:00100000:2.0:1746142907.573530:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268864 00000100:00100000:0.0:1746142907.573532:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6259 00010000:00010000:2.0:1746142907.573537:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.573537:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867268352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.573547:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142907.573549:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6260 00000100:00100000:2.0:1746142907.573552:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867268608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.573558:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.573561:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 38 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746142907.573567:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 30 pid: 1854 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.573569:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 38 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746142907.573574:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 30 pid: 1854 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746142907.573586:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3600/0x2fa243e067ccc2d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fff expref: 30 pid: 1854 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.573586:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092733c00/0x2fa243e067ccc30f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a037 expref: 38 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746142907.573599:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142907.573599:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.573628:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867268608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.573633:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6260 00000100:00100000:3.0:1746142907.573645:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6261 00000100:00100000:3.0:1746142907.573650:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867268864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.573657:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.573664:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.573672:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.573683:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0600/0x2fa243e067ccc205 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fc0 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.573699:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.573735:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867268352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 197us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.573740:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6259 00000100:00100000:0.0:1746142907.573799:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.573808:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268480 00000100:00100000:0.0:1746142907.573810:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268480 00010000:00010000:0.0:1746142907.573819:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 19 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.573829:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6262 00000100:00100000:0.0:1746142907.573832:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962867268480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.573839:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.573845:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 19 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.573851:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 19 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.573860:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccc1f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb9 expref: 19 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.573867:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.573881:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867268480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 48us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.573886:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6262 00000100:00100000:0.0:1746142907.573959:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.573969:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268736 00000100:00100000:0.0:1746142907.573972:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268736 00010000:00010000:0.0:1746142907.573982:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.573994:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6263 00000100:00100000:0.0:1746142907.573998:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867268736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.574003:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.574010:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.574021:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.574031:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092732800/0x2fa243e067ccc316 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a03e expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.574039:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.574040:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.574043:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.574049:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.574065:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.574078:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867268736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.574093:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6263 00000100:00100000:3.0:1746142907.576095:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867268864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2437us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.576103:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6261 00000100:00100000:3.0:1746142907.576148:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867774080:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.576164:0:9578:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576180:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576187:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576204:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576210:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576215:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576221:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800920cfe00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.576224:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576230:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576241:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.576250:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccc5e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.576287:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867267968:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 15338us (16554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.576294:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13986 00000100:00100000:3.0:1746142907.576317:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867772544:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.576326:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867774208:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.576333:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130123100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867774336:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.576346:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.576819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576882:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576925:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576940:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576951:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.576963:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269248 00000100:00100000:0.0:1746142907.576969:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269248 00010000:00010000:0.0:1746142907.576987:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 15 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.577000:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867268992 00000100:00100000:0.0:1746142907.577002:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867268992 00010000:00010000:0.0:1746142907.577010:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 40 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.577017:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269120 00000100:00100000:0.0:1746142907.577018:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269120 00010000:00010000:0.0:1746142907.577026:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 21 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.577032:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269376 00000100:00100000:0.0:1746142907.577034:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269376 00010000:00010000:0.0:1746142907.577040:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 22 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.577047:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269760 00000100:00100000:0.0:1746142907.577048:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269760 00010000:00010000:0.0:1746142907.577055:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 16 pid: 1853 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.577061:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269632 00000100:00100000:0.0:1746142907.577063:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269632 00010000:00010000:0.0:1746142907.577068:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.577077:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6264 00000100:00100000:0.0:1746142907.577082:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867269248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.577091:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.577101:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 16 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.577103:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6265 00000100:00100000:1.0:1746142907.577109:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867268992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.577109:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 16 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.577115:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.577122:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.577122:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fea400/0x2fa243e067ccc585 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a18e expref: 16 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.577129:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 41 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.577162:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6266 00000100:00100000:3.0:1746142907.577171:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867269120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.577177:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.577187:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 22 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577194:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 22 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577203:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccc2c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff1 expref: 22 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577215:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.577232:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867269120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.577237:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6266 00000100:00100000:3.0:1746142907.577245:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6267 00000100:00100000:3.0:1746142907.577249:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867269376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.577254:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.577259:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 20 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577266:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 20 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577273:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89a00/0x2fa243e067ccc2c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89ff8 expref: 20 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577280:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.577281:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.577284:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577290:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577302:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.577312:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867269376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.577316:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6267 00000100:00100000:3.0:1746142907.577322:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6268 00000100:00100000:3.0:1746142907.577326:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867269760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.577330:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.577336:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 15 pid: 1853 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577342:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 15 pid: 1853 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577350:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccc1fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fab expref: 15 pid: 1853 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577355:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.577363:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867269760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.577367:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6268 00000100:00100000:3.0:1746142907.577373:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6269 00000100:00100000:3.0:1746142907.577376:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867269632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.577380:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.577384:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577390:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577399:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092732a00/0x2fa243e067ccc301 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a029 expref: 41 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.577404:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.577411:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867269632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.577415:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6269 00010000:00010000:3.0:1746142907.577438:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577444:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577454:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577459:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577465:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577470:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc07600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.577472:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577481:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577489:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.577495:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07600/0x2fa243e067ccc5e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.577522:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867267840:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 16711us (17804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.577528:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13985 00010000:00010000:0.0:1746142907.577782:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142907.577795:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131400/0x2fa243e067ccc4e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4206592->5033983) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a13a expref: 39 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.577798:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962867269248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 716us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.577803:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6264 00010000:00010000:1.0:1746142907.577813:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.577826:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867268992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 718us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.577831:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6265 00000100:00100000:0.0:1746142907.577863:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.577877:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269888 00000100:00100000:0.0:1746142907.577880:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269888 00010000:00010000:0.0:1746142907.577891:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.578042:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6270 00000100:00100000:1.0:1746142907.578048:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867269888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.578054:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.578060:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.578067:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.578076:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0400/0x2fa243e067ccc1f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fb2 expref: 17 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.578083:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.578094:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867269888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.578098:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6270 00000100:00100000:1.0:1746142907.578194:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867269504 00000100:00100000:1.0:1746142907.578197:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867269504 00002000:00100000:1.0:1746142907.578219:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2514944->3117055) req@ffff880091de2680 x1830962867269504/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.578227:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2680 with x1830962867269504 ext(2514944->3117055) 00010000:00010000:1.0:1746142907.578233:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.578241:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 37 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746142907.578246:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091de2680 00000100:00100000:1.0:1746142907.578263:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1318 00000100:00100000:1.0:1746142907.578268:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867269504:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142907.585008:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.585046:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.585052:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270016 00000100:00100000:3.0:1746142907.585060:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270016 00010000:00010000:3.0:1746142907.585086:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 29 pid: 9578 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142907.585112:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270144 00000100:00100000:3.0:1746142907.585114:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270144 00010000:00010000:3.0:1746142907.585121:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.585136:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6271 00000100:00100000:3.0:1746142907.585142:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867270016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142907.585148:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6272 00010000:00010000:3.0:1746142907.585152:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142907.585156:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867270144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.585163:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.585166:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 30 pid: 9578 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.585174:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.585175:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 30 pid: 9578 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.585186:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.585192:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2600/0x2fa243e067ccc2bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb89fe3 expref: 30 pid: 9578 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.585197:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc538 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a172 expref: 30 pid: 11421 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.585202:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.585203:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.585205:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.585206:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.585207:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.585208:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585214:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.585214:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.585242:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142907.585271:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.585292:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867270016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.585297:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6271 00010000:00010000:3.0:1746142907.585351:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585358:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585370:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585380:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585386:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585391:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.585393:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585399:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585406:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.585411:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc5ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.585458:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867268096:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 23244us (25441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.585465:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13987 00010000:00010000:2.0:1746142907.586580:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586590:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586605:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586611:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586617:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586622:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd3e600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142907.586625:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586630:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586641:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.586647:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e600/0x2fa243e067ccc5d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.586702:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088320850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867267584:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 26237us (27441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.586708:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13983 00000100:00100000:0.0:1746142907.587088:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867270144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1930us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.587095:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6272 00000100:00100000:3.0:1746142907.587923:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.587985:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270272 00000100:00100000:1.0:1746142907.587991:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270272 00010000:00010000:1.0:1746142907.588015:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 39 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.588038:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6273 00000100:00100000:1.0:1746142907.588044:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867270272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.588057:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.588069:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 39 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.588078:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 39 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.588092:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092733800/0x2fa243e067ccc308 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a030 expref: 39 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:1.0:1746142907.588108:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.588110:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.588114:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.588121:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.588138:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.588159:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867270272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 116us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.588165:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6273 00010000:00010000:3.0:1746142907.589132:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589146:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589168:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589175:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589181:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589186:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fea800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.589189:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589195:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589207:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.589212:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fea800/0x2fa243e067ccc5d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.589254:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867267712:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 28588us (29564us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.589262:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13984 00000100:00100000:0.0:1746142907.593379:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867269504:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 15098us (16441us total) trans 17179873889 rc 0/0 00000100:00100000:0.0:1746142907.593390:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1318 00002000:00100000:0.0:1746142907.593399:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2514944->3117055) req@ffff880091de2680 x1830962867269504/t17179873889(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.593408:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2680 with x1830962867269504 ext(2514944->3117055) 00010000:00010000:0.0:1746142907.593418:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.593439:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:0.0:1746142907.593445:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091de2680 00000100:00100000:0.0:1746142907.597103:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.597563:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270400 00000100:00100000:1.0:1746142907.597571:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270400 00010000:00010000:1.0:1746142907.597603:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.597644:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6274 00000100:00100000:1.0:1746142907.597652:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867270400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.597664:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142907.597681:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.597694:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.597719:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccc57e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2514944->3117055) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a187 expref: 38 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.597748:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.597750:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.597753:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.597761:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.597789:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142907.597882:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597891:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597930:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597937:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597944:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597950:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a0400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142907.597953:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597960:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597970:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.597975:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0a0400/0x2fa243e067ccc5f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.598096:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867270400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 444us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.598103:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6274 00000100:00100000:2.0:1746142907.598382:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867268224:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 35995us (36496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.598390:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 13988 00000100:00100000:0.0:1746142907.600103:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.600160:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270656 00000100:00100000:3.0:1746142907.600169:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270656 00000100:00100000:3.0:1746142907.600215:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14382 00000100:00100000:3.0:1746142907.600223:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:32256:x1830962867270656:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1746142907.600262:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.600281:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccc5af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1a3 expref: 12 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600295:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.600299:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142907.600318:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.600330:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600336:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 37 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600342:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 18 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600348:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 37 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600353:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 7/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.600381:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 37 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600391:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 37 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.600402:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774592:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.600508:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 18 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600516:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 18 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.600524:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774720:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.600548:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 37 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600554:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 37 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.600560:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774848:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.600582:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.600589:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.600599:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774976:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.600615:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.602536:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.602574:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.602644:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.602708:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270912 00000100:00100000:1.0:1746142907.602713:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270912 00010000:00010000:1.0:1746142907.602735:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 38 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.602744:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271040 00000100:00100000:3.0:1746142907.602748:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271040 00000100:00100000:1.0:1746142907.602753:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867270784 00000100:00100000:1.0:1746142907.602755:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867270784 00010000:00010000:1.0:1746142907.602763:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 19 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.602765:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 39 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.602775:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6275 00000100:00100000:3.0:1746142907.602781:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6276 00000100:00100000:1.0:1746142907.602781:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867270912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142907.602786:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867270784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.602791:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.602792:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.602796:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 19 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.602796:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 39 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.602804:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 19 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.602849:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6277 00000100:00100000:2.0:1746142907.602858:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867271040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.602864:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.602868:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 39 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.602953:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 39 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.602970:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.602974:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.602981:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.603010:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867270912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 228us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.603015:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6275 00010000:00010000:2.0:1746142907.603329:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 38 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.603406:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccc347 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a068 expref: 38 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.603441:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774592:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.603445:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.603450:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.603452:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ae00/0x2fa243e067ccc339 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a05a expref: 19 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.603456:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.603459:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774720:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.603465:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774848:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.603471:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867774976:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.603478:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867270784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 691us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.603483:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6276 00010000:00010000:0.0:1746142907.603488:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.603595:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067ccc497 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a110 expref: 37 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.603603:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.603606:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.603612:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.603632:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867271040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 776us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.603638:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6277 00000100:00100000:0.0:1746142907.603776:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.603808:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271168 00000100:00100000:3.0:1746142907.603811:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271168 00010000:00010000:3.0:1746142907.603824:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.603838:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6278 00000100:00100000:3.0:1746142907.603843:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867271168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.603849:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.603852:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.603859:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.603868:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067ccc451 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a0e6 expref: 18 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.603876:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.603879:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.603884:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.603890:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.604190:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.604196:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000040:00080000:1.0:1746142907.604398:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].609, 88 off61304 00000004:00080000:1.0:1746142907.604404:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681603504098ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142907.604446:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].678, 88 off67472 00000004:00080000:1.0:1746142907.604451:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681603551470ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.604473:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].679, 88 off67560 00000004:00080000:1.0:1746142907.604476:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681603576350ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.604485:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].610, 88 off61392 00000004:00080000:1.0:1746142907.604488:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681603588284ns, next at 629431245375ns, rc = 0 00010000:00010000:3.0:1746142907.604677:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.604730:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867271168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 885us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.604736:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6278 00000040:00080000:1.0:1746142907.605001:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].611, 88 off61480 00000004:00080000:1.0:1746142907.605006:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681604106584ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142907.605022:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].680, 88 off67648 00000004:00080000:1.0:1746142907.605025:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604124715ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605263:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].681, 88 off67736 00000004:00080000:1.0:1746142907.605268:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604368275ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605282:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].612, 88 off61568 00000004:00080000:1.0:1746142907.605285:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681604384939ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142907.605295:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].682, 88 off67824 00000004:00080000:1.0:1746142907.605297:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604397374ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605305:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].613, 88 off61656 00000004:00080000:1.0:1746142907.605307:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681604407115ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142907.605314:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].683, 88 off67912 00000004:00080000:1.0:1746142907.605316:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604416589ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605323:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].614, 88 off61744 00000004:00080000:1.0:1746142907.605325:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681604425507ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142907.605331:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].684, 88 off68000 00000004:00080000:1.0:1746142907.605333:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604433484ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605339:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].615, 88 off61832 00000004:00080000:1.0:1746142907.605341:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681604441440ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142907.605348:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].685, 88 off68088 00000004:00080000:1.0:1746142907.605350:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604450559ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605357:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].686, 88 off68176 00000004:00080000:1.0:1746142907.605359:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681604458929ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142907.605366:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].616, 88 off61920 00000004:00080000:1.0:1746142907.605368:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681604467919ns, next at 629431245375ns, rc = 0 00000001:00080000:2.0:1746142907.607954:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936532 is committed 00000004:00080000:2.0:1746142907.608783:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 605 committed 00000004:00080000:2.0:1746142907.608789:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 675 committed 00000004:00080000:2.0:1746142907.609216:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 674 committed 00000004:00080000:2.0:1746142907.609219:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 604 committed 00000004:00080000:2.0:1746142907.609220:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 673 committed 00000004:00080000:2.0:1746142907.609222:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 603 committed 00000004:00080000:2.0:1746142907.609224:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 672 committed 00000004:00080000:2.0:1746142907.609225:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 602 committed 00000004:00080000:2.0:1746142907.609227:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 671 committed 00000004:00080000:2.0:1746142907.609228:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 601 committed 00000004:00080000:2.0:1746142907.609229:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 670 committed 00000004:00080000:2.0:1746142907.609231:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 669 committed 00000004:00080000:2.0:1746142907.609232:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 600 committed 00000004:00080000:2.0:1746142907.609234:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 599 committed 00000004:00080000:2.0:1746142907.609235:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 668 committed 00000004:00080000:2.0:1746142907.609237:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 667 committed 00000004:00080000:2.0:1746142907.609238:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 598 committed 00000001:00080000:2.0:1746142907.609247:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936530 is committed 00000001:00080000:2.0:1746142907.609252:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936528 is committed 00000100:00100000:0.0:1746142907.609454:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.609507:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142907.609532:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.609547:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142907.609935:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867775488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.609942:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867775104:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746142907.609985:0:10924:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091de1180 reply state ffff880099e0a800 transno 8589936532 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.610004:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.610011:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.610013:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746142907.610017:0:10924:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746142907.610082:0:10924:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746142907.610091:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32256:x1830962867270656:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 9868us (9993us total) trans 8589936532 rc 0/0 00000100:00100000:1.0:1746142907.610098:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14382 00000100:00100000:3.0:1746142907.610559:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775232 00000100:00100000:3.0:1746142907.610567:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775232 00000100:00100000:3.0:1746142907.610592:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775744 00000100:00100000:3.0:1746142907.610594:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775744 00000100:00100000:0.0:1746142907.610606:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142907.610610:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13989 00000100:00100000:3.0:1746142907.610615:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3764:x1830962867775232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.610625:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142907.610636:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.610648:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142907.610658:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746142907.610662:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.610676:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142907.610721:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3764:x1830962867775232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (1214us total) trans 21474841152 rc 0/0 00000100:00100000:3.0:1746142907.610727:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13989 00000100:00100000:0.0:1746142907.610982:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.611004:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.611055:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776256 00000100:00100000:2.0:1746142907.611058:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776256 00000100:00100000:3.0:1746142907.611059:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776768 00000100:00100000:3.0:1746142907.611061:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776768 00000100:00100000:3.0:1746142907.611098:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775360 00000100:00100000:3.0:1746142907.611100:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775360 00000100:00100000:1.0:1746142907.611165:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775872 00000100:00100000:1.0:1746142907.611168:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775872 00000100:00100000:0.0:1746142907.611174:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.611189:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.611249:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776384 00000100:00100000:2.0:1746142907.611252:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776384 00000100:00100000:3.0:1746142907.611254:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13990 00000100:00100000:3.0:1746142907.611258:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3764:x1830962867775744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.611263:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13991 00000100:00100000:2.0:1746142907.611266:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3764:x1830962867776768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142907.611311:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3764:x1830962867775744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1762us total) trans 21474841153 rc 0/0 00002000:00010000:2.0:1746142907.611312:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142907.611315:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00000100:00100000:3.0:1746142907.611316:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13990 00002000:00010000:2.0:1746142907.611317:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142907.611318:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142907.611320:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142907.611325:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13992 00000100:00100000:3.0:1746142907.611328:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3764:x1830962867776256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.611336:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:3764:x1830962867776768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (687us total) trans 17179873890 rc 0/0 00000100:00100000:2.0:1746142907.611340:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13991 00000100:00100000:2.0:1746142907.611348:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13993 00000100:00100000:2.0:1746142907.611353:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3764:x1830962867775360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.611372:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3764:x1830962867776256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (746us total) trans 17179873891 rc 0/0 00000100:00100000:3.0:1746142907.611377:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13992 00000100:00100000:3.0:1746142907.611385:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13994 00000100:00100000:3.0:1746142907.611389:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3764:x1830962867775872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.611393:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3764:x1830962867775360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (717us total) trans 21474841154 rc 0/0 00000100:00100000:2.0:1746142907.611398:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13993 00000100:00100000:2.0:1746142907.611405:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13995 00002000:00010000:3.0:1746142907.611433:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142907.611435:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.611437:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142907.611439:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.611440:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:3.0:1746142907.611458:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3764:x1830962867775872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (456us total) trans 21474841155 rc 0/0 00000100:00100000:3.0:1746142907.611463:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746142907.611611:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.611824:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3764:x1830962867776384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.611877:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+62:3764:x1830962867776384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 468us (687us total) trans 17179873892 rc 0/0 00000100:00100000:2.0:1746142907.611882:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13995 00000100:00100000:0.0:1746142907.612028:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142907.612046:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142907.612057:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb3480/2, rc 0, transno 17179873891 00000100:00100000:1.0:1746142907.612058:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867776000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.612064:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142907.612070:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0000/2, rc 0, transno 17179873890 00000100:00100000:0.0:1746142907.612073:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.612076:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142907.612080:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de3800/2, rc 0, transno 21474841152 00000100:00100000:1.0:1746142907.612084:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867776512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.612084:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142907.612090:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0e1880/2, rc 0, transno 21474841153 00000100:00100000:0.0:1746142907.612092:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.612095:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142907.612100:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de0e00/2, rc 0, transno 21474841154 00000100:00100000:0.0:1746142907.612102:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.612103:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867777024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142907.612107:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0e0a80/2, rc 0, transno 21474841155 00000100:00100000:0.0:1746142907.612109:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867775872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.612115:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142907.612115:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb3800/2, rc 0, transno 17179873892 00000100:00100000:0.0:1746142907.612117:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.612129:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776896 00000100:00100000:0.0:1746142907.612131:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775488 00000100:00100000:1.0:1746142907.612132:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776896 00000100:00100000:0.0:1746142907.612134:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775488 00000100:00100000:1.0:1746142907.612144:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776000 00000100:00100000:1.0:1746142907.612145:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776000 00000100:00100000:0.0:1746142907.612146:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776512 00000100:00100000:0.0:1746142907.612147:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776512 00000100:00100000:0.0:1746142907.612152:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867777024 00000100:00100000:0.0:1746142907.612154:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867777024 00000100:00100000:1.0:1746142907.612155:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13996 00000100:00100000:1.0:1746142907.612159:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3764:x1830962867776896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.612160:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13997 00000100:00100000:0.0:1746142907.612164:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3762:x1830962867775488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.612221:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3764:x1830962867776896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (589us total) trans 17179873893 rc 0/0 00000100:00100000:0.0:1746142907.612221:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3762:x1830962867775488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (175us total) trans 21474841156 rc 0/0 00000100:00100000:0.0:1746142907.612226:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13997 00000100:00100000:1.0:1746142907.612228:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13996 00000100:00100000:0.0:1746142907.612235:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13998 00000100:00100000:1.0:1746142907.612237:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13999 00000100:00100000:0.0:1746142907.612238:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3762:x1830962867776000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.612240:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3762:x1830962867776512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142907.612273:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142907.612275:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142907.612277:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:1.0:1746142907.612278:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142907.612280:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142907.612283:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3762:x1830962867776000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (206us total) trans 21474841157 rc 0/0 00000100:00100000:0.0:1746142907.612287:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13998 00000100:00100000:1.0:1746142907.612292:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3762:x1830962867776512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (196us total) trans 17179873894 rc 0/0 00000100:00100000:0.0:1746142907.612295:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14000 00000100:00100000:1.0:1746142907.612298:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13999 00000100:00100000:0.0:1746142907.612299:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3762:x1830962867777024:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142907.612315:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de2a00/2, rc 0, transno 21474841156 00000100:00100000:1.0:1746142907.612318:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867775488:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142907.612324:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0e3100/2, rc 0, transno 21474841157 00000100:00100000:1.0:1746142907.612327:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867776000:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142907.612332:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2a00/2, rc 0, transno 17179873894 00000100:00100000:1.0:1746142907.612335:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867776512:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142907.612335:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142907.612337:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142907.612339:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142907.612340:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142907.612342:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:0.0:1746142907.612361:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3762:x1830962867777024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (244us total) trans 17179873895 rc 0/0 00000100:00100000:0.0:1746142907.612366:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14000 00000004:00080000:1.0:1746142907.612367:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bce680/2, rc 0, transno 17179873895 00000100:00100000:1.0:1746142907.612370:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867777024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142907.612381:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0380/2, rc 0, transno 17179873893 00000100:00100000:0.0:1746142907.612384:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867776896:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746142907.612437:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.612444:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.612450:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.612456:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a0000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142907.612459:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.612464:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.612476:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.612478:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142907.612481:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.612485:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc5fc lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142907.612506:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.612522:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867775616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.612538:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.612546:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867776128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.612558:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.612565:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867776640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.612576:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142907.612713:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775104 00000100:00100000:3.0:1746142907.612717:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775104 00000100:00100000:3.0:1746142907.612734:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867775616 00000100:00100000:3.0:1746142907.612736:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867775616 00000100:00100000:3.0:1746142907.612745:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776128 00000100:00100000:3.0:1746142907.612746:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776128 00000100:00100000:3.0:1746142907.612754:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867776640 00000100:00100000:3.0:1746142907.612756:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867776640 00000100:00100000:3.0:1746142907.612763:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14001 00000100:00100000:3.0:1746142907.612768:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867775104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.612855:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3763:x1830962867775104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (348us total) trans 21474841158 rc 0/0 00000100:00100000:3.0:1746142907.612860:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14001 00000004:00080000:2.0:1746142907.612870:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de3480/2, rc 0, transno 21474841158 00000100:00100000:3.0:1746142907.612871:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14002 00000100:00100000:2.0:1746142907.612874:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867775104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.612876:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3763:x1830962867775616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.612945:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3763:x1830962867775616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (406us total) trans 21474841159 rc 0/0 00000100:00100000:3.0:1746142907.612951:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14002 00000100:00100000:3.0:1746142907.612960:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14003 00000100:00100000:3.0:1746142907.612963:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3763:x1830962867776128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142907.613013:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3763:x1830962867776128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (453us total) trans 17179873896 rc 0/0 00000100:00100000:3.0:1746142907.613020:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14003 00000100:00100000:3.0:1746142907.613029:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14004 00000100:00100000:3.0:1746142907.613033:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3763:x1830962867776640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142907.613066:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746142907.613069:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.613071:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142907.613072:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.613074:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:3.0:1746142907.613090:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3763:x1830962867776640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (513us total) trans 17179873897 rc 0/0 00000100:00100000:3.0:1746142907.613095:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14004 00000100:00100000:3.0:1746142907.613138:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746142907.613144:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867777152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142907.613163:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142907.613180:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867777152 00000100:00100000:3.0:1746142907.613183:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867777152 00000100:00100000:3.0:1746142907.613196:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14005 00000100:00100000:3.0:1746142907.613200:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3762:x1830962867777152:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142907.613227:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0e1f80/2, rc 0, transno 21474841159 00000100:00100000:2.0:1746142907.613231:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867775616:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142907.613237:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2300/2, rc 0, transno 17179873896 00000100:00100000:2.0:1746142907.613240:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867776128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142907.613246:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2680/2, rc 0, transno 17179873897 00000100:00100000:2.0:1746142907.613249:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867776640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142907.613253:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3762:x1830962867777152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (89us total) trans 17179873898 rc 0/0 00000100:00100000:3.0:1746142907.613258:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14005 00000004:00080000:3.0:1746142907.613275:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bcc000/2, rc 0, transno 17179873898 00000100:00100000:3.0:1746142907.613279:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867777152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.614059:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.614119:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271296 00000100:00100000:1.0:1746142907.614123:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271296 00000100:00100000:1.0:1746142907.614142:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14383 00000100:00100000:1.0:1746142907.614146:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32256:x1830962867271296:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.614159:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.614169:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1b8 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.614204:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.614214:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.614224:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.614227:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142907.614229:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c600, rc 0) 00000100:00100000:1.0:1746142907.614267:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32256:x1830962867271296:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.614272:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14383 00000100:00100000:0.0:1746142907.617568:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.617591:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271424 00000100:00100000:0.0:1746142907.617602:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271424 00000100:00100000:0.0:1746142907.617637:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14384 00000100:00100000:0.0:1746142907.617644:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:32256:x1830962867271424:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142907.617658:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142907.617673:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccc60a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1bf expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.617738:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.617748:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.617757:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:0.0:1746142907.617779:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142907.617783:0:22383:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142907.617794:0:22383:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.617813:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccc60a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.617841:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.617848:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.617851:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142907.617853:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3f400, rc 0) 00000100:00100000:0.0:1746142907.617896:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:32256:x1830962867271424:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 251us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.617929:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14384 00000100:00100000:0.0:1746142907.621832:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.621870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.622412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.622467:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271680 00000100:00100000:1.0:1746142907.622475:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271680 00000100:00100000:0.0:1746142907.622480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.622488:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271936 00000100:00100000:1.0:1746142907.622490:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271936 00000100:00100000:0.0:1746142907.622492:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.622519:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.622524:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272192 00000100:00100000:1.0:1746142907.622525:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272192 00000100:00100000:1.0:1746142907.622534:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271552 00000100:00100000:1.0:1746142907.622536:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271552 00000100:00100000:1.0:1746142907.622543:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867271808 00000100:00100000:1.0:1746142907.622549:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867271808 00000100:00100000:2.0:1746142907.622551:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272064 00000100:00100000:2.0:1746142907.622555:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272064 00000100:00100000:1.0:1746142907.622561:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14006 00000100:00100000:1.0:1746142907.622567:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867271936:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:2.0:1746142907.622572:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14007 00000100:00100000:2.0:1746142907.622577:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867272192:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.622580:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.622584:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.622594:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1e9 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.622596:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1db expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142907.622611:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406bc, atime: 0x681406bc, ctime: 0x681406bc, blocks: 0x1008 00002000:00010000:1.0:1746142907.622611:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406b9, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x808 00010000:00010000:2.0:1746142907.622625:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.622625:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.622626:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.622626:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.622632:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.622633:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.622644:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.622644:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.622652:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671400, rc 0) 00010000:00010000:1.0:1746142907.622652:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d200, rc 0) 00000100:00100000:2.0:1746142907.622685:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867272192:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.622686:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867271936:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 119us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.622690:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14007 00000100:00100000:1.0:1746142907.622693:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14006 00000100:00100000:1.0:1746142907.622703:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14008 00000100:00100000:1.0:1746142907.622706:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867271552:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.622810:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.622816:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1c6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.622826:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14009 00000100:00100000:2.0:1746142907.622833:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867271808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142907.622839:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.622847:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1d4 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142907.622856:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406b8, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x800 00010000:00010000:2.0:1746142907.622862:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.622864:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.622867:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.622875:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.622882:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670a00, rc 0) 00000100:00100000:2.0:1746142907.622897:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867271808:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 65us (404us total) trans 0 rc 0/0 00002000:00010000:1.0:1746142907.622967:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406b8, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x7f0 00010000:00010000:1.0:1746142907.622975:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.622976:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.622980:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.622992:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.622998:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d600, rc 0) 00000100:00100000:1.0:1746142907.623012:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867271552:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 305us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.623411:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14009 00000100:00100000:0.0:1746142907.623457:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14010 00000100:00100000:0.0:1746142907.623464:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867272064:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142907.623471:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142907.623478:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1e2 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142907.623488:0:1397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5032768, mtime: 0x681406bc, atime: 0x681406bb, ctime: 0x681406bb, blocks: 0x1670 00010000:00010000:0.0:1746142907.623496:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.623498:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.623501:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 15 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.623509:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 15 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.623515:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e800, rc 0) 00000100:00100000:1.0:1746142907.623529:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14008 00000100:00100000:0.0:1746142907.623531:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867272064:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 69us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.623536:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14010 00000100:00100000:1.0:1746142907.623560:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14011 00000100:00100000:1.0:1746142907.623564:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867271680:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142907.623570:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.623578:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1cd expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142907.623806:0:1852:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406b8, atime: 0x681406b9, ctime: 0x681406b9, blocks: 0x808 00010000:00010000:1.0:1746142907.623814:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.623816:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.623820:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.623828:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.623834:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3de00, rc 0) 00000100:00100000:1.0:1746142907.623849:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867271680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 285us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.623856:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14011 00000100:00100000:0.0:1746142907.630764:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.631373:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272448 00000100:00100000:2.0:1746142907.631380:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272448 00000100:00100000:2.0:1746142907.631472:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14385 00000100:00100000:2.0:1746142907.631479:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+7:32260:x1830962867272448:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142907.631499:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.631512:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1f0 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.631565:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631578:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631586:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631595:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631600:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631604:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631672:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631680:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.631686:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.631708:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.631718:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 8 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.631727:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130374e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867777280:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142907.631874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.632104:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.632125:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.632178:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.632228:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272576 00000100:00100000:3.0:1746142907.632232:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272576 00000100:00100000:0.0:1746142907.632619:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.632734:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.632813:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272832 00000100:00100000:3.0:1746142907.632816:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272832 00000100:00100000:1.0:1746142907.632840:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273088 00000100:00100000:1.0:1746142907.632842:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273088 00000100:00100000:1.0:1746142907.632862:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272704 00000100:00100000:1.0:1746142907.632863:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272704 00000100:00100000:1.0:1746142907.632880:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14012 00000100:00100000:1.0:1746142907.632885:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867272576:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142907.632965:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867272576:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 79us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.632971:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14012 00000100:00100000:1.0:1746142907.632985:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14013 00000100:00100000:1.0:1746142907.632990:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867272832:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142907.633022:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867272832:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 32us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.633027:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14013 00000100:00100000:1.0:1746142907.633036:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14014 00000100:00100000:1.0:1746142907.633039:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867273088:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142907.633064:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867273088:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 24us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.633068:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14014 00000100:00100000:1.0:1746142907.633077:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14015 00000100:00100000:1.0:1746142907.633082:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867272704:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142907.633104:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867272704:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.633109:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14015 00000100:00100000:0.0:1746142907.633346:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867272960 00000100:00100000:0.0:1746142907.633349:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867272960 00000100:00100000:3.0:1746142907.633368:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.633371:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14016 00000100:00100000:0.0:1746142907.633376:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867272960:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142907.633380:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273216 00000100:00100000:3.0:1746142907.633383:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273216 00000100:00100000:3.0:1746142907.633395:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14017 00000100:00100000:3.0:1746142907.633399:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867273216:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142907.633436:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867273216:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.633440:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14017 00000100:00100000:0.0:1746142907.633448:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867272960:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 70us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.633453:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14016 00000100:00100000:2.0:1746142907.633635:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867777280:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.633651:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:0.0:1746142907.634460:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.634497:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273344 00000100:00100000:3.0:1746142907.634501:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273344 00010000:00010000:3.0:1746142907.634520:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 9 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.634545:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6279 00000100:00100000:3.0:1746142907.634550:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867273344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.634558:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.634563:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 9 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.634571:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 9 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.634585:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccc5c4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b1 expref: 9 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.634864:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.634869:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.634875:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.634880:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.634919:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142907.634924:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.634930:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:3.0:1746142907.634940:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867273344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 390us (481us total) trans 0 rc 0/0 00000004:00200000:0.0:1746142907.634941:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000100:00100000:3.0:1746142907.634946:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6279 00010000:00010000:0.0:1746142907.635009:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635015:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635020:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635025:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e670c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.635028:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635034:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635041:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.635043:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142907.635046:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635050:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccc657 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635064:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635079:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635087:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635091:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635095:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e670200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.635097:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635101:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635108:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142907.635109:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142907.635111:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635115:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635122:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635127:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635131:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635135:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e671a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142907.635137:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635145:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635150:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098b3e400) 00010000:00010000:0.0:1746142907.635151:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142907.635154:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635158:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:0.0:1746142907.635191:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc642 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1f0 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.635197:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1f0 expref: 9 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.635203:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671c00, rc 0) 00000100:00100000:0.0:1746142907.635237:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:32260:x1830962867272448:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3759us (4482us total) trans 8589936533 rc 301/301 00000100:00100000:0.0:1746142907.635243:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14385 00000100:00100000:0.0:1746142907.639017:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.639398:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.639727:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.639755:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273472 00000100:00100000:0.0:1746142907.639763:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273472 00000100:00100000:0.0:1746142907.639806:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273600 00000100:00100000:0.0:1746142907.639809:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273600 00000100:00100000:0.0:1746142907.639820:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273728 00000100:00100000:0.0:1746142907.639822:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273728 00000100:00100000:0.0:1746142907.639833:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14018 00000100:00100000:3.0:1746142907.639839:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14019 00000100:00100000:0.0:1746142907.639839:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867273472:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142907.639845:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867273600:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142907.639938:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867273600:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 92us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.639943:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14019 00000100:00100000:3.0:1746142907.639954:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14020 00000100:00100000:3.0:1746142907.639958:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867273728:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142907.640149:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088323450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867273728:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 189us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.640154:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14020 00000100:00100000:2.0:1746142907.640207:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.640220:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273856 00000100:00100000:2.0:1746142907.640223:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273856 00000100:00100000:2.0:1746142907.640239:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14021 00000100:00100000:2.0:1746142907.640244:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867273856:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142907.640263:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867273472:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 423us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.640268:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14018 00000100:00100000:2.0:1746142907.640270:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867273856:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 27us (64us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.640274:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14021 00000100:00100000:2.0:1746142907.640315:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.640323:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867273984 00000100:00100000:2.0:1746142907.640325:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867273984 00000100:00100000:2.0:1746142907.640344:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14022 00000100:00100000:2.0:1746142907.640348:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867273984:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142907.640375:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867273984:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 27us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.640378:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.640379:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14022 00000100:00100000:2.0:1746142907.640654:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867274112 00000100:00100000:2.0:1746142907.640657:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867274112 00000100:00100000:3.0:1746142907.640886:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14023 00000100:00100000:3.0:1746142907.640891:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867274112:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142907.640940:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867274112:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 49us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.640947:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14023 00000100:00100000:0.0:1746142907.647363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.647527:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867274240 00000100:00100000:3.0:1746142907.647534:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867274240 00000100:00100000:3.0:1746142907.647576:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14024 00000100:00100000:3.0:1746142907.647583:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867274240:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:3.0:1746142907.647731:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142907.647734:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.647735:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142907.647737:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.647739:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142907.647774:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867274240:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 192us (420us total) trans 17179873899 rc 0/0 00000100:00100000:3.0:1746142907.647780:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14024 00000100:00100000:0.0:1746142907.649755:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.649802:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867274496 00000100:00100000:2.0:1746142907.649809:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867274496 00000100:00100000:2.0:1746142907.649850:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14386 00000100:00100000:2.0:1746142907.649856:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32264:x1830962867274496:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.649873:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.649889:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670600/0x2fa243e067ccc665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1f7 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.649978:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.649989:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.649997:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650007:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650012:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650017:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650082:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650089:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650094:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:2.0:1746142907.650101:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142907.650141:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650146:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650151:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650155:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e670200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142907.650157:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650162:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650169:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.650171:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142907.650174:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650178:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670200/0x2fa243e067ccc67a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650198:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650203:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650207:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650212:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650216:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e671c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142907.650218:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650226:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650232:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142907.650234:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142907.650236:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650240:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc66c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650247:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650251:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650256:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650259:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e671a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142907.650261:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650265:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650270:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880098b3ee00) 00010000:00010000:2.0:1746142907.650272:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142907.650273:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650277:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671a00/0x2fa243e067ccc673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142907.650302:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670600/0x2fa243e067ccc665 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1f7 expref: 28 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.650309:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670600/0x2fa243e067ccc665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1f7 expref: 28 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.650315:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670600, rc 0) 00000100:00100000:2.0:1746142907.650351:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32264:x1830962867274496:12345-192.168.204.50@tcp:101:cat.0 Request processed in 494us (601us total) trans 8589936534 rc 301/301 00000100:00100000:2.0:1746142907.650356:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14386 00000100:00100000:0.0:1746142907.653281:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.653328:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867274624 00000100:00100000:2.0:1746142907.653336:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867274624 00000100:00100000:2.0:1746142907.653872:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14025 00000100:00100000:2.0:1746142907.653881:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867274624:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:2.0:1746142907.654049:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142907.654052:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142907.654053:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142907.654055:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142907.654057:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142907.654106:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867274624:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 225us (829us total) trans 21474841160 rc 0/0 00000100:00100000:2.0:1746142907.654111:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14025 00000100:00100000:0.0:1746142907.656583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.656643:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867274752 00000100:00100000:1.0:1746142907.656651:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867274752 00000100:00100000:1.0:1746142907.656695:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14387 00000100:00100000:1.0:1746142907.656702:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32264:x1830962867274752:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142907.656721:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.656735:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccc688 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a1fe expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.656804:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.656816:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.656825:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:1.0:1746142907.656850:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142907.656853:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142907.656865:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.656883:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067ccc688 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.656933:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.656940:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.656943:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142907.656945:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c400, rc 0) 00000100:00100000:1.0:1746142907.656985:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32264:x1830962867274752:12345-192.168.204.50@tcp:101:cat.0 Request processed in 283us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.656990:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14387 00000100:00100000:0.0:1746142907.663417:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.663462:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.663486:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.663497:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.663510:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.663530:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.663597:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867275136 00000100:00100000:3.0:1746142907.663605:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867275136 00000100:00100000:3.0:1746142907.663649:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867275392 00000100:00100000:3.0:1746142907.663651:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867275392 00000100:00100000:3.0:1746142907.663663:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867275520 00000100:00100000:3.0:1746142907.663665:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867275520 00000100:00100000:3.0:1746142907.663674:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867275776 00000100:00100000:3.0:1746142907.663676:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867275776 00000100:00100000:3.0:1746142907.663699:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867276160 00000100:00100000:3.0:1746142907.663704:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867276160 00000100:00100000:3.0:1746142907.663722:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4243 00000100:00100000:3.0:1746142907.663729:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867275136:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142907.663760:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.663778:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.663779:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.663783:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.663795:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.664134:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4244 00000100:00100000:0.0:1746142907.664140:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962867275392:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142907.664154:0:29473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.664161:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.664162:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.664164:0:29473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.664171:0:29473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.664523:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4245 00000100:00100000:1.0:1746142907.664531:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962867275520:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142907.664544:0:20333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.664550:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.664551:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.664553:0:20333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.664559:0:20333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.664688:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4246 00000100:00100000:2.0:1746142907.664695:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867275776:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142907.664709:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.664716:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.664717:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.664720:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.664727:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.665305:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4247 00000100:00100000:2.0:1746142907.665312:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c8243383-433c-45fe-9bef-8828afa9ff81+19:2004:x1830962867276160:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142907.665324:0:9584:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.665330:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.665331:0:9584:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.665334:0:9584:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.665339:0:9584:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.666359:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.666402:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867276416 00000100:00100000:1.0:1746142907.666408:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867276416 00000100:00100000:1.0:1746142907.666448:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4248 00000100:00100000:1.0:1746142907.666453:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c8243383-433c-45fe-9bef-8828afa9ff81+22:2004:x1830962867276416:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142907.666467:0:20331:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.666473:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.666474:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.666476:0:20331:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.666484:0:20331:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.666640:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867275904 00000100:00100000:3.0:1746142907.666643:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867275904 00000100:00100000:3.0:1746142907.666668:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14026 00000100:00100000:3.0:1746142907.666673:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867275904:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.666681:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.666690:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a205 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.666701:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.666702:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.666707:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 39 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.666716:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 39 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.666724:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714400, rc 0) 00000100:00100000:3.0:1746142907.666747:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867275904:12345-192.168.204.50@tcp:101:cat.0 Request processed in 74us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.666755:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14026 00000100:00100000:1.0:1746142907.671039:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.671473:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.671501:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.671522:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867276544 00000100:00100000:1.0:1746142907.671529:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867276544 00000100:00100000:1.0:1746142907.672225:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867276672 00000100:00100000:1.0:1746142907.672229:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867276672 00000100:00100000:2.0:1746142907.672278:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867276800 00000100:00100000:2.0:1746142907.672282:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867276800 00000100:00100000:2.0:1746142907.672302:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14027 00000100:00100000:2.0:1746142907.672308:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867276544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.672323:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.672336:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a20c expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.672336:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142907.672355:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.672356:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.672364:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 39 pid: 9579 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142907.672376:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867276928 00010000:00010000:2.0:1746142907.672376:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 39 pid: 9579 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142907.672379:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867276928 00010000:00010000:2.0:1746142907.672385:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671a00, rc 0) 00000100:00100000:3.0:1746142907.672389:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14028 00000100:00100000:3.0:1746142907.672395:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867276672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.672400:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.672406:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a213 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.672416:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.672417:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.672429:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.672438:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.672444:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715600, rc 0) 00000100:00100000:3.0:1746142907.672464:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867276672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 69us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.672469:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14028 00000100:00100000:3.0:1746142907.672484:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14029 00000100:00100000:3.0:1746142907.672488:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867276800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.672493:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.672502:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a21a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.672516:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.672517:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.672520:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.672528:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.672533:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601800, rc 0) 00000100:00100000:3.0:1746142907.672544:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867276800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 56us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.672548:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14029 00000100:00100000:3.0:1746142907.672569:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14030 00000100:00100000:3.0:1746142907.672573:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867276928:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.672577:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.672582:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a221 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.672590:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.672591:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.672594:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.672601:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.672610:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130ab4200, rc 0) 00000100:00100000:3.0:1746142907.672618:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867276928:12345-192.168.204.50@tcp:101:cat.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.672622:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14030 00000100:00100000:1.0:1746142907.672685:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.672695:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867277056 00000100:00100000:1.0:1746142907.672698:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867277056 00000100:00100000:1.0:1746142907.672723:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14031 00000100:00100000:1.0:1746142907.672728:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867277056:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142907.672735:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.672741:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a228 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.672749:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.672750:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.672754:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.672761:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.672771:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3cc00, rc 0) 00000100:00100000:1.0:1746142907.672782:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867277056:12345-192.168.204.50@tcp:101:cat.0 Request processed in 55us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.672786:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14031 00000100:00100000:1.0:1746142907.672822:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.672842:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.672896:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.672923:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867277696 00000100:00100000:1.0:1746142907.672926:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867277696 00000100:00100000:1.0:1746142907.672954:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14388 00000100:00100000:1.0:1746142907.672960:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:32260:x1830962867277696:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142907.672970:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.672980:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccc6ea lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a22f expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.673013:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccc6ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a22f expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.673022:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccc6ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a22f expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.673034:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.673036:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142907.673039:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097420e00, rc 0) 00000100:00100000:1.0:1746142907.673054:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:32260:x1830962867277696:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 94us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.673061:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14388 00000100:00100000:3.0:1746142907.673162:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867277440 00000100:00100000:3.0:1746142907.673166:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867277440 00000100:00100000:3.0:1746142907.673190:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867277568 00000100:00100000:3.0:1746142907.673192:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867277568 00000100:00100000:3.0:1746142907.673205:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4249 00000100:00100000:3.0:1746142907.673209:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+24:2004:x1830962867277440:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142907.673223:0:13318:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.673230:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.673231:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.673234:0:13318:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.673241:0:13318:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.673619:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867276544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1309us (2585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.673625:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14027 00000100:00100000:2.0:1746142907.673647:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4250 00000100:00100000:2.0:1746142907.673653:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+21:2004:x1830962867277568:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142907.673667:0:9583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.673674:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.673675:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.673678:0:9583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.673685:0:9583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678778:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678792:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678799:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678804:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e670000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142907.678808:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678814:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678829:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.678834:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e670000/0x2fa243e067ccc6ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.678915:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+21:2003:x1830962867275776:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 14203us (15399us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.678924:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4246 00010000:00010000:2.0:1746142907.682826:0:9584:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.682840:0:9584:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.682852:0:9584:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.682857:0:9584:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e670400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142907.682860:0:9584:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.682866:0:9584:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.682881:0:9584:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.682886:0:9584:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e670400/0x2fa243e067ccc6b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9584 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.682977:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c8243383-433c-45fe-9bef-8828afa9ff81+19:2004:x1830962867276160:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 17662us (19442us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.682986:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4247 00010000:00010000:1.0:1746142907.692798:0:20333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.692813:0:20333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.692820:0:20333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.692826:0:20333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3c200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142907.692829:0:20333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.692834:0:20333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.692849:0:20333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.692854:0:20333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c200/0x2fa243e067ccc6a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.692975:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+24:2003:x1830962867275520:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 28441us (29483us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142907.692983:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4245 00010000:00010000:0.0:1746142907.695293:0:29473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.695306:0:29473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.695312:0:29473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.695317:0:29473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd3e400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142907.695320:0:29473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.695326:0:29473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.695338:0:29473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.695343:0:29473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e400/0x2fa243e067ccc69d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.695412:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+22:2003:x1830962867275392:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 31269us (31945us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142907.695432:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4244 00000100:00100000:0.0:1746142907.700618:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.700652:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.700679:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867277952 00000100:00100000:1.0:1746142907.700689:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867277952 00002000:00100000:1.0:1746142907.700726:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009a358380 x1830962867277952/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.700736:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358380 with x1830962867277952 ext(0->1048575) 00002000:00010000:1.0:1746142907.700741:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a358380 00010000:00010000:3.0:1746142907.700758:0:29472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.700758:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867278208 00000100:00100000:1.0:1746142907.700760:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867278208 00010000:00010000:3.0:1746142907.700769:0:29472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746142907.700771:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009a358700 x1830962867278208/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.700778:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358700 with x1830962867278208 ext(1048576->2097151) 00010000:00010000:3.0:1746142907.700781:0:29472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142907.700781:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a358700 00010000:00010000:3.0:1746142907.700786:0:29472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0a0000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.700790:0:29472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.700791:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4251 00010000:00010000:3.0:1746142907.700796:0:29472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.700798:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867277952:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142907.700811:0:29472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.700817:0:29472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067ccc696 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.700879:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867275136:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 37150us (37468us total) trans 0 rc 1036288/1036288 00000100:00100000:3.0:1746142907.700886:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4243 00000100:00100000:3.0:1746142907.700941:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4252 00000100:00100000:3.0:1746142907.700948:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867278208:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.703127:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.703155:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.704526:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867278464 00000100:00100000:2.0:1746142907.704526:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867278720 00000100:00100000:3.0:1746142907.704534:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867278464 00000100:00100000:2.0:1746142907.704534:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867278720 00002000:00100000:3.0:1746142907.704567:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009a358a80 x1830962867278464/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.704567:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880091de2d80 x1830962867278720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.704576:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2d80 with x1830962867278720 ext(1048576->2097151) 00010000:00010000:1.0:1746142907.704577:0:20331:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746142907.704580:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358a80 with x1830962867278464 ext(1048576->2097151) 00002000:00010000:2.0:1746142907.704580:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de2d80 00002000:00010000:3.0:1746142907.704583:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a358a80 00010000:00010000:1.0:1746142907.704587:0:20331:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.704594:0:20331:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.704599:0:20331:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3ce00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142907.704602:0:20331:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.704607:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4253 00010000:00010000:1.0:1746142907.704609:0:20331:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.704615:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867278720:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1746142907.704625:0:20331:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.704630:0:20331:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3ce00/0x2fa243e067ccc6b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142907.704682:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:2004:x1830962867276416:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 38227us (38323us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142907.704689:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4248 00000100:00100000:1.0:1746142907.704704:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4254 00000100:00100000:1.0:1746142907.704710:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867278464:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.705379:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.705441:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867278976 00000100:00100000:3.0:1746142907.705445:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867278976 00000100:00100000:3.0:1746142907.706018:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14389 00000100:00100000:3.0:1746142907.706026:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32266:x1830962867278976:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142907.706037:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.706051:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969200/0x2fa243e067ccc6ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a236 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.706303:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706314:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706322:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706333:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706338:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706343:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706427:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706438:0:22383:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706443:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:3.0:1746142907.706450:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142907.706498:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706503:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706506:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706510:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cc79c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.706513:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706516:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706523:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.706525:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142907.706528:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706532:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccc714 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706543:0:22383:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706550:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706554:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706558:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706561:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a969000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.706563:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706568:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706572:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142907.706574:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.706576:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706579:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969000/0x2fa243e067ccc706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706585:0:22383:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706589:0:22383:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706593:0:22383:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706596:0:22383:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a969800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142907.706599:0:22383:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706603:0:22383:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706607:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd400) 00010000:00010000:3.0:1746142907.706609:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142907.706610:0:22383:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706615:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969800/0x2fa243e067ccc70d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142907.706642:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969200/0x2fa243e067ccc6ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a236 expref: 30 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.706649:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a969200/0x2fa243e067ccc6ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a236 expref: 30 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.706655:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a969200, rc 0) 00000100:00100000:3.0:1746142907.706679:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32266:x1830962867278976:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 655us (1302us total) trans 8589936535 rc 301/301 00000100:00100000:3.0:1746142907.706684:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14389 00010000:00010000:3.0:1746142907.708768:0:13318:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.708780:0:13318:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.708788:0:13318:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.708795:0:13318:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130ab5400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.708799:0:13318:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.708805:0:13318:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.708819:0:13318:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.708823:0:13318:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130ab5400/0x2fa243e067ccc6f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.708873:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+18:2004:x1830962867277440:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 35660us (36047us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142907.708881:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4249 00000100:00100000:0.0:1746142907.720639:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.723075:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867279232 00000100:00100000:2.0:1746142907.723086:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867279232 00000100:00100000:2.0:1746142907.723136:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14390 00000100:00100000:2.0:1746142907.723144:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:32260:x1830962867279232:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142907.723161:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.723164:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142907.723191:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccc6ea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a22f expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723214:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.723218:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142907.723227:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d8000/0x2fa243e067ccc722 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a23d expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723263:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.723273:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 7 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723279:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723285:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723289:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.723317:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723326:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 7 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.723335:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130375c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867777408:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142907.723379:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.723388:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.723394:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.723399:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e671c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142907.723403:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.723410:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.723429:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723431:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.723435:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e671c00/0x2fa243e067ccc6f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723439:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 28 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.723446:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867777536:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.723469:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 7 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.723476:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 7 pid: 22383 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.723482:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867777664:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142907.723500:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867277568:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 49847us (50656us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.723500:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.723507:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4250 00000100:00100000:1.0:1746142907.724651:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867277952:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23850us (24039us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142907.724660:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4251 00002000:00100000:1.0:1746142907.724673:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009a358380 x1830962867277952/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.724682:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358380 with x1830962867277952 ext(0->1048575) 00002000:00010000:1.0:1746142907.724686:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a358380 00000100:00100000:3.0:1746142907.726149:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867278208:12345-192.168.204.50@tcp:3:cat.0 Request processed in 25193us (25487us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142907.726157:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4252 00002000:00100000:3.0:1746142907.726164:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009a358700 x1830962867278208/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.726171:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358700 with x1830962867278208 ext(1048576->2097151) 00002000:00010000:3.0:1746142907.726175:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a358700 00000100:00100000:0.0:1746142907.739935:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.739945:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130375c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867777408:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.739954:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867777536:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.739961:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867777664:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142907.739985:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142907.740060:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867279488 00000100:00100000:3.0:1746142907.740066:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867279488 00010000:00010000:3.0:1746142907.740092:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 29 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:3.0:1746142907.740129:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6280 00000100:00100000:3.0:1746142907.740136:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867279488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.740146:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142907.740152:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 29 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.740166:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 29 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.740188:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067ccc68f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1fe expref: 29 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:3.0:1746142907.740213:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.740220:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.740227:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.740231:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142907.740468:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867279488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 332us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.740472:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.740474:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6280 00000100:00100000:1.0:1746142907.740486:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867279360 00000100:00100000:1.0:1746142907.740490:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867279360 00010000:00010000:1.0:1746142907.740503:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 8 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:1.0:1746142907.740530:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6281 00000100:00100000:1.0:1746142907.740537:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b7b43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867279360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142907.740543:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142907.740544:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142907.740547:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 8 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.740554:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 8 pid: 10924 timeout: 781 lvb_type: 0 00000100:00100000:0.0:1746142907.740559:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867279616 00000100:00100000:0.0:1746142907.740562:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867279616 00010000:00010000:1.0:1746142907.740565:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccc603 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1b8 expref: 9 pid: 10924 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.740574:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 8 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.740577:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.740580:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.740585:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142907.740589:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.740590:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6282 00000100:00100000:0.0:1746142907.740594:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867279616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.740599:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.740602:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 8 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.740609:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 8 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.740620:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3f400/0x2fa243e067ccc611 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1bf expref: 8 pid: 22383 timeout: 781 lvb_type: 0 00010000:00010000:0.0:1746142907.740642:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142907.740646:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.740655:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.740660:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142907.740672:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142907.740716:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142907.740721:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000040:00080000:3.0:1746142907.740936:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].617, 88 off62008 00000004:00080000:3.0:1746142907.740942:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740041865ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.740964:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].687, 88 off68264 00000004:00080000:3.0:1746142907.740967:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740067583ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.740978:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].688, 88 off68352 00000004:00080000:3.0:1746142907.740980:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740080648ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.740988:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].618, 88 off62096 00000004:00080000:3.0:1746142907.740991:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740090824ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.740998:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].619, 88 off62184 00000004:00080000:3.0:1746142907.741000:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740100077ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.741007:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].689, 88 off68440 00000004:00080000:3.0:1746142907.741009:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740109409ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741015:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].690, 88 off68528 00000004:00080000:3.0:1746142907.741018:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740118190ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741024:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].620, 88 off62272 00000004:00080000:3.0:1746142907.741027:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740127047ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.741033:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].691, 88 off68616 00000004:00080000:3.0:1746142907.741036:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740135898ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741043:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].621, 88 off62360 00000004:00080000:3.0:1746142907.741046:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740146080ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.741054:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].692, 88 off68704 00000004:00080000:3.0:1746142907.741056:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740155830ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741063:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].622, 88 off62448 00000004:00080000:3.0:1746142907.741065:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740165564ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.741073:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].693, 88 off68792 00000004:00080000:3.0:1746142907.741075:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740175030ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741083:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].623, 88 off62536 00000004:00080000:3.0:1746142907.741085:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740185243ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142907.741092:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].694, 88 off68880 00000004:00080000:3.0:1746142907.741094:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740194465ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741102:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].695, 88 off68968 00000004:00080000:3.0:1746142907.741105:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681740205013ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142907.741113:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].624, 88 off62624 00000004:00080000:3.0:1746142907.741115:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681740215250ns, next at 629431245375ns, rc = 0 00000100:00100000:1.0:1746142907.741470:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b7b43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867279360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 931us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.741476:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6281 00000100:00100000:0.0:1746142907.741632:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+6:2006:x1830962867279616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1034us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.741638:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6282 00000100:00100000:2.0:1746142907.742615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.742641:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.742763:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867278720:12345-192.168.204.50@tcp:3:cat.0 Request processed in 38148us (39605us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.742770:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4253 00002000:00100000:2.0:1746142907.742777:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880091de2d80 x1830962867278720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.742786:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2d80 with x1830962867278720 ext(1048576->2097151) 00002000:00010000:2.0:1746142907.742790:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de2d80 00000100:00100000:0.0:1746142907.742818:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867279872 00000100:00100000:0.0:1746142907.742824:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867279872 00000100:00100000:0.0:1746142907.742853:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280000 00000100:00100000:0.0:1746142907.742855:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280000 00000100:00100000:2.0:1746142907.742862:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14391 00000100:00100000:2.0:1746142907.742870:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+6:32256:x1830962867279872:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1746142907.743700:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142907.743711:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142907.743717:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142907.743729:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10924 initiator: MDT0 00000100:00100000:1.0:1746142907.743763:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14392 00000100:00100000:1.0:1746142907.743770:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32264:x1830962867280000:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142907.743779:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.743787:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a244 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.743814:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.743823:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.743832:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.743834:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142907.743837:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.743843:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131323000, rc 0) 00000001:00080000:3.0:1746142907.744162:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936536 is committed 00000004:00080000:3.0:1746142907.744167:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 613 committed 00000004:00080000:3.0:1746142907.744174:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 684 committed 00000004:00080000:3.0:1746142907.744177:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 683 committed 00000004:00080000:3.0:1746142907.744179:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 612 committed 00000004:00080000:3.0:1746142907.744181:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 682 committed 00000004:00080000:3.0:1746142907.744182:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 611 committed 00000004:00080000:3.0:1746142907.744183:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 681 committed 00000004:00080000:3.0:1746142907.744185:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 610 committed 00000004:00080000:3.0:1746142907.744186:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 680 committed 00000004:00080000:3.0:1746142907.744187:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 609 committed 00000004:00080000:3.0:1746142907.744188:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 679 committed 00000004:00080000:3.0:1746142907.744189:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 678 committed 00000004:00080000:3.0:1746142907.744192:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 608 committed 00000004:00080000:3.0:1746142907.744193:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 607 committed 00000004:00080000:3.0:1746142907.744194:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 677 committed 00000004:00080000:3.0:1746142907.744195:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 676 committed 00000004:00080000:3.0:1746142907.744197:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 606 committed 00000001:00080000:3.0:1746142907.744199:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936535 is committed 00000100:00100000:3.0:1746142907.744296:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867778048:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746142907.744303:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746142907.744327:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867778176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.744330:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.744352:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142907.744364:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867778560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.744366:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867778688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.744381:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746142907.744440:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.744448:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746142907.744451:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.744453:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746142907.744455:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142907.744460:0:10924:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746142907.744463:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779200:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746142907.744464:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142907.744469:0:10924:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.744474:0:10924:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.744479:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.744480:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.744491:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779712:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746142907.744494:0:10924:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.744501:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867779840:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142907.744504:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.744514:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746142907.744518:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.744531:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.744540:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.744550:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.744566:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778048 00000100:00100000:2.0:1746142907.744569:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778048 00000100:00100000:2.0:1746142907.744587:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778176 00000100:00100000:2.0:1746142907.744589:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778176 00000100:00100000:2.0:1746142907.744599:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778560 00000100:00100000:2.0:1746142907.744600:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778560 00000100:00100000:2.0:1746142907.744606:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778688 00000100:00100000:2.0:1746142907.744607:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778688 00000100:00100000:2.0:1746142907.744612:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779200 00000100:00100000:2.0:1746142907.744613:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779200 00000100:00100000:2.0:1746142907.744618:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779712 00000100:00100000:2.0:1746142907.744619:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779712 00000100:00100000:2.0:1746142907.744624:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779072 00000100:00100000:2.0:1746142907.744625:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779072 00000100:00100000:2.0:1746142907.744630:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779584 00000100:00100000:2.0:1746142907.744632:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779584 00000100:00100000:2.0:1746142907.744639:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14032 00000100:00100000:2.0:1746142907.744644:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3762:x1830962867778048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142907.744724:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:2.0:1746142907.744727:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142908 -> 1746142908 00002000:00010000:2.0:1746142907.744728:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142907 -> 1746142907 00002000:00010000:2.0:1746142907.744730:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142907 -> 1746142907 00002000:00010000:2.0:1746142907.744732:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:2.0:1746142907.744751:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+65:3762:x1830962867778048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (421us total) trans 21474841161 rc 0/0 00000100:00100000:2.0:1746142907.744757:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14032 00000100:00100000:3.0:1746142907.745142:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.745161:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32264:x1830962867280000:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1390us (2517us total) trans 0 rc 0/0 00000004:00080000:3.0:1746142907.745165:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bcd180/2, rc 0, transno 21474841161 00000100:00100000:1.0:1746142907.745168:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14392 00000100:00100000:3.0:1746142907.745170:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867778048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.745182:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14033 00000100:00100000:3.0:1746142907.745188:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:3763:x1830962867778176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.745188:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14034 00000100:00100000:1.0:1746142907.745192:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3762:x1830962867778560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.745234:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14035 00002000:00010000:1.0:1746142907.745247:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142907.745249:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142907.745251:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142907.745252:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142907.745254:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:3.0:1746142907.745271:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:3763:x1830962867778176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (919us total) trans 21474841163 rc 0/0 00000100:00100000:3.0:1746142907.745276:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14033 00000100:00100000:1.0:1746142907.745277:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3762:x1830962867778560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (895us total) trans 21474841162 rc 0/0 00000100:00100000:1.0:1746142907.745282:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14034 00000100:00100000:3.0:1746142907.745286:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14036 00000100:00100000:3.0:1746142907.745290:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+71:3763:x1830962867779200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.745292:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14037 00000100:00100000:1.0:1746142907.745296:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:3763:x1830962867779712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.745334:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14038 00000100:00100000:1.0:1746142907.745338:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3763:x1830962867779072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142907.745342:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142907.745345:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.745346:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142907.745348:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142907.745350:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142907.745365:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3763:x1830962867779200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (884us total) trans 17179873901 rc 0/0 00000100:00100000:3.0:1746142907.745369:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14036 00002000:00010000:1.0:1746142907.745372:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142907.745374:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142908 -> 1746142908 00002000:00010000:1.0:1746142907.745375:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142908 -> 1746142908 00000100:00100000:3.0:1746142907.745377:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14039 00002000:00010000:1.0:1746142907.745377:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142908 -> 1746142908 00002000:00010000:1.0:1746142907.745378:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746142907.745381:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3763:x1830962867779584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.745394:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3763:x1830962867779072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (863us total) trans 17179873902 rc 0/0 00000100:00100000:1.0:1746142907.745399:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14038 00000100:00100000:3.0:1746142907.745433:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3763:x1830962867779584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (881us total) trans 17179873903 rc 0/0 00002000:00010000:1.0:1746142907.745436:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00000100:00100000:3.0:1746142907.745437:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14039 00002000:00010000:1.0:1746142907.745438:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142907.745440:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142907.745441:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142907.745443:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000004:00080000:3.0:1746142907.745457:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1f80/2, rc 0, transno 17179873902 00000100:00100000:1.0:1746142907.745460:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+72:3763:x1830962867779712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (955us total) trans 17179873900 rc 0/0 00000100:00100000:3.0:1746142907.745464:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.745465:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14037 00000004:00080000:3.0:1746142907.745469:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097430000/2, rc 0, transno 17179873903 00000100:00100000:3.0:1746142907.745472:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142907.745477:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1880/2, rc 0, transno 17179873901 00000100:00100000:3.0:1746142907.745480:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779200:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142907.745485:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097432300/2, rc 0, transno 17179873900 00000100:00100000:3.0:1746142907.745487:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867779712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142907.745493:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644f480/2, rc 0, transno 21474841163 00000100:00100000:3.0:1746142907.745495:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867778176:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142907.745505:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbf6a00/2, rc 0, transno 21474841162 00000100:00100000:3.0:1746142907.745507:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867778560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.745530:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3763:x1830962867778688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142907.745582:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3763:x1830962867778688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 344us (1134us total) trans 21474841164 rc 0/0 00000100:00100000:3.0:1746142907.745587:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14035 00000004:00080000:3.0:1746142907.745600:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbf4000/2, rc 0, transno 21474841164 00000100:00100000:3.0:1746142907.745603:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867778688:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746142907.745623:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142907.745630:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00010000:3.0:1746142907.745684:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880088fd8a80 reply state ffff88009cec5000 transno 8589936537 ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142907.745694:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142907.745700:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142907.745702:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746142907.745704:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746142907.745744:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:32256:x1830962867279872:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 2875us (3130us total) trans 8589936537 rc 0/0 00000100:00100000:3.0:1746142907.745749:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14391 00000100:00100000:2.0:1746142907.745878:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867777792:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.745921:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.745933:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867778304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.745948:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.745956:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867778816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.745967:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.745976:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867779328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.745987:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.745995:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867779968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142907.746007:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142907.746025:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867777792 00000100:00100000:2.0:1746142907.746028:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867777792 00000100:00100000:1.0:1746142907.746068:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867777920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.746088:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142907.746099:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867778432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142907.746111:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142907.746120:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867778944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.746132:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142907.746136:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778304 00000100:00100000:1.0:1746142907.746140:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867779456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.746140:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778304 00000100:00100000:1.0:1746142907.746153:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142907.746180:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778816 00000100:00100000:1.0:1746142907.746183:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778816 00000100:00100000:0.0:1746142907.746230:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779328 00000100:00100000:0.0:1746142907.746232:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779328 00000100:00100000:2.0:1746142907.746233:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779968 00000100:00100000:2.0:1746142907.746236:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779968 00000100:00100000:0.0:1746142907.746239:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867777920 00000100:00100000:0.0:1746142907.746240:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867777920 00000100:00100000:2.0:1746142907.746246:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778944 00000100:00100000:0.0:1746142907.746246:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867778432 00000100:00100000:0.0:1746142907.746247:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778432 00000100:00100000:2.0:1746142907.746248:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867778944 00000100:00100000:0.0:1746142907.746252:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867779456 00000100:00100000:0.0:1746142907.746254:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867779456 00000100:00100000:2.0:1746142907.746256:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14040 00000100:00100000:2.0:1746142907.746261:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3764:x1830962867777792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142907.746262:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14041 00000100:00100000:0.0:1746142907.746266:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3764:x1830962867778304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142907.746312:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142907.746315:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:2.0:1746142907.746316:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:2.0:1746142907.746318:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:2.0:1746142907.746319:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142907.746343:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:3764:x1830962867777792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (422us total) trans 21474841165 rc 0/0 00000100:00100000:0.0:1746142907.746346:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3764:x1830962867778304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (396us total) trans 21474841166 rc 0/0 00000100:00100000:2.0:1746142907.746348:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14040 00000100:00100000:0.0:1746142907.746351:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14041 00000100:00100000:2.0:1746142907.746358:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14042 00000100:00100000:0.0:1746142907.746361:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14043 00000100:00100000:2.0:1746142907.746363:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3764:x1830962867779328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.746365:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3764:x1830962867779968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142907.746402:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746142907.746404:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142907.746406:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142907.746407:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142907.746409:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:0.0:1746142907.746439:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3764:x1830962867779968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (431us total) trans 17179873905 rc 0/0 00000100:00100000:2.0:1746142907.746442:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3764:x1830962867779328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (454us total) trans 17179873904 rc 0/0 00000100:00100000:0.0:1746142907.746444:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14043 00000100:00100000:2.0:1746142907.746447:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14042 00000100:00100000:0.0:1746142907.746453:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14044 00000100:00100000:2.0:1746142907.746457:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14045 00000100:00100000:0.0:1746142907.746457:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3765:x1830962867777920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142907.746462:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3765:x1830962867778432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142907.746492:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142907.746494:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142907.746496:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142907.746497:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142907.746499:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142907.746511:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:3765:x1830962867778432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (399us total) trans 21474841168 rc 0/0 00000100:00100000:2.0:1746142907.746518:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14045 00000100:00100000:0.0:1746142907.746519:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+70:3765:x1830962867777920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (429us total) trans 21474841167 rc 0/0 00000100:00100000:0.0:1746142907.746523:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14044 00000100:00100000:2.0:1746142907.746527:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14046 00000100:00100000:2.0:1746142907.746531:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3765:x1830962867778944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.746533:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14047 00000100:00100000:0.0:1746142907.746536:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3765:x1830962867779456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142907.746565:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142907.746567:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:2.0:1746142907.746569:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:0.0:1746142907.746570:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142907.746571:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:2.0:1746142907.746572:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746142907.746572:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142907.746573:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142907.746575:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142907.746576:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:2.0:1746142907.746590:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+78:3765:x1830962867778944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (457us total) trans 17179873906 rc 0/0 00000100:00100000:0.0:1746142907.746592:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3765:x1830962867779456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (439us total) trans 17179873907 rc 0/0 00000100:00100000:2.0:1746142907.746595:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14046 00000100:00100000:0.0:1746142907.746597:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14047 00000004:00080000:2.0:1746142907.746615:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bcc380/2, rc 0, transno 21474841165 00000100:00100000:2.0:1746142907.746618:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867777792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142907.746624:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644ce00/2, rc 0, transno 21474841166 00000100:00100000:2.0:1746142907.746627:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867778304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142907.746632:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2a00/2, rc 0, transno 17179873904 00000100:00100000:2.0:1746142907.746635:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867779328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142907.746640:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dbf5c00/2, rc 0, transno 17179873905 00000100:00100000:2.0:1746142907.746643:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867779968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142907.746726:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14048 00000100:00100000:1.0:1746142907.746731:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3764:x1830962867778816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142907.746770:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142907.746772:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142904 -> 1746142904 00002000:00010000:1.0:1746142907.746774:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142907.746775:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142905 -> 1746142905 00002000:00010000:1.0:1746142907.746777:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142907.746797:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3764:x1830962867778816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (828us total) trans 17179873908 rc 0/0 00000100:00100000:1.0:1746142907.746802:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14048 00000004:00080000:1.0:1746142907.746824:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bce300/2, rc 0, transno 21474841167 00000100:00100000:1.0:1746142907.746827:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867777920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142907.746833:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644c700/2, rc 0, transno 21474841168 00000100:00100000:1.0:1746142907.746835:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867778432:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142907.746840:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de12300/2, rc 0, transno 17179873906 00000100:00100000:1.0:1746142907.746842:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867778944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142907.746847:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a0380/2, rc 0, transno 17179873907 00000100:00100000:1.0:1746142907.746849:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867779456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142907.747212:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800949d3100/2, rc 0, transno 17179873908 00000100:00100000:2.0:1746142907.747216:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867778816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142907.753266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.753322:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280128 00000100:00100000:2.0:1746142907.753329:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280128 00000100:00100000:2.0:1746142907.753365:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14393 00000100:00100000:2.0:1746142907.753371:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:32256:x1830962867280128:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142907.753390:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.753407:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f200/0x2fa243e067ccc73e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a24b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142907.753454:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867779840:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142907.753471:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f200/0x2fa243e067ccc73e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a24b expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.753606:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d8000/0x2fa243e067ccc722 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 9 pid: 10924 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746142907.753637:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.753637:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f200/0x2fa243e067ccc73e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a24b expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.753651:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d9200, rc 0) 00010000:00010000:2.0:1746142907.753653:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142907.753655:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142907.753658:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3f200, rc 0) 00000100:00100000:3.0:1746142907.753691:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:32260:x1830962867279232:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 30547us (33060us total) trans 8589936536 rc 0/0 00000100:00100000:2.0:1746142907.753695:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32256:x1830962867280128:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 325us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.753697:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14390 00000100:00100000:2.0:1746142907.753701:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14393 00000100:00100000:1.0:1746142907.754174:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867278464:12345-192.168.204.50@tcp:3:cat.0 Request processed in 49464us (51050us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142907.754182:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4254 00002000:00100000:1.0:1746142907.754189:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009a358a80 x1830962867278464/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.754202:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358a80 with x1830962867278464 ext(1048576->2097151) 00002000:00010000:1.0:1746142907.754205:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a358a80 00000100:00100000:1.0:1746142907.754763:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.754801:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280256 00000100:00100000:0.0:1746142907.754807:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280256 00000100:00100000:0.0:1746142907.754834:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5229 00000100:00100000:0.0:1746142907.754840:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32264:x1830962867280256:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:0.0:1746142907.754893:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32264:x1830962867280256:12345-192.168.204.50@tcp:49:cat.0 Request processed in 54us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.754913:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5229 00000100:00100000:0.0:1746142907.762429:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762510:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762527:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762539:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762551:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762579:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762589:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.762605:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.762620:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280640 00000100:00100000:2.0:1746142907.762629:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280640 00000100:00100000:2.0:1746142907.762640:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280768 00000100:00100000:2.0:1746142907.762641:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280768 00000100:00100000:2.0:1746142907.762669:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280896 00000100:00100000:2.0:1746142907.762671:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280896 00000100:00100000:1.0:1746142907.762678:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281024 00000100:00100000:2.0:1746142907.762681:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281152 00000100:00100000:1.0:1746142907.762681:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281024 00000100:00100000:2.0:1746142907.762682:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281152 00000100:00100000:2.0:1746142907.762690:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281280 00000100:00100000:2.0:1746142907.762691:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281280 00000100:00100000:1.0:1746142907.762691:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281408 00000100:00100000:1.0:1746142907.762693:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281408 00000100:00100000:2.0:1746142907.762701:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14049 00000100:00100000:2.0:1746142907.762707:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+20:2003:x1830962867280768:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142907.762819:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142907.762822:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142904 -> 1746142908 00002000:00010000:2.0:1746142907.762824:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142905 -> 1746142908 00002000:00010000:2.0:1746142907.762826:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142905 -> 1746142908 00002000:00010000:2.0:1746142907.762827:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142907.762854:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14050 00000100:00100000:1.0:1746142907.762860:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+21:2003:x1830962867280896:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:2.0:1746142907.762864:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+21:2003:x1830962867280768:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 157us (336us total) trans 17179873909 rc 0/0 00000100:00100000:2.0:1746142907.762870:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14049 00000100:00100000:2.0:1746142907.762882:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14051 00000100:00100000:2.0:1746142907.762886:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867281152:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142907.762931:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142907.762933:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142904 -> 1746142908 00002000:00010000:1.0:1746142907.762935:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142905 -> 1746142908 00002000:00010000:1.0:1746142907.762937:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142905 -> 1746142908 00002000:00010000:1.0:1746142907.762938:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746142907.762956:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+21:2003:x1830962867280896:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 96us (415us total) trans 17179873910 rc 0/0 00000100:00100000:1.0:1746142907.762961:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14050 00000100:00100000:1.0:1746142907.762971:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14052 00000100:00100000:1.0:1746142907.762976:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867281024:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142907.763023:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142907.763025:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142905 -> 1746142908 00002000:00010000:1.0:1746142907.763027:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142905 -> 1746142908 00002000:00010000:1.0:1746142907.763028:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142905 -> 1746142908 00002000:00010000:1.0:1746142907.763030:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142907.763045:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867281024:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 69us (493us total) trans 21474841169 rc 0/0 00000100:00100000:1.0:1746142907.763050:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14052 00000100:00100000:1.0:1746142907.763059:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14053 00000100:00100000:1.0:1746142907.763064:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+20:2003:x1830962867281280:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142907.763097:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142907.763099:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142908 -> 1746142908 00002000:00010000:1.0:1746142907.763101:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142908 -> 1746142908 00002000:00010000:1.0:1746142907.763102:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142908 -> 1746142908 00002000:00010000:1.0:1746142907.763103:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746142907.763117:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+21:2003:x1830962867281280:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 53us (527us total) trans 17179873911 rc 0/0 00000100:00100000:1.0:1746142907.763121:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14053 00000100:00100000:1.0:1746142907.763131:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14054 00000100:00100000:1.0:1746142907.763135:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:32260:x1830962867281408:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142907.763143:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.763153:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a259 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.763172:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.763179:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.763189:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.763191:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.763193:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2105344->2551807] (req 2105344->2551807) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.763215:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.763225:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 40 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.763234:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867780096:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.763932:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867280512 00000100:00100000:1.0:1746142907.763936:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867280512 00010000:00010000:0.0:1746142907.763950:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142907.763961:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 17 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.763963:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14394 00000100:00100000:1.0:1746142907.763968:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:32269:x1830962867280512:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142907.763969:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867780224:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.763977:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.763987:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccc74c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a252 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.763993:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c51cd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746142907.764036:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.764045:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.764053:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.764063:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.764068:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.764073:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00002000:00010000:2.0:1746142907.764327:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5032768 00002000:00010000:2.0:1746142907.764331:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142908 -> 1746142908 00002000:00010000:2.0:1746142907.764332:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142907 -> 1746142908 00002000:00010000:2.0:1746142907.764334:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142907 -> 1746142908 00002000:00010000:2.0:1746142907.764336:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5744 00000100:00100000:2.0:1746142907.764355:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867281152:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 1467us (1775us total) trans 21474841170 rc 0/0 00000100:00100000:2.0:1746142907.764360:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14051 00000100:00100000:2.0:1746142907.764396:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14055 00000100:00100000:2.0:1746142907.764401:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867280640:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142907.764453:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142907.764456:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142904 -> 1746142908 00002000:00010000:2.0:1746142907.764458:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142905 -> 1746142908 00002000:00010000:2.0:1746142907.764459:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142905 -> 1746142908 00002000:00010000:2.0:1746142907.764461:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142907.764478:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867280640:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 77us (1968us total) trans 21474841171 rc 0/0 00000100:00100000:2.0:1746142907.764483:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14055 00010000:00010000:1.0:1746142907.767052:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767070:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767079:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:1.0:1746142907.767089:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142907.767143:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767149:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767155:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767159:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130600e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142907.767163:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767168:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767177:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.767179:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142907.767182:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767186:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067ccc761 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767219:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767224:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767227:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767231:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767234:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4069800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142907.767236:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767240:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767246:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142907.767248:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142907.767250:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767254:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4069800/0x2fa243e067ccc753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767263:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767267:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767271:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767274:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4027800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142907.767276:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767280:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767285:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462300) 00010000:00010000:1.0:1746142907.767286:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142907.767288:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767292:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc75a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142907.767328:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccc74c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a252 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.767334:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccc74c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a252 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.767340:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495d400, rc 0) 00000100:00100000:1.0:1746142907.768881:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32269:x1830962867280512:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4905us (6459us total) trans 8589936538 rc 301/301 00000100:00100000:1.0:1746142907.768891:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14394 00000100:00100000:0.0:1746142907.771911:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.771935:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.771954:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281536 00000100:00100000:0.0:1746142907.771961:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281536 00010000:00010000:0.0:1746142907.771990:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.772013:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6283 00000100:00100000:0.0:1746142907.772019:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867281536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.772029:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.772046:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.772055:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.772075:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142907.772121:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867281536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.772126:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6283 00000100:00100000:0.0:1746142907.772153:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.772163:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281664 00000100:00100000:0.0:1746142907.772166:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281664 00010000:00010000:0.0:1746142907.772175:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 18 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.772188:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6284 00000100:00100000:0.0:1746142907.772192:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867281664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142907.772197:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142907.772203:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 18 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.772215:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 18 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.772225:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.772227:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142907.772233:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.772239:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142907.772265:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142907.772275:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867780352:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142907.772324:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.772433:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.772671:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867282048 00000100:00100000:1.0:1746142907.772675:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867282048 00000100:00100000:1.0:1746142907.772694:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5230 00000100:00100000:1.0:1746142907.772699:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32256:x1830962867282048:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1746142907.772816:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32256:x1830962867282048:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 117us (383us total) trans 8589936539 rc 0/0 00000100:00100000:1.0:1746142907.772821:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5230 00010000:00010000:1.0:1746142907.772855:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130ab4200/0x2fa243e067ccc6dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a221 expref: 40 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.772864:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867780096:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.772873:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e800/0x2fa243e067ccc634 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e2 expref: 18 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.772879:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867780224:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.772915:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.772924:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495d600, rc 0) 00000100:00100000:1.0:1746142907.772939:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+28:32260:x1830962867281408:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9803us (10333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.772946:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14054 00000100:00100000:1.0:1746142907.772966:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867281792 00000100:00100000:1.0:1746142907.772968:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867281792 00000100:00100000:1.0:1746142907.772990:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14395 00000100:00100000:1.0:1746142907.772994:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:32269:x1830962867281792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142907.773005:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.773016:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccc76f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a260 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.773057:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142907.773067:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142907.773075:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142907.773093:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:1.0:1746142907.773096:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142907.773105:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142907.773119:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccc76f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.773127:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.773133:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142907.773136:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142907.773137:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495ce00, rc 0) 00000100:00100000:1.0:1746142907.773155:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:32269:x1830962867281792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 161us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.773160:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14395 00000100:00100000:1.0:1746142907.773870:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867780352:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142907.773879:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142907.773914:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867281664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1705us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.773922:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6284 00000100:00100000:0.0:1746142907.778049:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.778081:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.778092:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.778126:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.778141:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867282432 00000100:00100000:3.0:1746142907.778148:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867282432 00000100:00100000:0.0:1746142907.778149:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.778180:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867282560 00000100:00100000:3.0:1746142907.778182:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867282560 00000100:00100000:3.0:1746142907.778192:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867282688 00000100:00100000:3.0:1746142907.778194:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867282688 00000100:00100000:3.0:1746142907.778202:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867282816 00000100:00100000:3.0:1746142907.778204:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867282816 00000100:00100000:3.0:1746142907.778216:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14056 00000100:00100000:3.0:1746142907.778222:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867282432:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.778237:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.778252:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a267 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.778282:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778284:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778290:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 30 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778303:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 30 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778311:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880e00, rc 0) 00000100:00100000:3.0:1746142907.778348:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867282432:12345-192.168.204.50@tcp:101:cat.0 Request processed in 125us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.778353:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14056 00000100:00100000:3.0:1746142907.778366:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14057 00000100:00100000:3.0:1746142907.778371:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867282560:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.778378:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.778385:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a26e expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.778394:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778396:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778399:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778408:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778430:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881c00, rc 0) 00000100:00100000:3.0:1746142907.778446:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867282560:12345-192.168.204.50@tcp:101:cat.0 Request processed in 75us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.778449:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14057 00000100:00100000:3.0:1746142907.778465:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14058 00000100:00100000:3.0:1746142907.778469:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867282688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.778474:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.778480:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a275 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.778488:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778489:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778496:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778505:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778511:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881400, rc 0) 00000100:00100000:1.0:1746142907.778524:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867282304 00000100:00100000:3.0:1746142907.778525:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867282688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 56us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.778529:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867282304 00000100:00100000:3.0:1746142907.778530:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14058 00000100:00100000:1.0:1746142907.778552:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5231 00000100:00100000:1.0:1746142907.778557:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:32256:x1830962867282304:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1746142907.778625:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14059 00000100:00100000:3.0:1746142907.778630:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867282816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142907.778637:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142907.778644:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a27c expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142907.778651:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778652:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142907.778656:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 30 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778663:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 30 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142907.778669:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a969200, rc 0) 00000100:00100000:1.0:1746142907.778675:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:32256:x1830962867282304:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 117us (633us total) trans 8589936540 rc 0/0 00000100:00100000:1.0:1746142907.778681:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5231 00000100:00100000:3.0:1746142907.778683:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867282816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 54us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.778688:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14059 00000100:00100000:0.0:1746142907.782200:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.782833:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.783233:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.783262:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.783286:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.783292:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867283328 00000100:00100000:3.0:1746142907.783302:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867283328 00002000:00100000:3.0:1746142907.783335:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2105344->2109439) req@ffff8800924f6d80 x1830962867283328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.783343:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f6d80 with x1830962867283328 ext(2105344->2109439) 00002000:00010000:3.0:1746142907.783348:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f6d80 00000100:00100000:3.0:1746142907.783361:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867283072 00000100:00100000:3.0:1746142907.783363:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867283072 00002000:00100000:3.0:1746142907.783371:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dc61180 x1830962867283072/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.783377:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61180 with x1830962867283072 ext(1048576->2097151) 00002000:00010000:3.0:1746142907.783381:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61180 00000100:00100000:3.0:1746142907.783386:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867283712 00000100:00100000:3.0:1746142907.783388:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867283712 00002000:00100000:3.0:1746142907.783394:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc61880 x1830962867283712/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.783399:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61880 with x1830962867283712 ext(1048576->2097151) 00002000:00010000:3.0:1746142907.783402:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61880 00000100:00100000:3.0:1746142907.783518:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867283968 00000100:00100000:3.0:1746142907.783520:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867283968 00002000:00100000:3.0:1746142907.783531:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dc60000 x1830962867283968/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.783536:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60000 with x1830962867283968 ext(1048576->2097151) 00002000:00010000:3.0:1746142907.783539:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc60000 00000100:00100000:2.0:1746142907.783544:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867283456 00000100:00100000:3.0:1746142907.783548:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4255 00000100:00100000:2.0:1746142907.783549:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867283456 00000100:00100000:3.0:1746142907.783553:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867283328:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.783574:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14060 00000100:00100000:2.0:1746142907.783579:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867283456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.783588:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.783603:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a283 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.783619:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.783621:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.783628:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 22 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.783641:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 22 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.783650:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4068400, rc 0) 00000100:00100000:3.0:1746142907.783653:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867283328:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 99us (1461us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142907.783658:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4255 00002000:00100000:3.0:1746142907.783662:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2105344->2109439) req@ffff8800924f6d80 x1830962867283328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.783668:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f6d80 with x1830962867283328 ext(2105344->2109439) 00002000:00010000:3.0:1746142907.783671:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f6d80 00000100:00100000:2.0:1746142907.783673:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867283456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 94us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.783678:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14060 00000100:00100000:3.0:1746142907.783681:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4256 00000100:00100000:3.0:1746142907.783684:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867283072:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.783698:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4257 00000100:00100000:2.0:1746142907.783703:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867283712:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.783996:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4258 00000100:00100000:1.0:1746142907.784003:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867283968:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.792978:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.793042:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867283072:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9353us (9806us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142907.793051:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4256 00002000:00100000:3.0:1746142907.793061:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dc61180 x1830962867283072/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.793070:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61180 with x1830962867283072 ext(1048576->2097151) 00002000:00010000:3.0:1746142907.793075:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61180 00000100:00100000:3.0:1746142907.793092:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867284224 00000100:00100000:3.0:1746142907.793097:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867284224 00002000:00100000:3.0:1746142907.793117:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2547712->2551807) req@ffff88012dc63800 x1830962867284224/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.793124:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63800 with x1830962867284224 ext(2547712->2551807) 00002000:00010000:3.0:1746142907.793126:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc63800 00000100:00100000:3.0:1746142907.793138:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4259 00000100:00100000:3.0:1746142907.793143:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867284224:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142907.793227:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867284224:12345-192.168.204.50@tcp:3:cat.0 Request processed in 83us (256us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142907.793232:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4259 00002000:00100000:3.0:1746142907.793236:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2547712->2551807) req@ffff88012dc63800 x1830962867284224/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.793241:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63800 with x1830962867284224 ext(2547712->2551807) 00002000:00010000:3.0:1746142907.793243:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc63800 00000100:00100000:0.0:1746142907.801285:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.801320:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.801347:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.801367:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.801623:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867284480 00000100:00100000:2.0:1746142907.801632:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867284480 00002000:00100000:2.0:1746142907.801662:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012dc61f80 x1830962867284480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.801670:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61f80 with x1830962867284480 ext(0->1048575) 00002000:00010000:2.0:1746142907.801675:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc61f80 00000100:00100000:2.0:1746142907.801692:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867284736 00000100:00100000:2.0:1746142907.801694:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867284736 00002000:00100000:2.0:1746142907.801706:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dc62d80 x1830962867284736/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.801712:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc62d80 with x1830962867284736 ext(1048576->2097151) 00002000:00010000:2.0:1746142907.801714:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc62d80 00000100:00100000:2.0:1746142907.801723:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867284992 00000100:00100000:2.0:1746142907.801725:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867284992 00002000:00100000:2.0:1746142907.801733:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009cd5d880 x1830962867284992/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.801738:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d880 with x1830962867284992 ext(1048576->2097151) 00002000:00010000:2.0:1746142907.801741:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5d880 00000100:00100000:2.0:1746142907.801747:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867285248 00000100:00100000:2.0:1746142907.801749:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867285248 00002000:00100000:2.0:1746142907.801757:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009cd5d180 x1830962867285248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.801762:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d180 with x1830962867285248 ext(1048576->2097151) 00002000:00010000:2.0:1746142907.801764:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5d180 00000100:00100000:2.0:1746142907.801776:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4260 00000100:00100000:2.0:1746142907.801783:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867284480:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.802314:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4261 00000100:00100000:2.0:1746142907.802321:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867284736:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.802806:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4262 00000100:00100000:2.0:1746142907.802812:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867284992:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.803787:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4263 00000100:00100000:1.0:1746142907.803794:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867285248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.804328:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867283968:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20325us (21040us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142907.804335:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4258 00002000:00100000:1.0:1746142907.804341:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dc60000 x1830962867283968/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.804355:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60000 with x1830962867283968 ext(1048576->2097151) 00002000:00010000:1.0:1746142907.804359:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc60000 00000100:00100000:0.0:1746142907.812568:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867283712:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28856us (29296us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142907.812578:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4257 00002000:00100000:0.0:1746142907.812588:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc61880 x1830962867283712/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142907.812597:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61880 with x1830962867283712 ext(1048576->2097151) 00002000:00010000:0.0:1746142907.812601:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc61880 00000100:00100000:0.0:1746142907.817293:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.817714:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867285504 00000100:00100000:1.0:1746142907.817723:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867285504 00000100:00100000:1.0:1746142907.817761:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5232 00000100:00100000:1.0:1746142907.817768:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4852050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:32260:x1830962867285504:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142907.817966:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4852050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:32260:x1830962867285504:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 197us (680us total) trans 8589936541 rc 0/0 00000100:00100000:1.0:1746142907.817972:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5232 00000100:00100000:2.0:1746142907.818866:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867284480:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17081us (17587us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.818875:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4260 00002000:00100000:2.0:1746142907.818883:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012dc61f80 x1830962867284480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.818891:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61f80 with x1830962867284480 ext(0->1048575) 00002000:00010000:2.0:1746142907.818896:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc61f80 00000100:00100000:0.0:1746142907.823612:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.823686:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867285632 00000100:00100000:2.0:1746142907.823696:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867285632 00000100:00100000:2.0:1746142907.823746:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14061 00000100:00100000:2.0:1746142907.823754:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867285632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.823773:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.823789:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccc7a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a28a expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.823838:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867780480:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142907.824078:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867284736:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21756us (22755us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142907.824087:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4261 00002000:00100000:3.0:1746142907.824095:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dc62d80 x1830962867284736/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.824104:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc62d80 with x1830962867284736 ext(1048576->2097151) 00002000:00010000:3.0:1746142907.824108:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc62d80 00000100:00100000:2.0:1746142907.824312:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.827238:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867284992:12345-192.168.204.50@tcp:3:cat.0 Request processed in 24419us (25882us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142907.827263:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4262 00002000:00100000:2.0:1746142907.827275:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009cd5d880 x1830962867284992/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.827297:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d880 with x1830962867284992 ext(1048576->2097151) 00002000:00010000:2.0:1746142907.827301:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5d880 00000100:00100000:2.0:1746142907.836848:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867780480:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142907.836877:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccc7a0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a28a expref: 41 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.836891:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3a00/0x2fa243e067ccc7a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a28a expref: 41 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142907.836940:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3a00, rc 0) 00000100:00100000:2.0:1746142907.836978:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867285632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 13224us (13373us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142907.836985:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14061 00000100:00100000:1.0:1746142907.837560:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867285248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 33764us (36189us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142907.837569:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4263 00002000:00100000:1.0:1746142907.837577:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009cd5d180 x1830962867285248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.837586:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d180 with x1830962867285248 ext(1048576->2097151) 00002000:00010000:1.0:1746142907.837590:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5d180 00000100:00100000:0.0:1746142907.840861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.840945:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867285760 00000100:00100000:2.0:1746142907.840952:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867285760 00000100:00100000:2.0:1746142907.840996:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14062 00000100:00100000:2.0:1746142907.841003:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32264:x1830962867285760:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.841018:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.841032:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a291 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.841055:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.841062:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142907.841064:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142907.841067:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 41 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.841091:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.841101:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 29 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.841112:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867780608:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142907.841195:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142907.843803:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.843859:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867285888 00000100:00100000:1.0:1746142907.843866:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867285888 00000100:00100000:2.0:1746142907.843894:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867780608:192.168.204.50@tcp:104: 00002000:00100000:1.0:1746142907.843919:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2105344->2551807) req@ffff88009cd5c000 x1830962867285888/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.843927:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c000 with x1830962867285888 ext(2105344->2551807) 00010000:00010000:2.0:1746142907.843934:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 41 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.843934:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 30 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.843946:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3000, rc 0) 00010000:00010000:1.0:1746142907.843949:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 30 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746142907.843954:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5c000 00000100:00100000:2.0:1746142907.843977:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32264:x1830962867285760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2974us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.843983:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14062 00000100:00100000:1.0:1746142907.843983:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1319 00000100:00100000:1.0:1746142907.843989:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867285888:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142907.852367:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.852473:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867285888:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8481us (8673us total) trans 21474841172 rc 0/0 00000100:00100000:1.0:1746142907.852484:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1319 00002000:00100000:1.0:1746142907.852494:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2105344->2551807) req@ffff88009cd5c000 x1830962867285888/t21474841172(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/448 e 0 to 0 dl 1746142918 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.852502:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c000 with x1830962867285888 ext(2105344->2551807) 00010000:00010000:1.0:1746142907.852511:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 32 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:1.0:1746142907.852523:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 32 pid: 1852 timeout: 781 lvb_type: 0 00002000:00010000:1.0:1746142907.852530:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5c000 00000100:00100000:2.0:1746142907.852595:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867286016 00000100:00100000:2.0:1746142907.852602:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867286016 00000100:00100000:2.0:1746142907.852633:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14063 00000100:00100000:2.0:1746142907.852639:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:32269:x1830962867286016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142907.852653:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142907.852665:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a298 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.852690:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142907.852694:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.852703:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.852711:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d2a00, rc 0) 00000100:00100000:2.0:1746142907.852728:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+33:32269:x1830962867286016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 89us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.852733:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14063 00000100:00100000:0.0:1746142907.858783:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.858855:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867286144 00000100:00100000:1.0:1746142907.858862:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867286144 00010000:00010000:1.0:1746142907.858893:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 33 pid: 1852 timeout: 781 lvb_type: 0 00000100:00100000:2.0:1746142907.860318:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6285 00000100:00100000:2.0:1746142907.860332:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+33:2006:x1830962867286144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.860346:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.860369:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 33 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.860382:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 33 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.860401:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495d600/0x2fa243e067ccc745 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2105344->2551807) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a259 expref: 33 pid: 1852 timeout: 781 lvb_type: 0 00010000:00010000:2.0:1746142907.860425:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.860427:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.860433:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 40 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.860440:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 40 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.860530:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.860532:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.860536:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.860542:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.860569:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.860578:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867780736:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142907.861235:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 40 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.861292:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867780864:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142907.861331:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142907.863052:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867780736:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142907.869217:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.869326:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867780864:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142907.869344:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.869379:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867286144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9052us (10606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.869387:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6285 00000100:00100000:1.0:1746142907.869470:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867286400 00000100:00100000:1.0:1746142907.869475:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867286400 00002000:00100000:1.0:1746142907.869506:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009cd5ed80 x1830962867286400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.869514:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5ed80 with x1830962867286400 ext(2097152->4194303) 00002000:00010000:1.0:1746142907.869518:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5ed80 00000100:00100000:1.0:1746142907.869542:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4264 00000100:00100000:1.0:1746142907.869548:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867286400:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.871392:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.871440:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867286656 00000100:00100000:3.0:1746142907.871446:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867286656 00002000:00100000:3.0:1746142907.871472:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009cd5f480 x1830962867286656/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.871480:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f480 with x1830962867286656 ext(2097152->4194303) 00002000:00010000:3.0:1746142907.871484:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5f480 00000100:00100000:3.0:1746142907.871501:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4265 00000100:00100000:3.0:1746142907.871507:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867286656:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142907.872151:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.872272:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867286912 00000100:00100000:1.0:1746142907.872277:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867286912 00002000:00100000:1.0:1746142907.872295:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009cd5df80 x1830962867286912/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.872302:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5df80 with x1830962867286912 ext(2097152->4194303) 00002000:00010000:1.0:1746142907.872305:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5df80 00000100:00100000:1.0:1746142907.872322:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4266 00000100:00100000:1.0:1746142907.872327:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867286912:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142907.872582:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.872644:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867287168 00000100:00100000:3.0:1746142907.872647:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867287168 00002000:00100000:3.0:1746142907.872661:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092137480 x1830962867287168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.872667:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137480 with x1830962867287168 ext(2097152->4194303) 00002000:00010000:3.0:1746142907.872670:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092137480 00000100:00100000:3.0:1746142907.873722:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4267 00000100:00100000:3.0:1746142907.873731:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867287168:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.886052:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867286400:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16494us (16833us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142907.886062:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4264 00002000:00100000:1.0:1746142907.886071:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009cd5ed80 x1830962867286400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.886079:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5ed80 with x1830962867286400 ext(2097152->4194303) 00002000:00010000:1.0:1746142907.886085:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5ed80 00000100:00100000:3.0:1746142907.902422:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867286656:12345-192.168.204.50@tcp:3:cat.0 Request processed in 30897us (31017us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142907.902436:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4265 00002000:00100000:3.0:1746142907.902446:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009cd5f480 x1830962867286656/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.902455:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f480 with x1830962867286656 ext(2097152->4194303) 00002000:00010000:3.0:1746142907.902460:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5f480 00000100:00100000:0.0:1746142907.925470:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142907.925622:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867287424 00000100:00100000:3.0:1746142907.925631:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867287424 00002000:00100000:3.0:1746142907.925665:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cd5c380 x1830962867287424/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.925673:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c380 with x1830962867287424 ext(4194304->5033983) 00002000:00010000:3.0:1746142907.925678:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5c380 00000100:00100000:3.0:1746142907.925697:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4268 00000100:00100000:3.0:1746142907.925703:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867287424:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.925755:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867286912:12345-192.168.204.50@tcp:3:cat.0 Request processed in 53426us (53603us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142907.925763:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4266 00002000:00100000:1.0:1746142907.925769:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009cd5df80 x1830962867286912/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142907.925776:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5df80 with x1830962867286912 ext(2097152->4194303) 00002000:00010000:1.0:1746142907.925779:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5df80 00000100:00100000:3.0:1746142907.939387:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867287168:12345-192.168.204.50@tcp:3:cat.0 Request processed in 65645us (66792us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142907.939397:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4267 00002000:00100000:3.0:1746142907.939407:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092137480 x1830962867287168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142907.939423:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137480 with x1830962867287168 ext(2097152->4194303) 00002000:00010000:3.0:1746142907.939427:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092137480 00000100:00100000:2.0:1746142907.939622:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867287424:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13918us (14158us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746142907.939630:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4268 00002000:00100000:2.0:1746142907.939635:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cd5c380 x1830962867287424/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.939643:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c380 with x1830962867287424 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.939646:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5c380 00000100:00100000:0.0:1746142907.951665:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.951715:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.951730:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867287680 00000100:00100000:2.0:1746142907.951740:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867287680 00002000:00100000:2.0:1746142907.951781:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cd5ca80 x1830962867287680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.951791:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5ca80 with x1830962867287680 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.951795:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5ca80 00000100:00100000:2.0:1746142907.951825:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4269 00000100:00100000:2.0:1746142907.951832:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867287680:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142907.951843:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867287936 00000100:00100000:1.0:1746142907.951847:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867287936 00000100:00100000:1.0:1746142907.951870:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5233 00000100:00100000:1.0:1746142907.951876:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32264:x1830962867287936:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142907.952032:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32264:x1830962867287936:12345-192.168.204.50@tcp:35:cat.0 Request processed in 155us (316us total) trans 8589936542 rc 0/0 00000100:00100000:1.0:1746142907.952038:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5233 00000100:00100000:2.0:1746142907.956742:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867287680:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4902us (5076us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746142907.956751:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4269 00002000:00100000:2.0:1746142907.956761:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cd5ca80 x1830962867287680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:58/0 lens 488/440 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.956773:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5ca80 with x1830962867287680 ext(4194304->5033983) 00002000:00010000:2.0:1746142907.956778:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5ca80 00000100:00100000:0.0:1746142907.963817:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.963928:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867288192 00000100:00100000:2.0:1746142907.963936:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867288192 00000100:00100000:2.0:1746142907.963981:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5234 00000100:00100000:2.0:1746142907.963988:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:32269:x1830962867288192:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142907.964140:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:32269:x1830962867288192:12345-192.168.204.50@tcp:35:cat.0 Request processed in 152us (328us total) trans 8589936543 rc 0/0 00000100:00100000:2.0:1746142907.964147:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5234 00000100:00100000:0.0:1746142907.974355:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.974456:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867288320 00000100:00100000:1.0:1746142907.974464:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867288320 00000100:00100000:1.0:1746142907.974555:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14064 00000100:00100000:1.0:1746142907.974563:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32266:x1830962867288320:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142907.974578:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.974591:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a29f expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.974614:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.974625:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.974631:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.974636:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.974638:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.974641:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1757184->2097151] (req 1757184->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.974663:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.974672:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.974681:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867780992:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.975697:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.975707:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 21 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.975715:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781120:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.975744:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.975752:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 20 pid: 1852 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.975760:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781248:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.975781:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.979063:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867780992:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.979074:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781120:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.979082:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781248:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.979106:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1757184->2097151] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.979120:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75000, rc 0) 00000100:00100000:1.0:1746142907.979350:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32266:x1830962867288320:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4786us (5000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.979357:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14064 00000100:00100000:0.0:1746142907.981991:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142907.982031:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.982075:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867288576 00000100:00100000:2.0:1746142907.982083:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867288576 00010000:00010000:2.0:1746142907.982112:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 21 pid: 1852 timeout: 781 lvb_type: 1 00000100:00100000:2.0:1746142907.982132:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867288448 00000100:00100000:2.0:1746142907.982135:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867288448 00010000:00010000:2.0:1746142907.982143:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 22 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.982187:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.982489:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867288704 00000100:00100000:2.0:1746142907.982492:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867288704 00010000:00010000:2.0:1746142907.982504:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.982505:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6286 00000100:00100000:0.0:1746142907.982513:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+21:2006:x1830962867288576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142907.982520:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6287 00010000:00010000:0.0:1746142907.982524:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142907.982525:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867288448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142907.982533:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.982541:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 22 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.982541:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 21 pid: 1852 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.982551:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 21 pid: 1852 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142907.982580:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6288 00000100:00100000:3.0:1746142907.982587:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b7b42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867288704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142907.982595:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142907.982671:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 22 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.982692:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccc63b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1cd expref: 21 pid: 1852 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142907.982709:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142907.982817:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142907.982827:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142907.982924:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962867288576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 411us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142907.982931:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6286 00010000:00010000:3.0:1746142907.982971:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e671a00/0x2fa243e067ccc6c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a20c expref: 41 pid: 9579 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746142907.982989:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881c00/0x2fa243e067ccc784 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a26e expref: 22 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:2.0:1746142907.983004:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.983005:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142907.983010:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.983017:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142907.983046:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142907.983056:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867781376:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142907.983105:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.983218:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142907.983246:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b7b42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867288704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 659us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142907.983252:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6288 00000100:00100000:2.0:1746142907.985184:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867781376:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142907.985200:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142907.985234:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867288448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2708us (3202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142907.985243:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6287 00000100:00100000:0.0:1746142907.985530:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142907.985643:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867288960 00000100:00100000:2.0:1746142907.985648:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867288960 00002000:00100000:2.0:1746142907.985725:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1757184->1761279) req@ffff88009862f800 x1830962867288960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/0 e 0 to 0 dl 1746142918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.985735:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862f800 with x1830962867288960 ext(1757184->1761279) 00002000:00010000:2.0:1746142907.985739:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862f800 00000100:00100000:2.0:1746142907.985767:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4270 00000100:00100000:2.0:1746142907.985774:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867288960:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142907.985873:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867288960:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 100us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142907.985879:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4270 00002000:00100000:2.0:1746142907.985883:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1757184->1761279) req@ffff88009862f800 x1830962867288960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:58/0 lens 488/4536 e 0 to 0 dl 1746142918 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142907.985890:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862f800 with x1830962867288960 ext(1757184->1761279) 00002000:00010000:2.0:1746142907.985893:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862f800 00000100:00100000:0.0:1746142907.990557:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142907.990673:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867289088 00000100:00100000:1.0:1746142907.990680:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867289088 00000100:00100000:1.0:1746142907.990822:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14065 00000100:00100000:1.0:1746142907.990831:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32266:x1830962867289088:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142907.990845:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142907.990858:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2a6 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.990883:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 19 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.990892:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 20 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.990921:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.990928:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.990929:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142907.990932:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1683455] (req 1048576->1683455) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.990957:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.990967:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.990977:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781504:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.991044:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 20 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.991052:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 20 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.991059:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781632:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.992886:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 19 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142907.993135:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 19 pid: 9578 timeout: 781 lvb_type: 1 00000100:00100000:1.0:1746142907.993148:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781760:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.993482:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142907.997840:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.997850:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781632:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142907.997857:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867781760:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142907.997880:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1683455] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 41 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142907.997892:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75c00, rc 0) 00000100:00100000:1.0:1746142907.999177:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32266:x1830962867289088:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8344us (8623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142907.999186:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14065 00000100:00100000:0.0:1746142908.000431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.000461:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.000506:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867289216 00000100:00100000:0.0:1746142908.000506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.000513:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867289216 00010000:00010000:3.0:1746142908.000607:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142908.001810:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867289472 00000100:00100000:3.0:1746142908.001815:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867289472 00010000:00010000:3.0:1746142908.001830:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 21 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142908.001845:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867289344 00000100:00100000:3.0:1746142908.001846:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867289344 00010000:00010000:3.0:1746142908.001853:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 20 pid: 9578 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142908.001869:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6289 00000100:00100000:3.0:1746142908.001874:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867289216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.001885:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.001910:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142908.001921:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142908.001940:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715600/0x2fa243e067ccc6ce lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a213 expref: 41 pid: 11943 timeout: 781 lvb_type: 1 00000100:00100000:0.0:1746142908.001943:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6290 00000100:00100000:0.0:1746142908.001949:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867289472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.001955:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142908.001958:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142908.001964:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 21 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142908.001971:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 21 pid: 1397 timeout: 781 lvb_type: 1 00010000:00010000:0.0:1746142908.001980:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067ccc78b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a275 expref: 21 pid: 1397 timeout: 781 lvb_type: 1 00000100:00100000:3.0:1746142908.001987:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867289216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 113us (1560us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142908.001990:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.001993:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6289 00000100:00100000:0.0:1746142908.002001:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867289472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.002004:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6291 00000100:00100000:0.0:1746142908.002006:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6290 00000100:00100000:3.0:1746142908.002008:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962867289344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.002013:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.002019:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 20 pid: 9578 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142908.002026:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 20 pid: 9578 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142908.002039:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e670a00/0x2fa243e067ccc62d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1d4 expref: 20 pid: 9578 timeout: 781 lvb_type: 1 00010000:00010000:3.0:1746142908.002047:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.002049:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.002053:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.002406:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.002442:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.002452:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867781888:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.002675:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.006717:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867781888:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.006735:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.006772:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962867289344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4762us (6263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.006780:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6291 00000100:00100000:0.0:1746142908.007970:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.008865:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867289728 00000100:00100000:3.0:1746142908.008873:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867289728 00002000:00100000:3.0:1746142908.008945:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1679360->1683455) req@ffff88009862c000 x1830962867289728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.008959:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862c000 with x1830962867289728 ext(1679360->1683455) 00002000:00010000:3.0:1746142908.008964:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862c000 00000100:00100000:3.0:1746142908.008986:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4271 00000100:00100000:3.0:1746142908.008993:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867289728:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142908.009109:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867289728:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 116us (1142us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142908.009115:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4271 00002000:00100000:3.0:1746142908.009120:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1679360->1683455) req@ffff88009862c000 x1830962867289728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.009126:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862c000 with x1830962867289728 ext(1679360->1683455) 00002000:00010000:3.0:1746142908.009129:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862c000 00000100:00100000:0.0:1746142908.013984:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.014078:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867289984 00000100:00100000:1.0:1746142908.014086:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867289984 00000100:00100000:1.0:1746142908.014133:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5235 00000100:00100000:1.0:1746142908.014141:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32266:x1830962867289984:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142908.014308:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32266:x1830962867289984:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 167us (330us total) trans 8589936544 rc 0/0 00000100:00100000:1.0:1746142908.014314:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5235 00000100:00100000:0.0:1746142908.054561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.056046:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867290240 00000100:00100000:1.0:1746142908.056056:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867290240 00000100:00100000:1.0:1746142908.056113:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14396 00000100:00100000:1.0:1746142908.056121:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:32277:x1830962867290240:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142908.056140:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.056155:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74e00/0x2fa243e067ccc7c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2ad expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.056216:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056226:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056235:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056246:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056251:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056256:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056331:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccc7d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056343:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccc7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056349:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccc7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:1.0:1746142908.056369:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142908.056438:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056444:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056449:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056454:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056459:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142908.056462:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056469:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056478:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142908.056480:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142908.056484:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056488:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74a00/0x2fa243e067ccc7ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056520:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056524:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056528:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056532:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142908.056534:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056538:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056543:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462800) 00010000:00010000:1.0:1746142908.056546:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142908.056548:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056551:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74000/0x2fa243e067ccc7d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.056585:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74e00/0x2fa243e067ccc7c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ad expref: 15 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.056595:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccc7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ad expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.056600:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142908.056602:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142908.056604:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75e00, rc 0) 00000100:00100000:1.0:1746142908.056657:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:32277:x1830962867290240:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 537us (2103us total) trans 8589936545 rc 0/0 00000100:00100000:1.0:1746142908.056663:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14396 00000100:00100000:0.0:1746142908.063609:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.063663:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867290368 00000100:00100000:3.0:1746142908.063671:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867290368 00000100:00100000:3.0:1746142908.063726:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 760 00000100:00100000:3.0:1746142908.063733:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867290368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.063745:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.063767:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75e00/0x2fa243e067ccc7d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ad expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.063797:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.063801:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.063837:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867290368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.063843:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 760 00010000:00010000:2.0:1746142908.104546:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142908.156566:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.156653:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867290496 00000100:00100000:1.0:1746142908.156661:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867290496 00000100:00100000:1.0:1746142908.156703:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14066 00000100:00100000:1.0:1746142908.156710:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:32277:x1830962867290496:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142908.156724:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.156737:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2b4 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.156762:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.156769:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.156770:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.156773:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1486848->2097151] (req 1486848->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.156794:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 39 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.156803:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 39 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.156812:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867782016:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142908.158318:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.162297:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867782016:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142908.162324:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1486848->2097151] (req 1486848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.162339:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:1.0:1746142908.162621:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:32277:x1830962867290496:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5908us (6058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.162629:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14066 00000100:00100000:0.0:1746142908.165488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.165548:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867290624 00000100:00100000:2.0:1746142908.165556:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867290624 00002000:00100000:2.0:1746142908.165592:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1683455) req@ffff88009862dc00 x1830962867290624/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.165600:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862dc00 with x1830962867290624 ext(1048576->1683455) 00010000:00010000:2.0:1746142908.165608:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 40 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.165624:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 40 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.165630:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009862dc00 00000100:00100000:2.0:1746142908.165658:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1320 00000100:00100000:2.0:1746142908.165665:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867290624:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142908.175391:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867290624:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 9717us (9898us total) trans 17179873912 rc 0/0 00000100:00100000:2.0:1746142908.175734:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1320 00002000:00100000:2.0:1746142908.175746:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1683455) req@ffff88009862dc00 x1830962867290624/t17179873912(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.175754:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862dc00 with x1830962867290624 ext(1048576->1683455) 00010000:00010000:2.0:1746142908.175792:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.175804:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.175811:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009862dc00 00000100:00100000:0.0:1746142908.183987:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.184019:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.184130:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867290752 00000100:00100000:1.0:1746142908.184137:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867290752 00010000:00010000:1.0:1746142908.184163:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.184193:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6292 00000100:00100000:1.0:1746142908.184198:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867290752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.184208:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.184223:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.184233:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.184249:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75c00/0x2fa243e067ccc7bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1683455) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2a6 expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.184360:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867291008 00000100:00100000:3.0:1746142908.184363:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867291008 00000100:00100000:3.0:1746142908.184391:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14397 00000100:00100000:3.0:1746142908.184396:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32280:x1830962867291008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.184422:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.184434:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067ccc7ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2bb expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.184485:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184495:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184503:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184512:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184517:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184522:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142908.184526:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.184528:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.184534:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.184541:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.184563:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.184572:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867782144:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.184600:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184608:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184614:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142908.184624:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.184678:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184683:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184689:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184694:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184698:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d3000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.184701:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184706:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184712:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142908.184715:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.184718:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.184721:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccc7f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142908.185580:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00010000:00010000:3.0:1746142908.187974:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.187985:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.187994:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.187998:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d2a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.188001:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.188006:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.188018:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4e00) 00010000:00010000:3.0:1746142908.188020:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.188023:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.188027:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccc7fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142908.188068:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867782144:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.188072:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067ccc7ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.188082:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.188082:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142908.188087:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.188089:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142908.188091:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2000, rc 0) 00000100:00100000:1.0:1746142908.188127:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867290752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3927us (4145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.188135:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6292 00000100:00100000:3.0:1746142908.188163:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32280:x1830962867291008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3766us (4142us total) trans 8589936546 rc 0/0 00000100:00100000:3.0:1746142908.188169:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14397 00000100:00100000:3.0:1746142908.188423:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.188505:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867291264 00000100:00100000:2.0:1746142908.188511:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867291264 00002000:00100000:2.0:1746142908.189391:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1486848->1490943) req@ffff88012dbf5880 x1830962867291264/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.189399:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5880 with x1830962867291264 ext(1486848->1490943) 00002000:00010000:2.0:1746142908.189403:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf5880 00000100:00100000:2.0:1746142908.189440:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4272 00000100:00100000:2.0:1746142908.189447:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867291264:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142908.189548:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867291264:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 101us (1125us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142908.189554:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4272 00002000:00100000:2.0:1746142908.189558:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1486848->1490943) req@ffff88012dbf5880 x1830962867291264/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.189564:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5880 with x1830962867291264 ext(1486848->1490943) 00002000:00010000:2.0:1746142908.189567:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf5880 00000100:00100000:0.0:1746142908.192617:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.192969:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867291520 00000100:00100000:3.0:1746142908.192976:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867291520 00000100:00100000:3.0:1746142908.193010:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14398 00000100:00100000:3.0:1746142908.193017:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+13:32283:x1830962867291520:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.193036:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.193051:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f2a00/0x2fa243e067ccc810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2c2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.193261:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.193273:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.193282:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142908.193291:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.193368:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f2a00/0x2fa243e067ccc810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.193382:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.193387:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.193390:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142908.193392:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ce34400, rc 0) 00000100:00100000:3.0:1746142908.193449:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:32283:x1830962867291520:12345-192.168.204.50@tcp:101:cat.0 Request processed in 431us (837us total) trans 8589936547 rc 0/0 00000100:00100000:3.0:1746142908.193457:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14398 00000100:00100000:0.0:1746142908.198815:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.200477:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867291648 00000100:00100000:1.0:1746142908.200486:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867291648 00000100:00100000:1.0:1746142908.200540:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14067 00000100:00100000:1.0:1746142908.200547:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867291648:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.200562:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.200576:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc825 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2c9 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.200622:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867782272:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142908.200695:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.202941:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.202978:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.203069:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867291776 00000100:00100000:2.0:1746142908.203077:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867291776 00000100:00100000:2.0:1746142908.203104:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867291904 00000100:00100000:2.0:1746142908.203106:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867291904 00000100:00100000:2.0:1746142908.203116:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14068 00000100:00100000:2.0:1746142908.203124:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:32277:x1830962867291776:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142908.203146:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.203158:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2d0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.203178:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.203183:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.203191:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.203195:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.203196:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.203199:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.203310:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14069 00000100:00100000:3.0:1746142908.203317:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867291904:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.203325:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.203333:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3a00/0x2fa243e067ccc833 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2d7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.203365:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867782400:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142908.203462:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.203539:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 40 pid: 11943 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.203547:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867782528:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.203715:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746142908.203766:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.203772:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.203779:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867782656:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.203802:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 16 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.203813:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 16 pid: 1853 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.203820:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867782784:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.203837:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.204010:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867782272:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142908.204029:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc825 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c9 expref: 42 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.204037:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccc825 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c9 expref: 42 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.204062:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74000, rc 0) 00000100:00100000:2.0:1746142908.204095:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867291648:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3548us (5287us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142908.204101:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14067 00000100:00100000:2.0:1746142908.206001:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867782528:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.206011:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867782656:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.206017:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867782784:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.206039:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.206051:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378400, rc 0) 00000100:00100000:2.0:1746142908.206095:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+33:32277:x1830962867291776:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2973us (3159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.206101:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14068 00000100:00100000:0.0:1746142908.207756:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.207855:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867782400:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142908.207879:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3a00/0x2fa243e067ccc833 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d7 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.207891:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3a00/0x2fa243e067ccc833 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d7 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.207929:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3a00, rc 0) 00000100:00100000:3.0:1746142908.207957:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867291904:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4641us (4977us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142908.207964:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14069 00000100:00100000:1.0:1746142908.208021:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867292032 00000100:00100000:1.0:1746142908.208027:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867292032 00010000:00010000:1.0:1746142908.208258:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 17 pid: 1853 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.208288:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6293 00000100:00100000:1.0:1746142908.208294:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867292032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.208307:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.208317:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 17 pid: 1853 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.208715:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 17 pid: 1853 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.208732:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d200/0x2fa243e067ccc61f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1db expref: 17 pid: 1853 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.209315:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142908.209690:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867292032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1394us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.209698:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6293 00000100:00100000:2.0:1746142908.214469:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.214492:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.214619:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.214640:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867292416 00000100:00100000:2.0:1746142908.214647:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867292416 00002000:00100000:2.0:1746142908.214683:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092136a00 x1830962867292416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.214692:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136a00 with x1830962867292416 ext(0->1048575) 00002000:00010000:2.0:1746142908.214697:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092136a00 00000100:00100000:2.0:1746142908.214711:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867292672 00000100:00100000:2.0:1746142908.214713:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867292672 00002000:00100000:2.0:1746142908.214728:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1757183) req@ffff880092134700 x1830962867292672/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.214734:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134700 with x1830962867292672 ext(1048576->1757183) 00002000:00010000:2.0:1746142908.214737:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092134700 00000100:00100000:2.0:1746142908.214747:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4273 00000100:00100000:2.0:1746142908.214754:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867292416:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142908.215448:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4274 00000100:00100000:1.0:1746142908.215456:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867292672:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.216151:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867292160 00000100:00100000:3.0:1746142908.216156:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867292160 00010000:00010000:3.0:1746142908.216177:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 43 pid: 11943 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746142908.216200:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6294 00000100:00100000:3.0:1746142908.216205:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b405e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867292160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.216214:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.216226:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 43 pid: 11943 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.216236:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 43 pid: 11943 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.216253:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130601800/0x2fa243e067ccc6d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a21a expref: 43 pid: 11943 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.216268:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.218299:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b405e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867292160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2086us (3830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.218309:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6294 00000100:00100000:3.0:1746142908.218456:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.218475:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867292800 00000100:00100000:3.0:1746142908.218479:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867292800 00010000:00010000:3.0:1746142908.218497:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746142908.218513:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6295 00000100:00100000:3.0:1746142908.218518:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+33:2004:x1830962867292800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.218528:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.218543:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.218552:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.218566:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a969200/0x2fa243e067ccc792 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a27c expref: 33 pid: 1397 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.218577:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.218579:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.218585:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.218591:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.218617:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.218627:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867782912:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.218681:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.229303:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.229361:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867292928 00000100:00100000:0.0:1746142908.229369:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867292928 00000100:00100000:3.0:1746142908.229392:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867782912:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.229406:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142908.229406:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14070 00000100:00100000:0.0:1746142908.229425:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:32283:x1830962867292928:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142908.229440:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142908.229452:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:2004:x1830962867292800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10933us (10995us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142908.229455:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2de expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.229459:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6295 00010000:00010000:0.0:1746142908.229477:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 42 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.229484:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142908.229485:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142908.229488:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.229511:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 42 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.229521:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 42 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.229529:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.229531:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867783040:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142908.229589:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.229708:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867292416:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14954us (15213us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142908.229716:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4273 00002000:00100000:2.0:1746142908.229723:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092136a00 x1830962867292416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.229737:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136a00 with x1830962867292416 ext(0->1048575) 00002000:00010000:2.0:1746142908.229741:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092136a00 00000100:00100000:2.0:1746142908.229752:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867293184 00000100:00100000:2.0:1746142908.229755:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867293184 00002000:00100000:2.0:1746142908.229771:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1089536->1093631) req@ffff88012dbf4e00 x1830962867293184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.229778:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4e00 with x1830962867293184 ext(1089536->1093631) 00002000:00010000:2.0:1746142908.229780:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4e00 00000100:00100000:2.0:1746142908.230333:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4275 00000100:00100000:2.0:1746142908.230340:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2003:x1830962867293184:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142908.230435:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2003:x1830962867293184:12345-192.168.204.50@tcp:3:cat.0 Request processed in 95us (905us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142908.230441:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4275 00002000:00100000:2.0:1746142908.230445:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1089536->1093631) req@ffff88012dbf4e00 x1830962867293184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.230452:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4e00 with x1830962867293184 ext(1089536->1093631) 00002000:00010000:2.0:1746142908.230454:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4e00 00000100:00100000:1.0:1746142908.238717:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867292672:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23254us (24089us total) trans 0 rc 708608/708608 00000100:00100000:1.0:1746142908.238726:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4274 00002000:00100000:1.0:1746142908.238736:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1757183) req@ffff880092134700 x1830962867292672/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 708608/708608 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.238744:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134700 with x1830962867292672 ext(1048576->1757183) 00010000:00010000:1.0:1746142908.238752:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.238764:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746142908.238770:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134700 00000100:00100000:0.0:1746142908.246553:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.248979:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.249136:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867293440 00000100:00100000:2.0:1746142908.249143:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867293440 00000100:00100000:2.0:1746142908.249176:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5236 00000100:00100000:2.0:1746142908.249182:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:32277:x1830962867293440:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142908.249391:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867783040:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142908.249422:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.249434:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89d400, rc 0) 00000100:00100000:3.0:1746142908.249520:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867293696 00000100:00100000:3.0:1746142908.249524:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867293696 00000100:00100000:3.0:1746142908.249545:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14399 00000100:00100000:3.0:1746142908.249550:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32285:x1830962867293696:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142908.249558:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.249571:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccc841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2e5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.249618:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.249628:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.249634:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.249640:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.249658:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.249665:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 32 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.249677:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867783168:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.249722:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:32277:x1830962867293440:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 540us (749us total) trans 8589936548 rc 0/0 00000100:00100000:2.0:1746142908.249731:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5236 00000100:00100000:1.0:1746142908.249772:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:32283:x1830962867292928:12345-192.168.204.50@tcp:101:cat.0 Request processed in 20348us (20476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.249777:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14070 00010000:00010000:3.0:1746142908.250173:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.250181:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 15 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.250188:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867783296:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.250206:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.252223:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.252808:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867293824 00000100:00100000:1.0:1746142908.252815:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867293824 00002000:00100000:1.0:1746142908.252846:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1757184->2097151) req@ffff88012b1a1c00 x1830962867293824/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.252860:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1c00 with x1830962867293824 ext(1757184->2097151) 00010000:00010000:1.0:1746142908.252867:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.252878:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 41 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746142908.252883:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1a1c00 00000100:00100000:1.0:1746142908.254070:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1321 00000100:00100000:1.0:1746142908.254080:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867293824:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142908.258467:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.258498:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.258523:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.258565:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867293952 00000100:00100000:0.0:1746142908.258572:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867293952 00010000:00010000:0.0:1746142908.258599:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 33 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746142908.258618:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294080 00000100:00100000:0.0:1746142908.258620:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294080 00010000:00010000:0.0:1746142908.258628:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 16 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746142908.258640:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6296 00000100:00100000:0.0:1746142908.258646:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867293952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142908.258657:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142908.258662:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 33 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.258670:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 33 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.258688:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142908.258692:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.258699:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.258703:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142908.258735:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867293952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142908.258742:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6296 00000100:00100000:0.0:1746142908.258754:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6297 00000100:00100000:0.0:1746142908.258758:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867294080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142908.258764:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142908.258767:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 16 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.258774:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 16 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.258783:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142908.258786:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.258792:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.258797:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.258811:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142908.258823:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867294080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142908.258828:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6297 00010000:00010000:3.0:1746142908.259127:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2000/0x2fa243e067ccc802 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2bb expref: 32 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.259143:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867783168:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.259152:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ce00/0x2fa243e067ccc776 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a260 expref: 15 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.259160:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867783296:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.259173:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.259180:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.259184:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142908.259199:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.259291:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccc841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.259300:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.259305:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.259307:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142908.259309:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cd800, rc 0) 00000100:00100000:3.0:1746142908.259330:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32285:x1830962867293696:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9780us (12786us total) trans 8589936549 rc 0/0 00000100:00100000:3.0:1746142908.259336:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14399 00000100:00100000:1.0:1746142908.259516:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294208 00000100:00100000:1.0:1746142908.259520:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294208 00000100:00100000:1.0:1746142908.259543:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14071 00000100:00100000:1.0:1746142908.259547:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32280:x1830962867294208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.259557:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.259567:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2ec expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.259585:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.259591:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.259593:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.259595:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.259618:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.259627:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 21 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.259637:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867783424:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142908.259685:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.263769:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867783424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142908.263792:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 44 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.263806:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75600, rc 0) 00000100:00100000:1.0:1746142908.263849:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32280:x1830962867294208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4301us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.263856:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14071 00000100:00100000:1.0:1746142908.266920:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:0.0:1746142908.267121:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873913 is committed 00000001:00080000:0.0:1746142908.267131:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873911 is committed 00000001:00080000:0.0:1746142908.267136:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873908 is committed 00000001:00080000:0.0:1746142908.267161:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873888 is committed 00000100:00100000:2.0:1746142908.267301:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867293824:12345-192.168.204.50@tcp:4:cat.0 Request processed in 13222us (15079us total) trans 17179873913 rc 0/0 00000100:00100000:2.0:1746142908.267310:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1321 00002000:00100000:2.0:1746142908.267320:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1757184->2097151) req@ffff88012b1a1c00 x1830962867293824/t17179873913(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.267327:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1c00 with x1830962867293824 ext(1757184->2097151) 00010000:00010000:2.0:1746142908.267335:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.267345:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.267351:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1a1c00 00000100:00100000:2.0:1746142908.267367:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294336 00000100:00100000:2.0:1746142908.267372:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294336 00002000:00100000:2.0:1746142908.268372:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1486848->2097151) req@ffff8800968e9880 x1830962867294336/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.268380:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9880 with x1830962867294336 ext(1486848->2097151) 00010000:00010000:2.0:1746142908.268386:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 8 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.268394:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 8 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.268404:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e9880 00000100:00100000:2.0:1746142908.268441:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1322 00000100:00100000:2.0:1746142908.268448:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867294336:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142908.284164:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.284292:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294464 00000100:00100000:3.0:1746142908.284299:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294464 00010000:00010000:3.0:1746142908.284329:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.284370:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6298 00000100:00100000:3.0:1746142908.284378:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867294464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.284389:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.284405:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.284426:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.284445:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75000/0x2fa243e067ccc7b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1757184->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a29f expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.284475:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.284477:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.284483:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.284490:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.285092:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.285104:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867783552:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.285184:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.294850:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867294336:12345-192.168.204.50@tcp:4:cat.0 Request processed in 26394us (27941us total) trans 17179873914 rc 0/0 00000100:00100000:3.0:1746142908.294860:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1322 00002000:00100000:3.0:1746142908.294869:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1486848->2097151) req@ffff8800968e9880 x1830962867294336/t17179873914(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.294877:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9880 with x1830962867294336 ext(1486848->2097151) 00010000:00010000:3.0:1746142908.294886:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 10 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.294897:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 10 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.294918:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e9880 00000100:00100000:3.0:1746142908.295693:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867783552:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.295708:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.296623:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867294464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12244us (12463us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.296630:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6298 00000100:00100000:0.0:1746142908.297234:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.297448:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294720 00000100:00100000:3.0:1746142908.297454:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294720 00002000:00100000:3.0:1746142908.297482:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880088d7d500 x1830962867294720/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.297490:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7d500 with x1830962867294720 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.297493:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7d500 00000100:00100000:3.0:1746142908.297509:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4276 00000100:00100000:3.0:1746142908.297516:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867294720:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142908.305883:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.308817:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294848 00000100:00100000:3.0:1746142908.308827:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294848 00010000:00010000:3.0:1746142908.308864:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 12 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.308914:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6299 00000100:00100000:3.0:1746142908.308922:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867294848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.308935:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.308950:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 12 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.308962:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.308982:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75400/0x2fa243e067ccc7e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1486848->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2b4 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.309868:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.309870:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.309878:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.309886:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142908.309895:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867294720:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12377us (12659us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142908.309926:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4276 00010000:00010000:3.0:1746142908.309932:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746142908.309936:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880088d7d500 x1830962867294720/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142908.309942:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867783680:192.168.204.50@tcp:105: 00002000:00100000:2.0:1746142908.309944:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7d500 with x1830962867294720 ext(1048576->2097151) 00002000:00010000:2.0:1746142908.309948:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7d500 00000100:00100000:3.0:1746142908.309997:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.312872:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867783680:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.312890:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.312974:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867294848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4051us (7095us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.312983:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6299 00000100:00100000:0.0:1746142908.315981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.316111:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867294976 00000100:00100000:1.0:1746142908.316119:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867294976 00000100:00100000:2.0:1746142908.317231:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14072 00000100:00100000:2.0:1746142908.317243:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32283:x1830962867294976:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142908.317257:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.317272:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2f3 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.317292:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.317294:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.317299:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 10 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.317312:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 10 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.317326:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378c00, rc 0) 00000100:00100000:2.0:1746142908.317372:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32283:x1830962867294976:12345-192.168.204.50@tcp:101:cat.0 Request processed in 133us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.317378:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14072 00000100:00100000:0.0:1746142908.320986:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.321206:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867295360 00000100:00100000:2.0:1746142908.321213:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867295360 00002000:00100000:2.0:1746142908.321246:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1093632->2097151) req@ffff880088d7d880 x1830962867295360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.321255:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7d880 with x1830962867295360 ext(1093632->2097151) 00002000:00010000:2.0:1746142908.321259:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7d880 00000100:00100000:2.0:1746142908.321284:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4277 00000100:00100000:2.0:1746142908.321290:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867295360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142908.330300:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.330681:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.330735:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867295488 00000100:00100000:1.0:1746142908.330743:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867295488 00002000:00100000:1.0:1746142908.330784:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800968eaa00 x1830962867295488/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.330800:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eaa00 with x1830962867295488 ext(1048576->2097151) 00002000:00010000:1.0:1746142908.330806:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eaa00 00000100:00100000:1.0:1746142908.330825:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867295744 00000100:00100000:1.0:1746142908.330830:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867295744 00002000:00100000:1.0:1746142908.330844:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800968e8700 x1830962867295744/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.330851:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8700 with x1830962867295744 ext(1048576->2097151) 00002000:00010000:1.0:1746142908.330853:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8700 00000100:00100000:1.0:1746142908.330872:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4278 00000100:00100000:1.0:1746142908.330880:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867295488:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142908.332590:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4279 00000100:00100000:1.0:1746142908.332599:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867295744:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.334547:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867295360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13251us (13561us total) trans 0 rc 1003520/1003520 00000100:00100000:3.0:1746142908.334555:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4277 00002000:00100000:3.0:1746142908.334563:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1093632->2097151) req@ffff880088d7d880 x1830962867295360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1003520/1003520 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.334573:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7d880 with x1830962867295360 ext(1093632->2097151) 00002000:00010000:3.0:1746142908.334577:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7d880 00000100:00100000:2.0:1746142908.337124:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867295488:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6237us (6826us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142908.337133:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4278 00002000:00100000:2.0:1746142908.337141:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800968eaa00 x1830962867295488/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.337151:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eaa00 with x1830962867295488 ext(1048576->2097151) 00002000:00010000:2.0:1746142908.337156:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eaa00 00000100:00100000:1.0:1746142908.346006:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867295744:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13401us (15319us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142908.346016:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4279 00002000:00100000:1.0:1746142908.346026:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800968e8700 x1830962867295744/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.346034:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8700 with x1830962867295744 ext(1048576->2097151) 00002000:00010000:1.0:1746142908.346039:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8700 00000100:00100000:0.0:1746142908.350532:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.350627:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867295872 00000100:00100000:1.0:1746142908.350635:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867295872 00000100:00100000:1.0:1746142908.350683:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14073 00000100:00100000:1.0:1746142908.350690:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32280:x1830962867295872:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.350706:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.350720:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a2fa expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.350744:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.350751:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.350752:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.350756:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.350782:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 31 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.350793:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 31 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.350803:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867783808:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142908.350879:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.355221:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.355297:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296000 00000100:00100000:2.0:1746142908.355305:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296000 00000100:00100000:2.0:1746142908.355342:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14074 00000100:00100000:2.0:1746142908.355348:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32285:x1830962867296000:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142908.355366:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.355381:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a301 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.355403:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 9 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.355421:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.355427:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.355432:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.355433:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.355436:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2777088->3145727] (req 2777088->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.355459:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.355466:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.355475:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867783936:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.355552:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.355563:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 9 pid: 11421 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.355569:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867784064:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.355586:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 9 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.355593:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 9 pid: 9578 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.355599:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867784192:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.355609:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.356054:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968ea300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867783808:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142908.356069:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.356079:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbb000, rc 0) 00000100:00100000:1.0:1746142908.356097:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32280:x1830962867295872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5408us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.356104:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14073 00000100:00100000:0.0:1746142908.356524:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.356574:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296128 00000100:00100000:1.0:1746142908.356577:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296128 00002000:00100000:1.0:1746142908.356599:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1093631) req@ffff88009a359f80 x1830962867296128/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.356607:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a359f80 with x1830962867296128 ext(1048576->1093631) 00010000:00010000:1.0:1746142908.356613:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 32 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.356620:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 32 pid: 9578 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746142908.356625:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a359f80 00000100:00100000:2.0:1746142908.359023:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1323 00000100:00100000:2.0:1746142908.359038:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867296128:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142908.359767:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867783936:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.359775:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867784064:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.359781:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867784192:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.359801:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2777088->3145727] (req 2777088->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.359813:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378800, rc 0) 00000100:00100000:2.0:1746142908.359842:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32285:x1830962867296000:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4495us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.359849:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14074 00000100:00100000:0.0:1746142908.360924:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.360958:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.360986:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296384 00000100:00100000:1.0:1746142908.360992:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296384 00010000:00010000:1.0:1746142908.361016:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 10 pid: 9578 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.361032:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296256 00000100:00100000:1.0:1746142908.361034:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296256 00010000:00010000:1.0:1746142908.361041:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.361053:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6300 00000100:00100000:1.0:1746142908.361058:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867296384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.361068:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.361083:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 10 pid: 9578 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.361090:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 10 pid: 9578 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.361105:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067ccc618 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1e9 expref: 10 pid: 9578 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.361114:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.361125:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6301 00000100:00100000:1.0:1746142908.361132:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867296384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.361133:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867296256:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142908.361136:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6300 00010000:00010000:3.0:1746142908.361141:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.361149:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.361159:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.361161:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.361169:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296512 00010000:00010000:3.0:1746142908.361170:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3cc00/0x2fa243e067ccc6e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a228 expref: 26 pid: 1852 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.361171:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296512 00010000:00010000:1.0:1746142908.361178:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 10 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142908.361192:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.361208:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867296256:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 77us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.361262:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6302 00000100:00100000:1.0:1746142908.361266:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867296512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.361271:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.361276:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 10 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.361281:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 10 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.361291:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4068400/0x2fa243e067ccc799 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a283 expref: 10 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.361299:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.361301:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.361307:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.361314:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.361337:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.361347:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867784320:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.361390:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6301 00000100:00100000:1.0:1746142908.361604:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.362404:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867296128:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3370us (5879us total) trans 21474841173 rc 0/0 00000100:00100000:2.0:1746142908.362452:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1323 00002000:00100000:2.0:1746142908.362460:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1093631) req@ffff88009a359f80 x1830962867296128/t21474841173(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.362468:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a359f80 with x1830962867296128 ext(1048576->1093631) 00010000:00010000:2.0:1746142908.362475:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 34 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.362485:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 34 pid: 9578 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.362491:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a359f80 00000100:00100000:1.0:1746142908.362928:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867784320:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142908.362940:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142908.362968:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867296512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1700us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.362975:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6302 00000100:00100000:0.0:1746142908.363245:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.363386:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296768 00000100:00100000:2.0:1746142908.363390:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296768 00002000:00100000:2.0:1746142908.363427:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2777088->2781183) req@ffff88009a35ad80 x1830962867296768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.363433:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35ad80 with x1830962867296768 ext(2777088->2781183) 00002000:00010000:2.0:1746142908.363436:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a35ad80 00000100:00100000:2.0:1746142908.363460:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4280 00000100:00100000:2.0:1746142908.363466:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867296768:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142908.363542:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867296768:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 76us (298us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142908.363551:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4280 00002000:00100000:2.0:1746142908.363555:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2777088->2781183) req@ffff88009a35ad80 x1830962867296768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.363561:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35ad80 with x1830962867296768 ext(2777088->2781183) 00002000:00010000:2.0:1746142908.363564:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a35ad80 00000001:00080000:1.0:1746142908.363929:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841173 is committed 00000001:00080000:1.0:1746142908.363939:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841171 is committed 00000001:00080000:1.0:1746142908.363945:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841168 is committed 00000001:00080000:1.0:1746142908.363971:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841149 is committed 00000100:00100000:0.0:1746142908.366315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.367939:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867296896 00000100:00100000:1.0:1746142908.367949:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867296896 00010000:00010000:0.0:1746142908.367996:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 8 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746142908.368023:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6303 00000100:00100000:0.0:1746142908.368029:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:2004:x1830962867296896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142908.368040:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142908.368057:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 8 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.368068:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 8 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.368087:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093378400/0x2fa243e067ccc82c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2d0 expref: 8 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.368106:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142908.368108:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142908.368114:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.368122:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.368149:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142908.368160:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867784448:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142908.368231:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433780 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.371972:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.372016:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867297024 00000100:00100000:3.0:1746142908.372023:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867297024 00000100:00100000:2.0:1746142908.372054:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.372071:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867297280 00000100:00100000:2.0:1746142908.372075:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867297280 00002000:00100000:2.0:1746142908.372100:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880092137100 x1830962867297280/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.372109:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137100 with x1830962867297280 ext(1048576->2097151) 00002000:00010000:2.0:1746142908.372114:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137100 00000100:00100000:2.0:1746142908.372128:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4281 00000100:00100000:2.0:1746142908.372134:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867297280:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142908.372139:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14075 00000100:00100000:3.0:1746142908.372145:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:32285:x1830962867297024:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142908.372152:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.372165:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a308 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.372183:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.372191:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.372195:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.372197:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.372199:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3506175] (req 3145728->3506175) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.372217:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.372226:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.372236:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867784704:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.372288:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.372296:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 26 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.372307:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867784832:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.372323:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.372436:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867784576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746142908.372467:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142908.372808:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867784448:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142908.372822:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142908.372844:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962867296896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4815us (6535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142908.372850:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6303 00000100:00100000:1.0:1746142908.373079:0:3103:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867784576 00000100:00100000:1.0:1746142908.373082:0:3103:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867784576 00000100:00100000:1.0:1746142908.373114:0:3103:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1746142908.373118:0:3103:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830962867784576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1746142908.373129:0:3103:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1304067776 pending 634880 free 3908063232 avail 3669708800 00000100:00100000:1.0:1746142908.373154:0:3103:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830962867784576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.373158:0:3103:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00080000:3.0:1746142908.373202:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142908.373316:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867784576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746142908.375813:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867784704:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.375823:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867784832:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.375842:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3506175] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.375857:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1600, rc 0) 00000100:00100000:3.0:1746142908.377295:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32285:x1830962867297024:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5144us (5322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.377304:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14075 00000100:00100000:0.0:1746142908.377827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.378002:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867297280:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 5867us (5946us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142908.378010:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4281 00002000:00100000:3.0:1746142908.378018:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880092137100 x1830962867297280/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.378026:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137100 with x1830962867297280 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.378031:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137100 00000100:00100000:2.0:1746142908.378084:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867297408 00000100:00100000:2.0:1746142908.378090:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867297408 00010000:00010000:2.0:1746142908.378110:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.378130:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6304 00000100:00100000:2.0:1746142908.378136:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867297408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.378147:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.378161:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.378171:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.378187:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067ccc7ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a298 expref: 7 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.378545:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.378566:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+6:2005:x1830962867297408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 430us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.378572:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6304 00000100:00100000:0.0:1746142908.382621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.382733:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867297536 00000100:00100000:2.0:1746142908.382741:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867297536 00010000:00010000:2.0:1746142908.382772:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 24 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.382836:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6305 00000100:00100000:2.0:1746142908.382844:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867297536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.382857:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.382873:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 24 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.382884:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 24 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.382921:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067ccc7a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a291 expref: 24 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.382933:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.382935:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.382940:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 23 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.382948:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 23 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.382974:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 23 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142908.382983:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867784960:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142908.383343:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.385564:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867784960:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142908.385578:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.385619:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867297536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2775us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.385627:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6305 00000100:00100000:0.0:1746142908.388421:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.388525:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867297792 00000100:00100000:3.0:1746142908.388532:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867297792 00002000:00100000:3.0:1746142908.388569:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3502080->3506175) req@ffff88009a35b480 x1830962867297792/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.388582:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35b480 with x1830962867297792 ext(3502080->3506175) 00002000:00010000:3.0:1746142908.388586:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35b480 00000100:00100000:3.0:1746142908.388616:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4282 00000100:00100000:3.0:1746142908.388622:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962867297792:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.388737:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962867297792:12345-192.168.204.50@tcp:3:cat.0 Request processed in 114us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142908.388742:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4282 00002000:00100000:3.0:1746142908.388747:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3502080->3506175) req@ffff88009a35b480 x1830962867297792/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.388752:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35b480 with x1830962867297792 ext(3502080->3506175) 00002000:00010000:3.0:1746142908.388755:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35b480 00000100:00100000:0.0:1746142908.392334:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.392852:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867298176 00000100:00100000:3.0:1746142908.392860:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867298176 00002000:00100000:3.0:1746142908.392895:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2777087) req@ffff880091de1c00 x1830962867298176/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.392928:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1c00 with x1830962867298176 ext(2097152->2777087) 00002000:00010000:3.0:1746142908.392933:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091de1c00 00000100:00100000:3.0:1746142908.392964:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4283 00000100:00100000:3.0:1746142908.392971:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867298176:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142908.393865:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.395477:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867298304 00000100:00100000:1.0:1746142908.395487:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867298304 00002000:00100000:1.0:1746142908.395523:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880091de0380 x1830962867298304/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.395531:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0380 with x1830962867298304 ext(2097152->3145727) 00002000:00010000:1.0:1746142908.395536:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de0380 00000100:00100000:1.0:1746142908.395567:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4284 00000100:00100000:1.0:1746142908.395573:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867298304:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142908.404638:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867298304:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9057us (10768us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142908.404648:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4284 00002000:00100000:1.0:1746142908.404657:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880091de0380 x1830962867298304/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.404666:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0380 with x1830962867298304 ext(2097152->3145727) 00002000:00010000:1.0:1746142908.404671:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de0380 00000100:00100000:3.0:1746142908.405486:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867298176:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12512us (13157us total) trans 0 rc 679936/679936 00000100:00100000:3.0:1746142908.405493:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4283 00002000:00100000:3.0:1746142908.405499:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2777087) req@ffff880091de1c00 x1830962867298176/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 679936/679936 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.405506:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1c00 with x1830962867298176 ext(2097152->2777087) 00002000:00010000:3.0:1746142908.405509:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091de1c00 00000100:00100000:0.0:1746142908.413394:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.413451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.413618:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867298688 00000100:00100000:1.0:1746142908.413626:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867298688 00002000:00100000:1.0:1746142908.413665:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880091de3b80 x1830962867298688/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.413674:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de3b80 with x1830962867298688 ext(3145728->4194303) 00002000:00010000:1.0:1746142908.413678:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091de3b80 00000100:00100000:1.0:1746142908.413803:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867298816 00000100:00100000:1.0:1746142908.413806:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867298816 00000100:00100000:3.0:1746142908.413807:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4285 00000100:00100000:3.0:1746142908.413815:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867298688:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:1.0:1746142908.413819:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3506176->4194303) req@ffff880091de2300 x1830962867298816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.413825:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2300 with x1830962867298816 ext(3506176->4194303) 00002000:00010000:1.0:1746142908.413828:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de2300 00000100:00100000:1.0:1746142908.413850:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4286 00000100:00100000:1.0:1746142908.413855:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867298816:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142908.423022:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867298816:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9158us (9562us total) trans 0 rc 688128/688128 00000100:00100000:1.0:1746142908.423032:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4286 00002000:00100000:1.0:1746142908.423041:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3506176->4194303) req@ffff880091de2300 x1830962867298816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 688128/688128 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.423050:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2300 with x1830962867298816 ext(3506176->4194303) 00002000:00010000:1.0:1746142908.423055:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de2300 00000100:00100000:3.0:1746142908.426867:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867298688:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13038us (13465us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142908.426880:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4285 00002000:00100000:3.0:1746142908.426893:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880091de3b80 x1830962867298688/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.426935:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de3b80 with x1830962867298688 ext(3145728->4194303) 00002000:00010000:3.0:1746142908.426941:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091de3b80 00000100:00100000:0.0:1746142908.430022:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.430148:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867298944 00000100:00100000:3.0:1746142908.430155:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867298944 00000100:00100000:3.0:1746142908.430205:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14076 00000100:00100000:3.0:1746142908.430213:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867298944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.430228:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.430244:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a30f expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.430263:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.430265:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.430272:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 26 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.430291:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 26 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.430300:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1000, rc 0) 00000100:00100000:3.0:1746142908.430333:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867298944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 122us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.430339:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14076 00000100:00100000:0.0:1746142908.435400:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.435602:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867299200 00000100:00100000:3.0:1746142908.435623:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867299200 00002000:00100000:3.0:1746142908.435829:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092d0b480 x1830962867299200/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.435839:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0b480 with x1830962867299200 ext(4194304->5033983) 00002000:00010000:3.0:1746142908.435862:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0b480 00000100:00100000:3.0:1746142908.436630:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4287 00000100:00100000:3.0:1746142908.436637:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867299200:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.444982:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867299200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8337us (9604us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746142908.444993:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4287 00002000:00100000:3.0:1746142908.445002:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880092d0b480 x1830962867299200/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.445011:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0b480 with x1830962867299200 ext(4194304->5033983) 00002000:00010000:3.0:1746142908.445712:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0b480 00000100:00100000:0.0:1746142908.453126:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.454380:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867299456 00000100:00100000:2.0:1746142908.454389:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867299456 00000100:00100000:2.0:1746142908.454450:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5237 00000100:00100000:2.0:1746142908.454458:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32280:x1830962867299456:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142908.455295:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32280:x1830962867299456:12345-192.168.204.50@tcp:35:cat.0 Request processed in 836us (2174us total) trans 8589936550 rc 0/0 00000100:00100000:2.0:1746142908.455309:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5237 00000100:00100000:0.0:1746142908.480384:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.480452:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867299712 00000100:00100000:3.0:1746142908.480460:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867299712 00000100:00100000:3.0:1746142908.480506:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14400 00000100:00100000:3.0:1746142908.480519:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:32294:x1830962867299712:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.480539:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.480555:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a316 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.480620:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480630:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480639:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480650:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480654:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480659:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480743:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480751:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.480756:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142908.480767:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.481024:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481030:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481035:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481040:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481044:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.481047:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481052:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481062:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142908.481065:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.481068:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481073:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccc887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481760:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481766:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481774:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481778:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.481779:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481783:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481790:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4100) 00010000:00010000:3.0:1746142908.481791:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.481793:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481797:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc88e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.481827:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.481837:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.481842:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.481843:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142908.481845:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1200, rc 0) 00000100:00100000:3.0:1746142908.481941:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:32294:x1830962867299712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1423us (1563us total) trans 8589936551 rc 0/0 00000100:00100000:3.0:1746142908.481947:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14400 00000100:00100000:0.0:1746142908.491485:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.491677:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867299968 00000100:00100000:2.0:1746142908.491685:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867299968 00000100:00100000:2.0:1746142908.491720:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5238 00000100:00100000:2.0:1746142908.491727:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4851c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32294:x1830962867299968:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142908.491893:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4851c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32294:x1830962867299968:12345-192.168.204.50@tcp:35:cat.0 Request processed in 166us (414us total) trans 8589936552 rc 0/0 00000100:00100000:2.0:1746142908.491922:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5238 00000100:00100000:0.0:1746142908.493467:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.493545:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867300224 00000100:00100000:3.0:1746142908.493551:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867300224 00000100:00100000:3.0:1746142908.493591:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14401 00000100:00100000:3.0:1746142908.493597:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:32293:x1830962867300224:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142908.493609:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.493624:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc8a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a31d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.493676:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493685:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493693:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493703:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493708:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493712:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493783:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc8b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493791:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493796:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142908.493805:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.493852:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493857:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493862:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493866:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493871:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.493874:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493879:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493887:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142908.493889:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.493893:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493923:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccc8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493937:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493941:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493948:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493952:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.493954:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493957:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493963:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4d00) 00010000:00010000:3.0:1746142908.493964:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.493966:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493970:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0600/0x2fa243e067ccc8b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142908.493997:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc8a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a31d expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.494007:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a31d expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.494013:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.494014:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142908.494016:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1c00, rc 0) 00000100:00100000:3.0:1746142908.494048:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:32293:x1830962867300224:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 451us (585us total) trans 8589936553 rc 0/0 00000100:00100000:3.0:1746142908.494053:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14401 00000100:00100000:2.0:1746142908.494479:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.494510:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.494536:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.494640:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867300352 00000100:00100000:2.0:1746142908.494644:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867300352 00000100:00100000:2.0:1746142908.494833:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867300480 00000100:00100000:2.0:1746142908.494836:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867300480 00000100:00100000:1.0:1746142908.494866:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867300608 00000100:00100000:1.0:1746142908.494869:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867300608 00000100:00100000:1.0:1746142908.494888:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14077 00000100:00100000:1.0:1746142908.494893:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867300352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.494920:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.494930:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a324 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.494943:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.494945:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.494951:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.494961:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.494968:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbae00, rc 0) 00000100:00100000:1.0:1746142908.494989:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867300352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 96us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.494994:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14077 00000100:00100000:1.0:1746142908.495004:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14078 00000100:00100000:1.0:1746142908.495008:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867300480:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.495013:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.495019:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc8cd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a32b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.495055:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867785088:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142908.495098:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.495188:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14079 00000100:00100000:1.0:1746142908.495193:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867300608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.495201:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.495209:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba200/0x2fa243e067ccc8d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a332 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.495231:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867785216:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142908.495253:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00002000:00010000:1.0:1746142908.498018:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142908 -> 1746142909 00002000:00010000:1.0:1746142908.498025:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142908 -> 1746142909 00002000:00010000:1.0:1746142908.498027:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142908 -> 1746142909 00000100:00100000:1.0:1746142908.498046:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867785088:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142908.498073:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc8cd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a32b expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746142908.498078:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142908 -> 1746142909 00002000:00010000:2.0:1746142908.498080:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142908 -> 1746142909 00002000:00010000:2.0:1746142908.498082:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142908 -> 1746142909 00010000:00010000:1.0:1746142908.498085:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067ccc8cd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a32b expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142908.498091:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867785216:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142908.498097:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbba00, rc 0) 00010000:00010000:2.0:1746142908.498103:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fba200/0x2fa243e067ccc8d4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a332 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.498110:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba200/0x2fa243e067ccc8d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a332 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.498129:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba200, rc 0) 00000100:00100000:1.0:1746142908.498131:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867300480:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3121us (3620us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142908.498138:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14078 00000100:00100000:2.0:1746142908.498144:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867300608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2951us (3608us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142908.498147:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14079 00000100:00100000:0.0:1746142908.499748:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.500150:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867300736 00000100:00100000:2.0:1746142908.500156:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867300736 00000100:00100000:2.0:1746142908.500207:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 761 00000100:00100000:2.0:1746142908.500213:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867300736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.500224:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.500242:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1c00/0x2fa243e067ccc8b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a31d expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.500255:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142908.500258:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.500562:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867300736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 347us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.500568:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 761 00000100:00100000:0.0:1746142908.507335:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.507392:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867300992 00000100:00100000:3.0:1746142908.507400:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867300992 00002000:00100000:3.0:1746142908.507446:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880096070700 x1830962867300992/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.507455:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070700 with x1830962867300992 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.507459:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096070700 00000100:00100000:3.0:1746142908.507488:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4288 00000100:00100000:3.0:1746142908.507494:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962867300992:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.521212:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962867300992:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13709us (13878us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142908.521224:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4288 00002000:00100000:3.0:1746142908.521235:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880096070700 x1830962867300992/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.521244:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070700 with x1830962867300992 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.521249:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096070700 00000100:00100000:0.0:1746142908.533186:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.533238:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.533722:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867301120 00000100:00100000:2.0:1746142908.533731:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867301120 00000100:00100000:1.0:1746142908.533755:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867301248 00000100:00100000:1.0:1746142908.533759:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867301248 00000100:00100000:2.0:1746142908.533784:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14080 00000100:00100000:2.0:1746142908.533792:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867301120:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142908.533807:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.533823:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccc8db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a339 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142908.533866:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867785344:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142908.533964:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14081 00000100:00100000:1.0:1746142908.533970:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867301248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.533978:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.533986:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067ccc8e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a340 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.534009:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867785472:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142908.534315:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.534328:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.538680:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867785344:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142908.538711:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccc8db lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a339 expref: 8 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.538725:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098445c00/0x2fa243e067ccc8db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a339 expref: 8 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142908.538727:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867785472:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142908.538738:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445c00, rc 0) 00010000:00010000:1.0:1746142908.538750:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067ccc8e2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a340 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.538760:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067ccc8e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a340 expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.538772:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbaa00, rc 0) 00000100:00100000:2.0:1746142908.538783:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867301120:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4991us (5602us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142908.538791:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14080 00000100:00100000:1.0:1746142908.538791:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867301248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4821us (5553us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142908.538797:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14081 00000100:00100000:0.0:1746142908.546468:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.546524:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867301376 00000100:00100000:1.0:1746142908.546532:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867301376 00000100:00100000:1.0:1746142908.546582:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14082 00000100:00100000:1.0:1746142908.546589:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:32294:x1830962867301376:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142908.546607:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.546625:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a347 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.546651:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 22 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.546663:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.546665:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142908.546668:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.546692:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 22 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.546702:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 22 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.546713:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867785600:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142908.546790:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.551775:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867785600:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142908.551802:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.551817:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba400, rc 0) 00000100:00100000:1.0:1746142908.551870:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:32294:x1830962867301376:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5280us (5407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.551877:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14082 00000100:00100000:0.0:1746142908.552820:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.552921:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867301504 00000100:00100000:3.0:1746142908.552928:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867301504 00002000:00100000:3.0:1746142908.552959:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3506175) req@ffff880096072300 x1830962867301504/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.552966:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072300 with x1830962867301504 ext(3145728->3506175) 00010000:00010000:3.0:1746142908.552973:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 23 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.552985:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 23 pid: 9578 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.552996:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096072300 00000100:00100000:3.0:1746142908.554212:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1324 00000100:00100000:3.0:1746142908.554221:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867301504:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142908.559191:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867301504:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4962us (6363us total) trans 21474841174 rc 0/0 00000100:00100000:0.0:1746142908.559203:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1324 00002000:00100000:0.0:1746142908.559213:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3506175) req@ffff880096072300 x1830962867301504/t21474841174(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142908.559221:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096072300 with x1830962867301504 ext(3145728->3506175) 00010000:00010000:0.0:1746142908.559229:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.559241:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746142908.559248:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096072300 00000100:00100000:0.0:1746142908.569556:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.569832:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867301632 00000100:00100000:2.0:1746142908.569840:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867301632 00010000:00010000:2.0:1746142908.569871:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.569970:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6306 00000100:00100000:2.0:1746142908.569977:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867301632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.569989:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.570006:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.570017:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.570036:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1600/0x2fa243e067ccc872 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a308 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.570061:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.570063:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.570068:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.570075:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.570100:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142908.570111:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867785728:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142908.570190:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.574574:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867785728:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142908.574591:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.574622:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2004:x1830962867301632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4645us (5073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.574630:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6306 00000100:00100000:0.0:1746142908.578951:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.578985:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867301888 00000100:00100000:1.0:1746142908.578993:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867301888 00002000:00100000:1.0:1746142908.579030:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096071f80 x1830962867301888/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.579044:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071f80 with x1830962867301888 ext(2097152->3145727) 00002000:00010000:1.0:1746142908.579048:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096071f80 00000100:00100000:1.0:1746142908.579254:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4289 00000100:00100000:1.0:1746142908.579262:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867301888:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142908.591482:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867301888:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12212us (12572us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142908.591491:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4289 00002000:00100000:1.0:1746142908.591500:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096071f80 x1830962867301888/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.591508:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096071f80 with x1830962867301888 ext(2097152->3145727) 00002000:00010000:1.0:1746142908.591512:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096071f80 00000100:00100000:0.0:1746142908.596975:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.597016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.597091:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302016 00000100:00100000:1.0:1746142908.597099:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302016 00000100:00100000:1.0:1746142908.597155:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14402 00000100:00100000:1.0:1746142908.597161:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:32295:x1830962867302016:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142908.597181:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.597197:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714600/0x2fa243e067ccc8f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a34e expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.597241:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597252:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597260:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597270:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597275:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597280:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597334:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597349:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.597354:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142908.597378:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.597387:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 32 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.597398:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867785856:192.168.204.50@tcp:104: 00000100:00080000:3.0:1746142908.597456:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746142908.597949:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302144 00000100:00100000:2.0:1746142908.597954:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302144 00000100:00100000:2.0:1746142908.597989:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14083 00000100:00100000:2.0:1746142908.597994:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:32294:x1830962867302144:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142908.598002:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.598011:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a355 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.598296:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.598301:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142908.598303:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142908.598305:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.598320:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.598327:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 25 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.598335:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867785984:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142908.599070:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.599389:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.602047:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.602076:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.602096:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302528 00000100:00100000:0.0:1746142908.602103:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302528 00000100:00100000:0.0:1746142908.602143:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5239 00000100:00100000:0.0:1746142908.602149:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:8514:x1830962867302528:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746142908.602296:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:8514:x1830962867302528:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 147us (219us total) trans 8589936554 rc 0/0 00000100:00100000:0.0:1746142908.602302:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5239 00000100:00100000:1.0:1746142908.602604:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867785856:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142908.602621:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:1.0:1746142908.602641:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302272 00000100:00100000:1.0:1746142908.602644:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302272 00000100:00100000:2.0:1746142908.602726:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867785984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.602741:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.602753:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732400, rc 0) 00000100:00100000:2.0:1746142908.602769:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:32294:x1830962867302144:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4776us (5753us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.602775:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14083 00002000:00100000:1.0:1746142908.602835:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2777088->3145727) req@ffff88009809ea00 x1830962867302272/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.602843:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ea00 with x1830962867302272 ext(2777088->3145727) 00010000:00010000:1.0:1746142908.602848:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 26 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.602856:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 26 pid: 9578 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746142908.602861:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009809ea00 00000100:00100000:0.0:1746142908.603516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.603723:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302656 00000100:00100000:3.0:1746142908.603726:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302656 00010000:00010000:3.0:1746142908.603742:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 34 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.603757:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6307 00000100:00100000:3.0:1746142908.603762:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867302656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.603770:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.603773:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 34 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.603781:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 34 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.603795:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd800/0x2fa243e067ccc848 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2e5 expref: 34 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.603814:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.603819:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603827:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603832:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603848:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.603864:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867302656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.603869:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6307 00010000:00010000:3.0:1746142908.603927:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603932:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142908.603960:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:3.0:1746142908.603964:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142908.603974:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603981:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603989:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603993:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.603998:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604002:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604006:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094715000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.604010:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604015:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604021:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142908.604023:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.604025:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604029:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715000/0x2fa243e067ccc8f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604037:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604041:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604045:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604048:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.604050:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604053:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604057:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462900) 00010000:00010000:3.0:1746142908.604058:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.604060:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604067:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714a00/0x2fa243e067ccc8fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.604089:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714600/0x2fa243e067ccc8f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.604098:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 12 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.604275:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1325 00000100:00100000:1.0:1746142908.604281:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867302272:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:3.0:1746142908.604879:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.604882:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142908.604885:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715a00, rc 0) 00000100:00100000:3.0:1746142908.605023:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:32295:x1830962867302016:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 7860us (8053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.605029:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14402 00000100:00100000:0.0:1746142908.608310:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.608879:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302784 00000100:00100000:3.0:1746142908.608886:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302784 00000100:00100000:3.0:1746142908.608936:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14084 00000100:00100000:3.0:1746142908.608943:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867302784:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142908.608958:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.608970:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a35c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.608989:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.608991:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.608998:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.609016:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.609026:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1600, rc 0) 00000100:00100000:3.0:1746142908.609066:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2003:x1830962867302784:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 124us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.609072:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14084 00000100:00100000:0.0:1746142908.611118:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.611460:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.611629:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.611667:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.612240:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867302272:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7957us (10198us total) trans 17179873915 rc 0/0 00000100:00100000:0.0:1746142908.612250:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1325 00002000:00100000:0.0:1746142908.612259:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2777088->3145727) req@ffff88009809ea00 x1830962867302272/t17179873915(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142908.612267:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ea00 with x1830962867302272 ext(2777088->3145727) 00010000:00010000:0.0:1746142908.612277:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 28 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.612295:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 28 pid: 9578 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746142908.612301:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009809ea00 00000100:00100000:1.0:1746142908.612420:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867302912 00000100:00100000:1.0:1746142908.612427:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867302912 00000100:00100000:1.0:1746142908.612462:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867303040 00000100:00100000:1.0:1746142908.612464:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867303040 00000100:00100000:1.0:1746142908.612475:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867303168 00000100:00100000:1.0:1746142908.612477:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867303168 00000100:00100000:1.0:1746142908.612485:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867303296 00000100:00100000:1.0:1746142908.612486:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867303296 00000100:00100000:1.0:1746142908.612501:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14085 00000100:00100000:1.0:1746142908.612507:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867302912:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142908.612519:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.612531:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a363 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.612548:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.612550:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.612557:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.612569:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.612577:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130000, rc 0) 00000100:00100000:1.0:1746142908.612593:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867302912:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 86us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.612597:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14085 00000100:00100000:1.0:1746142908.612607:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14086 00000100:00100000:1.0:1746142908.612611:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867303040:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142908.612616:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.612624:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a36a expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.612633:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.612634:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.612637:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.612645:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.612656:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131200, rc 0) 00000100:00100000:1.0:1746142908.612669:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867303040:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 58us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.612674:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14086 00000100:00100000:1.0:1746142908.612682:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14087 00000100:00100000:1.0:1746142908.612686:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867303168:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142908.612690:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.612695:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a371 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.612703:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.612704:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.612707:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.612714:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142908.612720:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131000, rc 0) 00000100:00100000:1.0:1746142908.612729:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867303168:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 43us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.612733:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14087 00000100:00100000:1.0:1746142908.612739:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14088 00000100:00100000:1.0:1746142908.612742:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867303296:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142908.612748:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142908.612752:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067ccc92f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a378 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.612779:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867786112:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142908.612824:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.614182:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.614240:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867303552 00000100:00100000:3.0:1746142908.614246:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867303552 00000100:00100000:3.0:1746142908.614277:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14403 00000100:00100000:3.0:1746142908.614283:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32297:x1830962867303552:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142908.614296:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.614308:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a37f expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.614361:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614370:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614377:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614387:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614392:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614397:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614476:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614485:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614490:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142908.614497:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.614554:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614559:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614563:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614568:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614573:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.614576:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614582:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614589:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142908.614591:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.614594:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614599:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccc93d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614607:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614611:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614616:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614619:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4027800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142908.614621:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614626:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614631:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4400) 00010000:00010000:3.0:1746142908.614633:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142908.614634:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614639:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4027800/0x2fa243e067ccc944 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.614665:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 36 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.614674:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 35 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.614679:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.614681:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142908.614683:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6000, rc 0) 00000100:00100000:3.0:1746142908.615048:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32297:x1830962867303552:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 764us (867us total) trans 8589936555 rc 0/0 00000100:00100000:3.0:1746142908.615053:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14403 00000100:00100000:0.0:1746142908.618472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.619087:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867303680 00000100:00100000:3.0:1746142908.619094:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867303680 00010000:00010000:3.0:1746142908.619123:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 28 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.619148:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6308 00000100:00100000:3.0:1746142908.619155:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867303680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.619165:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.619181:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 28 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.619193:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 28 pid: 9578 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.619213:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.619215:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.619220:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.619228:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.619253:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.619263:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867786240:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.619319:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00010000:00010000:3.0:1746142908.619425:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093378800/0x2fa243e067ccc86b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2777088->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a301 expref: 28 pid: 9578 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.619436:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867786112:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142908.619456:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067ccc92f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a378 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.619464:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067ccc92f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a378 expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.619470:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130800, rc 0) 00000100:00100000:3.0:1746142908.619489:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867303296:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 6746us (7821us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142908.619496:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14088 00000100:00100000:3.0:1746142908.626127:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867786240:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.626143:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.626412:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867303680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7244us (7932us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.626421:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6308 00000100:00100000:2.0:1746142908.628970:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.629001:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.629035:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867303936 00000100:00100000:3.0:1746142908.629043:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867303936 00000100:00100000:3.0:1746142908.629099:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14404 00000100:00100000:3.0:1746142908.629106:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:32295:x1830962867303936:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142908.629122:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.629137:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a386 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.629218:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.629229:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.629236:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.629243:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.629271:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.629282:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 34 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.629292:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867786368:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.629351:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.629363:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 13 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.629370:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867786496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.629392:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.631132:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.631148:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867304320 00000100:00100000:1.0:1746142908.631154:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867304320 00002000:00100000:1.0:1746142908.631186:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092136680 x1830962867304320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.631194:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136680 with x1830962867304320 ext(2097152->4194303) 00002000:00010000:1.0:1746142908.631198:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092136680 00000100:00100000:1.0:1746142908.631224:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4290 00000100:00100000:1.0:1746142908.631230:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867304320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142908.631625:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.631639:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867304576 00000100:00100000:2.0:1746142908.631642:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867304576 00010000:00010000:2.0:1746142908.631658:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 35 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.631674:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6309 00000100:00100000:2.0:1746142908.631678:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867304576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.631686:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.631691:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 35 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.631700:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 35 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.631715:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142908.631719:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.631726:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.631731:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.631762:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867304576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.631768:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6309 00000100:00100000:3.0:1746142908.632003:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867304448 00000100:00100000:3.0:1746142908.632006:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867304448 00002000:00100000:3.0:1746142908.632022:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092135f80 x1830962867304448/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.632030:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135f80 with x1830962867304448 ext(3145728->4194303) 00002000:00010000:3.0:1746142908.632033:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092135f80 00000100:00100000:3.0:1746142908.632044:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4291 00000100:00100000:3.0:1746142908.632048:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867304448:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142908.632547:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067ccc94b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a37f expref: 34 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.632567:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867786368:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.632578:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867786496:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.632592:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:3.0:1746142908.632652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.632664:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867304704 00000100:00100000:3.0:1746142908.632666:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867304704 00010000:00010000:3.0:1746142908.635945:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 14 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.636953:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6310 00000100:00100000:3.0:1746142908.636965:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867304704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.636982:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.636990:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 14 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.637001:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 14 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.637020:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067ccc905 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a34e expref: 14 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.637033:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.637038:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.637046:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.637051:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142908.637073:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.637120:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867304704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 159us (4467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.637127:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6310 00010000:00010000:0.0:1746142908.637181:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142908.637187:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142908.637205:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142908.637310:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a386 expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.637325:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a386 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.637694:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142908.637697:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142908.637699:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6800, rc 0) 00000100:00100000:1.0:1746142908.638174:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:32295:x1830962867303936:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 9067us (9171us total) trans 8589936556 rc 0/0 00000100:00100000:1.0:1746142908.638181:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14404 00000100:00100000:0.0:1746142908.641442:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.642516:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867304448:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10465us (11386us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142908.642526:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4291 00002000:00100000:2.0:1746142908.642535:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092135f80 x1830962867304448/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.642544:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135f80 with x1830962867304448 ext(3145728->4194303) 00002000:00010000:2.0:1746142908.642549:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092135f80 00000100:00100000:3.0:1746142908.643361:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867304832 00000100:00100000:3.0:1746142908.643369:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867304832 00000100:00100000:3.0:1746142908.643417:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14089 00000100:00100000:3.0:1746142908.643424:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32297:x1830962867304832:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142908.643437:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.643451:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a38d expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.643475:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.643481:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.643483:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.643486:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.643509:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.643518:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 11 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.643528:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867786624:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.643819:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.650723:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867304320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19484us (21750us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142908.650735:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4290 00002000:00100000:2.0:1746142908.650745:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092136680 x1830962867304320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.650753:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136680 with x1830962867304320 ext(2097152->4194303) 00010000:00010000:2.0:1746142908.650762:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 10 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.650775:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 10 pid: 1854 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.650780:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092136680 00000100:00100000:3.0:1746142908.651227:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867786624:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.651524:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.651542:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0c00, rc 0) 00000100:00100000:3.0:1746142908.651597:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32297:x1830962867304832:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8173us (10161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.651603:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14089 00000100:00100000:0.0:1746142908.651938:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.652065:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305088 00000100:00100000:2.0:1746142908.652071:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305088 00000100:00100000:2.0:1746142908.652111:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14405 00000100:00100000:2.0:1746142908.652118:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:32295:x1830962867305088:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142908.652136:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.652138:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142908.652159:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6800/0x2fa243e067ccc960 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a386 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.652183:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142908.652186:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142908.652196:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc975 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a394 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.652268:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652278:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652285:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652294:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652299:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652304:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652308:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092733a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142908.652311:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652316:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652322:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142908.652324:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142908.652327:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652331:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccc97c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.652346:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc975 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a394 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.652353:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccc975 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a394 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.652373:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732e00, rc 0) 00000100:00100000:2.0:1746142908.652393:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:32295:x1830962867305088:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 276us (456us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142908.652398:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14405 00000100:00100000:0.0:1746142908.661820:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.661861:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.661941:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.662217:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305344 00000100:00100000:3.0:1746142908.662224:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305344 00000100:00100000:3.0:1746142908.662257:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5240 00000100:00100000:3.0:1746142908.662264:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:32295:x1830962867305344:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:3.0:1746142908.662422:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:32295:x1830962867305344:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 157us (608us total) trans 8589936557 rc 0/0 00000100:00100000:3.0:1746142908.662428:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5240 00000100:00100000:3.0:1746142908.662928:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305600 00000100:00100000:3.0:1746142908.662932:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305600 00000100:00100000:2.0:1746142908.662934:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305472 00000100:00100000:2.0:1746142908.662939:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305472 00010000:00010000:3.0:1746142908.662950:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 11 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.662968:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14090 00000100:00100000:3.0:1746142908.662971:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6311 00000100:00100000:2.0:1746142908.662974:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:32294:x1830962867305472:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142908.662976:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867305600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.662983:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.662985:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.662994:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a39b expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.663005:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 12 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.663010:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.663017:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.663018:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142908.663022:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142908.663026:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.663036:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 12 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746142908.663064:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305728 00000100:00100000:0.0:1746142908.663069:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305728 00000100:00100000:0.0:1746142908.663090:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14091 00000100:00100000:0.0:1746142908.663095:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+8:32293:x1830962867305728:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142908.663103:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142908.663110:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3a2 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.663124:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.663131:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 8 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142908.663138:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142908.663143:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142908.663144:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142908.663147:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 9 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.663165:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142908.663175:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 9 pid: 1854 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746142908.663184:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867786752:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142908.663248:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 8 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142908.663256:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 8 pid: 11421 timeout: 782 lvb_type: 1 00000100:00100000:0.0:1746142908.663262:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867786880:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142908.663282:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.663289:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 23 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:0.0:1746142908.663296:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867787008:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142908.663307:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00010000:00010000:3.0:1746142908.664923:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccc90c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a355 expref: 12 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.664936:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.664938:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.664943:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.664949:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.664970:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.664977:0:8381:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.664985:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867787136:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142908.665072:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.665079:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 27 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.665088:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867787264:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.667667:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.668704:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.668927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.668946:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305856 00000100:00100000:1.0:1746142908.668952:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305856 00010000:00010000:1.0:1746142908.668975:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 9 pid: 11421 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.668998:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6312 00000100:00100000:1.0:1746142908.669005:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867305856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.669017:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.669034:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 9 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.669043:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 9 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.669061:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142908.669087:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867305856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.669092:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6312 00000100:00100000:1.0:1746142908.669175:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.669185:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867305984 00000100:00100000:1.0:1746142908.669188:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867305984 00010000:00010000:1.0:1746142908.669198:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 10 pid: 1854 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.669211:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6313 00000100:00100000:1.0:1746142908.669216:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867305984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.669222:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.669228:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 10 pid: 1854 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.669235:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 10 pid: 1854 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.669245:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142908.669269:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867305984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.669274:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6313 00010000:00010000:2.0:1746142908.669344:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccc8c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a324 expref: 9 pid: 1854 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.669365:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867786752:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.669377:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131200/0x2fa243e067ccc921 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a36a expref: 8 pid: 11421 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.669384:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867786880:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.669392:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867787008:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.669422:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1564672->2097151] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 8 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.669430:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711ba00, rc 0) 00000100:00100000:2.0:1746142908.669452:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+8:32293:x1830962867305728:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6357us (6435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.669458:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14091 00000100:00100000:0.0:1746142908.670509:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.670609:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867306112 00000100:00100000:2.0:1746142908.670613:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867306112 00010000:00010000:2.0:1746142908.670628:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 24 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.670638:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867787136:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142908.670645:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6314 00010000:00010000:3.0:1746142908.670646:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.670649:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2004:x1830962867306112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.670658:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.670667:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 24 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.670668:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867305600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7692us (8727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.670672:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6311 00010000:00010000:2.0:1746142908.670675:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 24 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.670687:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccc864 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2fa expref: 24 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.670695:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.670696:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.670701:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 7 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.670708:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 7 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.670728:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 7 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.670730:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867787264:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.670737:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867787392:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.670745:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 10 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.670753:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733a00, rc 0) 00000100:00100000:3.0:1746142908.670777:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:32294:x1830962867305472:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7805us (8916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.670781:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14090 00000100:00100000:2.0:1746142908.670787:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.672071:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.672132:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092404a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867787392:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142908.672140:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.672160:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2004:x1830962867306112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1510us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.672166:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6314 00000100:00100000:0.0:1746142908.672508:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867306368 00000100:00100000:0.0:1746142908.672513:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867306368 00002000:00100000:0.0:1746142908.672540:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4141055) req@ffff880092405180 x1830962867306368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142908.672549:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405180 with x1830962867306368 ext(4136960->4141055) 00010000:00010000:0.0:1746142908.672554:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.672564:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746142908.672574:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092405180 00000100:00100000:0.0:1746142908.672593:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1326 00000100:00100000:0.0:1746142908.672598:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867306368:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142908.673774:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867306368:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1172us (1700us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142908.673781:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1326 00002000:00100000:0.0:1746142908.673787:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4141055) req@ffff880092405180 x1830962867306368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142908.673794:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405180 with x1830962867306368 ext(4136960->4141055) 00010000:00010000:0.0:1746142908.673800:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.673810:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:0.0:1746142908.673815:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092405180 00000100:00100000:1.0:1746142908.673936:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.674228:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867306624 00000100:00100000:0.0:1746142908.674232:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867306624 00002000:00100000:0.0:1746142908.674249:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1564672->1568767) req@ffff8800968ea300 x1830962867306624/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142908.674257:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea300 with x1830962867306624 ext(1564672->1568767) 00002000:00010000:0.0:1746142908.674260:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea300 00000100:00100000:0.0:1746142908.674854:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4292 00000100:00100000:0.0:1746142908.674861:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867306624:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142908.676281:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867306624:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1417us (2342us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142908.676288:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4292 00002000:00100000:1.0:1746142908.676293:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1564672->1568767) req@ffff8800968ea300 x1830962867306624/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.676301:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ea300 with x1830962867306624 ext(1564672->1568767) 00002000:00010000:1.0:1746142908.676304:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ea300 00000100:00100000:0.0:1746142908.676767:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.676917:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867306880 00000100:00100000:1.0:1746142908.676922:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867306880 00002000:00100000:1.0:1746142908.676939:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4194303) req@ffff88011e13c700 x1830962867306880/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.676946:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13c700 with x1830962867306880 ext(4136960->4194303) 00010000:00010000:1.0:1746142908.676952:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.676963:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746142908.676968:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e13c700 00000100:00100000:1.0:1746142908.677137:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1327 00000100:00100000:1.0:1746142908.677143:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867306880:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142908.677435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.677593:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867307008 00000100:00100000:3.0:1746142908.677596:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867307008 00000100:00100000:3.0:1746142908.677624:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14092 00000100:00100000:3.0:1746142908.677628:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:32297:x1830962867307008:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142908.677635:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.677647:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3a9 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.677663:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.677671:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 7 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.677676:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.677677:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.677680:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 24 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.677699:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 7 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.677708:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 7 pid: 11421 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746142908.677716:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867787520:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.677773:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.677779:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 7 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.677785:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867787648:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.677799:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142908.679485:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867306880:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 2338us (2715us total) trans 17179873916 rc 0/0 00000100:00100000:1.0:1746142908.679493:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1327 00002000:00100000:1.0:1746142908.679501:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4194303) req@ffff88011e13c700 x1830962867306880/t17179873916(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.679509:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13c700 with x1830962867306880 ext(4136960->4194303) 00010000:00010000:1.0:1746142908.679516:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 30 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.679525:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 30 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:1.0:1746142908.679531:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e13c700 00000100:00100000:3.0:1746142908.679841:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867787520:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.679849:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867787648:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.679869:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 24 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.679880:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7c00, rc 0) 00000100:00100000:3.0:1746142908.679916:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:32297:x1830962867307008:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2271us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.679922:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14092 00000100:00100000:0.0:1746142908.681180:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.681357:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.681556:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867307264 00000100:00100000:1.0:1746142908.681562:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867307264 00010000:00010000:1.0:1746142908.681583:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 8 pid: 1854 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.681611:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867307136 00000100:00100000:1.0:1746142908.681614:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867307136 00010000:00010000:1.0:1746142908.681623:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 8 pid: 11421 timeout: 782 lvb_type: 1 00000100:00100000:1.0:1746142908.681636:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6315 00000100:00100000:1.0:1746142908.681642:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867307264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.681651:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.681668:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 8 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.681676:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 8 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.681695:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fba400/0x2fa243e067ccc8e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a347 expref: 8 pid: 1854 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.681707:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142908.681730:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867307264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.681734:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6315 00000100:00100000:1.0:1746142908.681744:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6316 00000100:00100000:1.0:1746142908.681748:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867307136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.681753:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.681759:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 8 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.681765:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 8 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.681774:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131000/0x2fa243e067ccc928 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a371 expref: 8 pid: 11421 timeout: 782 lvb_type: 1 00010000:00010000:1.0:1746142908.681782:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.681784:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142908.681789:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.681795:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142908.681815:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142908.681823:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867787776:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142908.681860:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142908.682336:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.682369:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867307392 00000100:00100000:0.0:1746142908.682373:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867307392 00000100:00100000:2.0:1746142908.682377:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142908.682387:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 30 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.682417:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.682421:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6317 00000100:00100000:0.0:1746142908.682426:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867307392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142908.682434:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142908.682444:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 30 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.682446:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867307520 00000100:00100000:3.0:1746142908.682452:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867307520 00010000:00010000:0.0:1746142908.682453:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 30 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.682464:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0c00/0x2fa243e067ccc96e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a38d expref: 30 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:0.0:1746142908.682478:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142908.682479:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142908.682481:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14093 00010000:00010000:0.0:1746142908.682483:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 9 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.682486:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+7:32293:x1830962867307520:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142908.682493:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 9 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.682510:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 9 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142908.682518:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867787904:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142908.682555:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.682566:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867307776 00000100:00100000:0.0:1746142908.682569:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867307776 00000100:00100000:0.0:1746142908.682592:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14406 00000100:00100000:0.0:1746142908.682597:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32302:x1830962867307776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142908.682610:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142908.682620:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a400/0x2fa243e067ccc998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3b7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.682675:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682684:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682692:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682702:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682711:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682716:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682788:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682797:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.682802:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142908.682808:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142908.682816:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.682824:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3b0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.682840:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.682846:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142908.682847:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142908.682849:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 8 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.682864:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.682872:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 23 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.682879:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788032:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.682917:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00010000:00010000:0.0:1746142908.683003:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683010:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683015:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683020:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683025:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009711a600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142908.683028:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683092:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683105:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142908.683107:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142908.683111:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683115:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a600/0x2fa243e067ccc99f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683123:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683127:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683131:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142908.683134:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867787776:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142908.683135:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009711b800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142908.683137:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683141:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142908.683144:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142908.683146:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88012fc92c00) 00010000:00010000:0.0:1746142908.683149:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142908.683151:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142908.683155:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711b800/0x2fa243e067ccc9a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142908.683157:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867307136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1408us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.683162:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6316 00010000:00010000:0.0:1746142908.683182:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a400/0x2fa243e067ccc998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 37 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.683192:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 36 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142908.683198:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142908.683199:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142908.683202:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711ac00, rc 0) 00000100:00100000:0.0:1746142908.683223:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32302:x1830962867307776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 625us (845us total) trans 8589936558 rc 0/0 00000100:00100000:0.0:1746142908.683228:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14406 00000100:00100000:0.0:1746142908.686115:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.686142:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867787904:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142908.686144:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142908.686159:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142908.686190:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867307392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3762us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.686197:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6317 00000100:00100000:3.0:1746142908.686205:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867308032 00000100:00100000:3.0:1746142908.686211:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867308032 00000100:00100000:1.0:1746142908.686271:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867308288 00000100:00100000:1.0:1746142908.686275:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867308288 00002000:00100000:1.0:1746142908.686298:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88011e13f480 x1830962867308288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.686306:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f480 with x1830962867308288 ext(3145728->4194303) 00002000:00010000:1.0:1746142908.686310:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13f480 00000100:00100000:1.0:1746142908.686333:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4293 00000100:00100000:1.0:1746142908.686339:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867308288:12345-192.168.204.50@tcp:3:multiop.0 00002000:00100000:3.0:1746142908.686380:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4456448->4460543) req@ffff88011e13ca80 x1830962867308032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.686388:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ca80 with x1830962867308032 ext(4456448->4460543) 00010000:00010000:3.0:1746142908.686395:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 24 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.686422:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 24 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.686428:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e13ca80 00000100:00100000:3.0:1746142908.686446:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1328 00000100:00100000:3.0:1746142908.686451:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867308032:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142908.687063:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867308032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 610us (953us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142908.687069:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1328 00002000:00100000:3.0:1746142908.687074:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4456448->4460543) req@ffff88011e13ca80 x1830962867308032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.687081:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ca80 with x1830962867308032 ext(4456448->4460543) 00010000:00010000:3.0:1746142908.687085:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 24 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.687095:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 24 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.687100:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e13ca80 00000100:00100000:3.0:1746142908.687124:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788032:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.687139:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->2428927] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 8 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.687154:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0e00, rc 0) 00000100:00100000:3.0:1746142908.687183:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:32293:x1830962867307520:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4697us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.687189:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14093 00000100:00100000:0.0:1746142908.687821:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.688137:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867308416 00000100:00100000:3.0:1746142908.688142:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867308416 00000100:00100000:3.0:1746142908.688294:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14094 00000100:00100000:3.0:1746142908.688301:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962867308416:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.688309:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.688319:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52800/0x2fa243e067ccc9c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3be expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.688349:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788160:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142908.688388:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.689182:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.689218:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867308544 00000100:00100000:3.0:1746142908.689222:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867308544 00000100:00100000:3.0:1746142908.689243:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14095 00000100:00100000:3.0:1746142908.689248:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867308544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.689255:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.689264:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3c5 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.689277:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.689279:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.689286:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 30 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.689299:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 30 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.689312:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52e00, rc 0) 00000100:00100000:3.0:1746142908.689330:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2004:x1830962867308544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.689335:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14095 00000100:00100000:2.0:1746142908.689421:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.689474:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.690152:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867309056 00000100:00100000:1.0:1746142908.690157:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867309056 00000100:00100000:1.0:1746142908.690182:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5241 00000100:00100000:1.0:1746142908.690188:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32297:x1830962867309056:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142908.690319:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32297:x1830962867309056:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 130us (897us total) trans 8589936559 rc 0/0 00000100:00100000:1.0:1746142908.690324:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5241 00000100:00100000:3.0:1746142908.691029:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867308800 00000100:00100000:3.0:1746142908.691033:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867308800 00002000:00100000:3.0:1746142908.691053:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4460543) req@ffff88009cd5dc00 x1830962867308800/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.691061:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5dc00 with x1830962867308800 ext(4194304->4460543) 00010000:00010000:3.0:1746142908.691067:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.691077:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.691082:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5dc00 00000100:00100000:3.0:1746142908.691109:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1329 00000100:00100000:3.0:1746142908.691114:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867308800:12345-192.168.204.50@tcp:4:multiop.0 00002000:00010000:3.0:1746142908.695831:0:11421:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746142908 -> 1746142909 00002000:00010000:3.0:1746142908.695838:0:11421:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142908 -> 1746142909 00002000:00010000:3.0:1746142908.695840:0:11421:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746142908 -> 1746142909 00000100:00100000:3.0:1746142908.695861:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788160:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142908.695886:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52800/0x2fa243e067ccc9c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3be expref: 27 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.695915:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52800/0x2fa243e067ccc9c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3be expref: 27 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.695938:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52800, rc 0) 00000100:00100000:1.0:1746142908.695958:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867308288:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 9617us (9811us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142908.695961:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2003:x1830962867308416:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7660us (8140us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142908.695967:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14094 00000100:00100000:1.0:1746142908.695967:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4293 00002000:00100000:1.0:1746142908.695976:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88011e13f480 x1830962867308288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.695984:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f480 with x1830962867308288 ext(3145728->4194303) 00002000:00010000:1.0:1746142908.695989:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13f480 00000100:00100000:3.0:1746142908.697535:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867308800:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6415us (8055us total) trans 21474841175 rc 0/0 00000100:00100000:3.0:1746142908.697544:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1329 00002000:00100000:3.0:1746142908.697550:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4460543) req@ffff88009cd5dc00 x1830962867308800/t21474841175(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.697558:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5dc00 with x1830962867308800 ext(4194304->4460543) 00010000:00010000:3.0:1746142908.697565:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.697577:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.697584:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5dc00 00000100:00100000:0.0:1746142908.700611:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.700672:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867309184 00000100:00100000:2.0:1746142908.700681:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867309184 00010000:00010000:2.0:1746142908.700710:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.700747:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6318 00000100:00100000:2.0:1746142908.700755:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867309184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142908.700767:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142908.700785:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.700795:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.700814:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982c7c00/0x2fa243e067ccc991 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a9 expref: 26 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.700845:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.700847:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.700853:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 7 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.700860:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 7 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.700888:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 7 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142908.701073:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867788288:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142908.701303:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.701843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.703189:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867309312 00000100:00100000:3.0:1746142908.703197:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867309312 00000100:00100000:3.0:1746142908.703233:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14096 00000100:00100000:3.0:1746142908.703239:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867309312:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.703253:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.703269:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3cc expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.703309:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788416:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142908.703383:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.703934:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867788288:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.703948:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.703972:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867309184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3218us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.703980:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6318 00000100:00100000:0.0:1746142908.704693:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.705266:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867309568 00000100:00100000:3.0:1746142908.705271:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867309568 00002000:00100000:3.0:1746142908.705299:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2424832->2428927) req@ffff8800981cea00 x1830962867309568/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.705308:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cea00 with x1830962867309568 ext(2424832->2428927) 00002000:00010000:3.0:1746142908.705312:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cea00 00000100:00100000:3.0:1746142908.705884:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4294 00000100:00100000:3.0:1746142908.705890:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867309568:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142908.705993:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867309568:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 103us (1302us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142908.705997:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4294 00002000:00100000:3.0:1746142908.706000:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2424832->2428927) req@ffff8800981cea00 x1830962867309568/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/4536 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.706006:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cea00 with x1830962867309568 ext(2424832->2428927) 00002000:00010000:3.0:1746142908.706009:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cea00 00000100:00100000:0.0:1746142908.706421:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.707304:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867309824 00000100:00100000:1.0:1746142908.707311:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867309824 00002000:00100000:1.0:1746142908.707334:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800981cf480 x1830962867309824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142908.707342:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cf480 with x1830962867309824 ext(1048576->2097151) 00002000:00010000:1.0:1746142908.707350:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cf480 00000100:00100000:3.0:1746142908.707687:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788416:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142908.707725:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4295 00000100:00100000:1.0:1746142908.707732:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867309824:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142908.708518:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3cc expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.708532:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3cc expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.708546:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea53a00, rc 0) 00000100:00100000:3.0:1746142908.708582:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867309312:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5343us (6740us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142908.708589:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14096 00000100:00100000:0.0:1746142908.711939:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.711998:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310080 00000100:00100000:2.0:1746142908.712013:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310080 00000100:00100000:2.0:1746142908.712057:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5242 00000100:00100000:2.0:1746142908.712064:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32293:x1830962867310080:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142908.712236:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:32293:x1830962867310080:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 171us (304us total) trans 8589936560 rc 0/0 00000100:00100000:2.0:1746142908.712242:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5242 00000100:00100000:0.0:1746142908.714947:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.715053:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310336 00000100:00100000:3.0:1746142908.715060:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310336 00002000:00100000:3.0:1746142908.715088:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800981cc000 x1830962867310336/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.715096:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc000 with x1830962867310336 ext(4194304->5033983) 00000100:00100000:1.0:1746142908.715096:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867309824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7363us (8675us total) trans 0 rc 1048576/1048576 00002000:00010000:3.0:1746142908.715100:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cc000 00000100:00100000:1.0:1746142908.715104:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4295 00002000:00100000:1.0:1746142908.715110:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800981cf480 x1830962867309824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142908.715117:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4296 00002000:00100000:1.0:1746142908.715118:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cf480 with x1830962867309824 ext(1048576->2097151) 00002000:00010000:1.0:1746142908.715121:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cf480 00000100:00100000:3.0:1746142908.715123:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867310336:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142908.722983:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.723449:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310464 00000100:00100000:3.0:1746142908.723457:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310464 00000100:00100000:3.0:1746142908.723508:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14097 00000100:00100000:3.0:1746142908.723515:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32302:x1830962867310464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.723530:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.723545:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3d3 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.723568:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 9 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.723575:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142908.723577:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142908.723579:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.723604:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 9 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.723614:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 9 pid: 12211 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.723624:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788544:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.723692:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.724045:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867310336:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8920us (9104us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746142908.724053:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4296 00002000:00100000:3.0:1746142908.724060:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800981cc000 x1830962867310336/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.724073:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc000 with x1830962867310336 ext(4194304->5033983) 00002000:00010000:3.0:1746142908.724078:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cc000 00000100:00100000:3.0:1746142908.725875:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788544:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.725917:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.725930:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea53a00, rc 0) 00000100:00100000:3.0:1746142908.725956:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32302:x1830962867310464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2441us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.725963:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14097 00000100:00100000:0.0:1746142908.730310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.730392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.730809:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310592 00000100:00100000:3.0:1746142908.730816:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310592 00002000:00100000:3.0:1746142908.730852:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1564672->2097151) req@ffff8800981cdf80 x1830962867310592/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.730861:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cdf80 with x1830962867310592 ext(1564672->2097151) 00010000:00010000:3.0:1746142908.730870:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 8 pid: 12211 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.730882:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 8 pid: 12211 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.730888:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800981cdf80 00000100:00100000:3.0:1746142908.730931:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1330 00000100:00100000:3.0:1746142908.730937:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867310592:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142908.731082:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310720 00000100:00100000:3.0:1746142908.731086:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310720 00000100:00100000:3.0:1746142908.731110:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14098 00000100:00100000:3.0:1746142908.731115:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867310720:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.731123:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.731135:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52c00/0x2fa243e067ccc9de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3da expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.731243:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788672:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142908.731338:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.735688:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788672:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142908.735717:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52c00/0x2fa243e067ccc9de lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3da expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.735730:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52c00/0x2fa243e067ccc9de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3da expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.735756:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52c00, rc 0) 00000100:00100000:3.0:1746142908.735795:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867310720:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4679us (5401us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142908.735802:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14098 00000100:00100000:3.0:1746142908.741659:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867310592:12345-192.168.204.50@tcp:4:cat.0 Request processed in 10712us (11347us total) trans 21474841176 rc 0/0 00000100:00100000:3.0:1746142908.741668:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1330 00002000:00100000:3.0:1746142908.741678:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1564672->2097151) req@ffff8800981cdf80 x1830962867310592/t21474841176(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.741686:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cdf80 with x1830962867310592 ext(1564672->2097151) 00010000:00010000:3.0:1746142908.741694:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 10 pid: 12211 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.741706:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 10 pid: 12211 timeout: 782 lvb_type: 0 00002000:00010000:3.0:1746142908.741713:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800981cdf80 00000100:00100000:0.0:1746142908.743949:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.744153:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310848 00000100:00100000:3.0:1746142908.744161:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310848 00000100:00100000:3.0:1746142908.744214:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14099 00000100:00100000:3.0:1746142908.744221:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867310848:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.744240:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.744255:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067ccc9e5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3e1 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.744308:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788800:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142908.744385:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.744782:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.744892:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867310976 00000100:00100000:3.0:1746142908.744896:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867310976 00010000:00010000:3.0:1746142908.744930:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 12 pid: 12211 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.744957:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6319 00000100:00100000:3.0:1746142908.744963:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867310976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.744982:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.744997:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 12 pid: 12211 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.745007:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 12 pid: 12211 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.745023:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.745025:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.745031:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.745038:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.745056:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.745064:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867788928:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.745116:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746142908.747171:0:11421:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from glimpse AST (req@ffff88009862d180 x1830962867788800) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 12 pid: 12211 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.747195:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711ba00/0x2fa243e067ccc98a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1564672->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3a2 expref: 12 pid: 12211 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.747224:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867788800:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142908.747245:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067ccc9e5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e1 expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.747255:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea52200/0x2fa243e067ccc9e5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e1 expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.747261:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52200, rc 0) 00000100:00100000:3.0:1746142908.747300:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867310848:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3079us (3357us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142908.747306:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14099 00000100:00100000:3.0:1746142908.748734:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867788928:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.748747:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.748772:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867310976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3809us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.748779:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6319 00000100:00100000:0.0:1746142908.749032:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.749388:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867311232 00000100:00100000:3.0:1746142908.749393:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867311232 00002000:00100000:3.0:1746142908.749432:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800981cf800 x1830962867311232/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.749440:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cf800 with x1830962867311232 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.749444:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cf800 00000100:00100000:3.0:1746142908.749458:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4297 00000100:00100000:3.0:1746142908.749463:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867311232:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.760600:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867311232:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11127us (11559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142908.760610:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4297 00002000:00100000:3.0:1746142908.760619:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800981cf800 x1830962867311232/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.760628:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cf800 with x1830962867311232 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.760632:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cf800 00000100:00100000:0.0:1746142908.775199:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.775255:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867311360 00000100:00100000:3.0:1746142908.775263:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867311360 00000100:00100000:3.0:1746142908.775619:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14100 00000100:00100000:3.0:1746142908.775628:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32302:x1830962867311360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.775643:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.775659:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3e8 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.775685:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 8 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.775692:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142908.775693:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142908.775696:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.775721:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 8 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.775736:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 8 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.775746:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867789056:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142908.775829:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.779272:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.779375:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867789056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142908.779409:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.779426:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77400, rc 0) 00000100:00100000:3.0:1746142908.779475:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32302:x1830962867311360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3848us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.779482:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14100 00000100:00100000:2.0:1746142908.779746:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867311488 00000100:00100000:2.0:1746142908.779763:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867311488 00002000:00100000:2.0:1746142908.779817:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2428927) req@ffff880099e88a80 x1830962867311488/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.779839:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88a80 with x1830962867311488 ext(2097152->2428927) 00010000:00010000:2.0:1746142908.779857:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 9 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.779931:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 9 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.779952:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e88a80 00000100:00100000:2.0:1746142908.780410:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1331 00000100:00100000:2.0:1746142908.780429:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867311488:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142908.786626:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867311488:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6201us (7353us total) trans 21474841177 rc 0/0 00000100:00100000:2.0:1746142908.786637:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1331 00002000:00100000:2.0:1746142908.786646:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2428927) req@ffff880099e88a80 x1830962867311488/t21474841177(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/448 e 0 to 0 dl 1746142919 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.786655:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88a80 with x1830962867311488 ext(2097152->2428927) 00010000:00010000:2.0:1746142908.786664:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:2.0:1746142908.786678:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00002000:00010000:2.0:1746142908.786684:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e88a80 00000100:00100000:0.0:1746142908.789457:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.789508:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867311616 00000100:00100000:3.0:1746142908.789515:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867311616 00010000:00010000:3.0:1746142908.789548:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.789583:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6320 00000100:00100000:3.0:1746142908.789590:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867311616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.789602:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.789618:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.789632:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.789650:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccc9bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2428927) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b0 expref: 11 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.789676:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.789678:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.789684:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.789691:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.789717:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142908.789727:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867789184:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142908.789968:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.794501:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867789184:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142908.794517:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.794566:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867311616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4975us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.794575:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6320 00000100:00100000:0.0:1746142908.803326:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.804680:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867311872 00000100:00100000:2.0:1746142908.804689:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867311872 00002000:00100000:2.0:1746142908.804732:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880099e8bb80 x1830962867311872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.804791:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8bb80 with x1830962867311872 ext(2097152->4194303) 00002000:00010000:2.0:1746142908.804796:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e8bb80 00000100:00100000:3.0:1746142908.804864:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4298 00000100:00100000:3.0:1746142908.804872:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867311872:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142908.807614:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.807684:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867312128 00000100:00100000:2.0:1746142908.807692:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867312128 00002000:00100000:2.0:1746142908.807725:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880099e88e00 x1830962867312128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.807735:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88e00 with x1830962867312128 ext(2097152->4194303) 00002000:00010000:2.0:1746142908.807740:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e88e00 00000100:00100000:2.0:1746142908.807758:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4299 00000100:00100000:2.0:1746142908.807764:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867312128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142908.822780:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867311872:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17901us (19454us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142908.822790:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4298 00002000:00100000:3.0:1746142908.822800:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880099e8bb80 x1830962867311872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.822808:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8bb80 with x1830962867311872 ext(2097152->4194303) 00002000:00010000:3.0:1746142908.822813:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e8bb80 00000100:00100000:2.0:1746142908.838477:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867312128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 30705us (30862us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142908.838486:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4299 00002000:00100000:2.0:1746142908.838495:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880099e88e00 x1830962867312128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.838509:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88e00 with x1830962867312128 ext(2097152->4194303) 00002000:00010000:2.0:1746142908.838513:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e88e00 00000100:00100000:0.0:1746142908.853288:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.853495:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867312384 00000100:00100000:2.0:1746142908.853503:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867312384 00000100:00100000:2.0:1746142908.853587:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14407 00000100:00100000:2.0:1746142908.853595:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:32307:x1830962867312384:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142908.853615:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.853631:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc9f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3ef expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.853691:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853701:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853711:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853722:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853727:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853732:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853811:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853823:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853828:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142908.853835:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142908.853886:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853892:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853896:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853926:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853931:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142908.853934:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853939:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853948:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142908.853950:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142908.853954:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.853958:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccc9fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855329:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855338:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855343:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855347:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142908.855349:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855354:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855362:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880088ce2700) 00010000:00010000:2.0:1746142908.855365:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142908.855367:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855371:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067ccca01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142908.855420:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccc9f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 23 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.855431:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 22 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.855436:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142908.855438:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142908.855439:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733800, rc 0) 00000100:00100000:2.0:1746142908.859841:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:32307:x1830962867312384:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6237us (6551us total) trans 8589936561 rc 0/0 00000100:00100000:2.0:1746142908.859852:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14407 00000100:00100000:3.0:1746142908.860273:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.860408:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867312640 00000100:00100000:2.0:1746142908.860415:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867312640 00002000:00100000:2.0:1746142908.860445:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009862c380 x1830962867312640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.860454:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862c380 with x1830962867312640 ext(4194304->5033983) 00002000:00010000:2.0:1746142908.860458:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009862c380 00000100:00100000:2.0:1746142908.860473:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4300 00000100:00100000:2.0:1746142908.860479:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867312640:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142908.871358:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.871412:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.871443:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.871456:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.871524:0:8097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867312768 00000100:00100000:2.0:1746142908.871532:0:8097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867312768 00000100:00100000:2.0:1746142908.871570:0:8097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 183 00000100:00100000:2.0:1746142908.871578:0:8097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9590e9a3-538a-49d5-a431-e1408ed78761+15:2003:x1830962867312768:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142908.874092:0:8097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130dda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9590e9a3-538a-49d5-a431-e1408ed78761+15:2003:x1830962867312768:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 2506us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.874104:0:8097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 183 00000100:00100000:2.0:1746142908.874166:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867313280 00000100:00100000:2.0:1746142908.874172:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867313280 00000100:00100000:2.0:1746142908.874205:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 551 00000100:00100000:2.0:1746142908.874211:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867313280:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142908.874257:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867313280:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 46us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.874263:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 551 00000100:00100000:0.0:1746142908.878637:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.880491:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867313024 00000100:00100000:1.0:1746142908.880500:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867313024 00000100:00100000:1.0:1746142908.880550:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867312896 00000100:00100000:1.0:1746142908.880552:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867312896 00000100:00100000:0.0:1746142908.880930:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867312640:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20447us (20654us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746142908.880939:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4300 00002000:00100000:0.0:1746142908.880948:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009862c380 x1830962867312640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142908.880957:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862c380 with x1830962867312640 ext(4194304->5033983) 00002000:00010000:0.0:1746142908.880962:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009862c380 00000100:00100000:1.0:1746142908.881889:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867313152 00000100:00100000:1.0:1746142908.881895:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867313152 00000100:00100000:2.0:1746142908.882434:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 881 00000100:00100000:2.0:1746142908.882445:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+5:2003:x1830962867313024:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142908.882486:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+5:2003:x1830962867313024:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 45us (11074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.882491:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 881 00000100:00100000:2.0:1746142908.882504:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 882 00000100:00100000:2.0:1746142908.882508:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2003:x1830962867312896:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142908.882526:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2003:x1830962867312896:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 18us (11069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.882530:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 882 00000100:00100000:2.0:1746142908.882537:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 883 00000100:00100000:2.0:1746142908.882542:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+5:2003:x1830962867313152:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142908.882556:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+5:2003:x1830962867313152:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 15us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142908.882560:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 883 00000100:00080000:2.0:1746142908.882582:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746142908.891050:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.891354:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867313536 00000100:00100000:2.0:1746142908.891362:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867313536 00000100:00100000:2.0:1746142908.891428:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5243 00000100:00100000:2.0:1746142908.891436:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32302:x1830962867313536:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142908.892923:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32302:x1830962867313536:12345-192.168.204.50@tcp:35:cat.0 Request processed in 1486us (1878us total) trans 8589936562 rc 0/0 00000100:00100000:2.0:1746142908.892934:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5243 00000100:00100000:0.0:1746142908.923021:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.923107:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867313792 00000100:00100000:2.0:1746142908.923116:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867313792 00000100:00100000:2.0:1746142908.923169:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14408 00000100:00100000:2.0:1746142908.923177:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32310:x1830962867313792:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142908.923198:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.923212:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccca16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3f6 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.923292:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142908.923303:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 39 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.923308:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.923315:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142908.923338:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.923346:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 21 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.923355:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867789312:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.923561:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 39 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.923568:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 39 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.923576:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867789440:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.923595:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142908.925135:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.925184:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867313920 00000100:00100000:3.0:1746142908.925189:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867313920 00010000:00010000:3.0:1746142908.925207:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 22 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:3.0:1746142908.925235:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6321 00000100:00100000:3.0:1746142908.925241:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867313920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142908.925250:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142908.925254:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 22 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.925263:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 22 pid: 7230 timeout: 782 lvb_type: 0 00010000:00010000:3.0:1746142908.925278:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142908.925281:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142908.925291:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142908.925295:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142908.925317:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867313920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.925322:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6321 00010000:00010000:2.0:1746142908.925490:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733800/0x2fa243e067ccca08 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3ef expref: 21 pid: 7230 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.925542:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867789312:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142908.927057:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142908.927118:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314048 00000100:00100000:1.0:1746142908.927123:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314048 00010000:00010000:1.0:1746142908.927140:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 40 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:1.0:1746142908.927166:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6322 00000100:00100000:1.0:1746142908.927172:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867314048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142908.927179:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142908.927183:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 40 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.927193:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 40 pid: 7231 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142908.927206:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142908.927209:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142908.927216:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142908.927223:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142908.927235:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142908.927258:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867314048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142908.927263:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6322 00010000:00010000:2.0:1746142908.927489:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711ac00/0x2fa243e067ccc9ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3b7 expref: 39 pid: 7231 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.927500:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867789440:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.927516:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142908.927522:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142908.927526:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142908.927540:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142908.927636:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733c00/0x2fa243e067ccca16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 40 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.927650:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 39 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.927655:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142908.927657:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142908.927659:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732a00, rc 0) 00000100:00100000:2.0:1746142908.927691:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32310:x1830962867313792:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4515us (4678us total) trans 8589936563 rc 0/0 00000100:00100000:2.0:1746142908.927697:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14408 00000100:00100000:0.0:1746142908.977566:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142908.977610:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142908.977686:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314176 00000100:00100000:3.0:1746142908.977693:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314176 00000100:00100000:3.0:1746142908.977724:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314304 00000100:00100000:3.0:1746142908.977726:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314304 00000100:00100000:3.0:1746142908.977737:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14101 00000100:00100000:3.0:1746142908.977744:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867314176:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.977758:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.977770:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a3fd expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.977787:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.977789:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.977796:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.977808:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.977816:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77e00, rc 0) 00000100:00100000:3.0:1746142908.977869:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867314176:12345-192.168.204.50@tcp:101:cat.0 Request processed in 125us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.977876:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14101 00000100:00100000:3.0:1746142908.977889:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14102 00000100:00100000:3.0:1746142908.977894:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867314304:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142908.977920:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142908.977926:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a404 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142908.977935:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.977936:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142908.977940:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.977948:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142908.977954:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d76800, rc 0) 00000100:00100000:3.0:1746142908.977968:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867314304:12345-192.168.204.50@tcp:101:cat.0 Request processed in 75us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142908.977972:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14102 00000100:00100000:0.0:1746142908.988844:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.988929:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314560 00000100:00100000:2.0:1746142908.988936:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314560 00002000:00100000:2.0:1746142908.988975:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880099e89180 x1830962867314560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/0 e 0 to 0 dl 1746142919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142908.988985:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89180 with x1830962867314560 ext(1048576->2097151) 00002000:00010000:2.0:1746142908.988990:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89180 00000100:00100000:2.0:1746142908.989019:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4301 00000100:00100000:2.0:1746142908.989026:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867314560:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142908.997616:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142908.997729:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314688 00000100:00100000:2.0:1746142908.997737:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314688 00000100:00100000:2.0:1746142908.997776:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14103 00000100:00100000:2.0:1746142908.997782:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32310:x1830962867314688:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142908.997798:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142908.997812:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a40b expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.997839:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.997846:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.997852:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.997854:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142908.997857:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2998272->3145727] (req 2998272->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 28 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.997882:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142908.997892:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 13 pid: 9580 timeout: 782 lvb_type: 1 00000100:00100000:2.0:1746142908.997928:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867789568:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142908.998017:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142908.998025:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00000100:00100000:2.0:1746142908.998033:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867789696:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142908.998050:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142908.998701:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867314560:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9674us (9862us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142908.998710:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4301 00002000:00100000:3.0:1746142908.998718:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880099e89180 x1830962867314560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:59/0 lens 488/440 e 0 to 0 dl 1746142919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142908.998726:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89180 with x1830962867314560 ext(1048576->2097151) 00002000:00010000:3.0:1746142908.998730:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89180 00000100:00100000:2.0:1746142909.007544:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867789568:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.007555:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867789696:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.007580:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2998272->3145727] (req 2998272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 28 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.007595:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733c00, rc 0) 00000100:00100000:2.0:1746142909.008884:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32310:x1830962867314688:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 11098us (11271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.008893:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14103 00000100:00100000:0.0:1746142909.013853:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.015487:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314816 00000100:00100000:3.0:1746142909.015497:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314816 00010000:00010000:3.0:1746142909.015547:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 12 pid: 9580 timeout: 782 lvb_type: 1 00000100:00100000:3.0:1746142909.015578:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6323 00000100:00100000:3.0:1746142909.015585:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867314816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.015596:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.015611:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 12 pid: 9580 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142909.015622:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 12 pid: 9580 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142909.015642:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d76800/0x2fa243e067ccca32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a404 expref: 12 pid: 9580 timeout: 782 lvb_type: 1 00010000:00010000:3.0:1746142909.015667:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.015709:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867314816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 125us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.015715:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6323 00000100:00080000:2.0:1746142909.015916:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142909.018947:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.019008:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867314944 00000100:00100000:2.0:1746142909.019015:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867314944 00000100:00100000:2.0:1746142909.019047:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14104 00000100:00100000:2.0:1746142909.019053:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+11:32313:x1830962867314944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.019066:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.019080:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a412 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.019104:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.019109:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2998272->3145727] (req 2998272->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.019114:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.019118:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.019150:0:12211:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2998272->3145727] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.019161:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.019170:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732c00, rc 0) 00000100:00100000:2.0:1746142909.020835:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+12:32313:x1830962867314944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1777us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.020847:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14104 00000100:00100000:0.0:1746142909.021827:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.022919:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867315072 00000100:00100000:1.0:1746142909.022927:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867315072 00010000:00010000:1.0:1746142909.023046:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00000100:00080000:2.0:1746142909.023350:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746142909.023720:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6324 00000100:00100000:1.0:1746142909.023729:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867315072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.023740:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.023758:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142909.023769:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142909.023789:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d77400/0x2fa243e067ccc9ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3e8 expref: 28 pid: 11421 timeout: 782 lvb_type: 0 00010000:00010000:1.0:1746142909.023814:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.023815:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.023820:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.023828:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.023856:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.023865:0:11911:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.023875:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867789952:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142909.023971:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.029298:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968e9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867789952:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142909.029314:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142909.029348:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867315072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5620us (7523us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.029356:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6324 00000100:00100000:0.0:1746142909.031079:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.031235:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867315328 00000100:00100000:3.0:1746142909.031242:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867315328 00002000:00100000:3.0:1746142909.031275:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2998272->3002367) req@ffff88009734ce00 x1830962867315328/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.031284:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ce00 with x1830962867315328 ext(2998272->3002367) 00010000:00010000:3.0:1746142909.031291:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.031303:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.031309:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734ce00 00000100:00100000:3.0:1746142909.031326:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1332 00000100:00100000:3.0:1746142909.031333:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867315328:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142909.031448:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867315328:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 116us (374us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142909.031454:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1332 00002000:00100000:3.0:1746142909.031458:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2998272->3002367) req@ffff88009734ce00 x1830962867315328/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.031464:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ce00 with x1830962867315328 ext(2998272->3002367) 00010000:00010000:3.0:1746142909.031468:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.031477:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.031482:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734ce00 00000100:00100000:0.0:1746142909.035255:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.035458:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867315584 00000100:00100000:2.0:1746142909.035465:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867315584 00000100:00080000:0.0:1746142909.035568:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746142909.035799:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14105 00000100:00100000:2.0:1746142909.035809:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32310:x1830962867315584:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.035824:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.035840:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a419 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.035865:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 9 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.035873:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.035883:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.035884:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.035888:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2568191] (req 2097152->2568191) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 31 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.035941:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.035949:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 31 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746142909.035959:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790080:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.037578:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 9 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.037589:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 9 pid: 11421 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.037598:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790208:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.037632:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.040793:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.041121:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.041188:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867315712 00000100:00100000:2.0:1746142909.041195:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867315712 00002000:00100000:2.0:1746142909.041230:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2998272->3145727) req@ffff88009734fb80 x1830962867315712/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.041239:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734fb80 with x1830962867315712 ext(2998272->3145727) 00010000:00010000:2.0:1746142909.041247:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.041258:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 27 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.041264:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734fb80 00000100:00100000:2.0:1746142909.041280:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1333 00000100:00100000:2.0:1746142909.041286:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867315712:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142909.041493:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867315968 00000100:00100000:3.0:1746142909.041497:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867315968 00000100:00100000:3.0:1746142909.041525:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14409 00000100:00100000:3.0:1746142909.041530:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32316:x1830962867315968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.041543:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.041555:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067ccca4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a420 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.041603:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041612:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041622:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041631:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041637:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041641:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041711:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041718:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041723:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142909.041730:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142909.041779:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041788:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041793:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041798:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041803:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d76800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.041806:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041811:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041818:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142909.041821:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142909.041823:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.041828:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76800/0x2fa243e067ccca55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00000100:00080000:1.0:1746142909.041944:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746142909.043634:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043644:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043649:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043653:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d77600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.043657:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043662:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043673:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4f00) 00010000:00010000:3.0:1746142909.043675:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142909.043677:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043682:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77600/0x2fa243e067ccca5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.043723:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067ccca4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 42 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.043733:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.043739:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.043740:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142909.043742:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445000, rc 0) 00000100:00100000:3.0:1746142909.043778:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32316:x1830962867315968:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2247us (2657us total) trans 8589936564 rc 0/0 00000100:00100000:3.0:1746142909.043785:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14409 00000100:00100000:0.0:1746142909.045209:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.045370:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867316096 00000100:00100000:1.0:1746142909.045377:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867316096 00010000:00010000:1.0:1746142909.045410:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 32 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746142909.045439:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6325 00000100:00100000:1.0:1746142909.045445:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867316096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.045457:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.045472:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 32 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746142909.045481:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 32 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746142909.045500:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142909.045521:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867316096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.045526:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6325 00010000:00010000:2.0:1746142909.045969:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52e00/0x2fa243e067ccc9c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3c5 expref: 31 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746142909.045985:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790080:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.045993:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790208:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.046013:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2568191] (req 2097152->2568191) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 30 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.046022:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732400, rc 0) 00000100:00100000:2.0:1746142909.046039:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32310:x1830962867315584:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 10233us (10792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.046044:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14105 00000100:00100000:1.0:1746142909.046786:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867315712:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 5497us (5996us total) trans 21474841178 rc 0/0 00000100:00100000:1.0:1746142909.046793:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1333 00002000:00100000:1.0:1746142909.046801:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2998272->3145727) req@ffff88009734fb80 x1830962867315712/t21474841178(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.046809:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734fb80 with x1830962867315712 ext(2998272->3145727) 00010000:00010000:1.0:1746142909.046815:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.046825:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.046830:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734fb80 00000100:00100000:2.0:1746142909.053447:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.053532:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.053604:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867316224 00000100:00100000:3.0:1746142909.053612:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867316224 00010000:00010000:3.0:1746142909.053650:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 10 pid: 11421 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.053677:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867316352 00000100:00100000:3.0:1746142909.053679:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867316352 00010000:00010000:3.0:1746142909.053688:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.053702:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6326 00000100:00100000:3.0:1746142909.053708:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867316224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.053719:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.053736:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 10 pid: 11421 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.053746:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 10 pid: 11421 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.053764:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067ccc983 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a39b expref: 10 pid: 11421 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.053780:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.053782:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.053788:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.053795:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.053822:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.053834:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867790336:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.053894:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.053929:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6327 00000100:00100000:3.0:1746142909.053935:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867316352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.053942:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.053954:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.053962:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.053974:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092733c00/0x2fa243e067ccca39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2998272->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a40b expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.053982:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.053983:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.053986:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.053993:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.054009:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.054021:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867790464:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.054050:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00080000:0.0:1746142909.054333:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142909.055587:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.056296:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.056383:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867316480 00000100:00100000:1.0:1746142909.056389:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867316480 00000100:00100000:1.0:1746142909.057193:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867316608 00000100:00100000:1.0:1746142909.057198:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867316608 00000100:00100000:3.0:1746142909.057241:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867790336:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.057256:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.057437:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14106 00000100:00100000:2.0:1746142909.057447:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867316480:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.057461:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.057473:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a427 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.057489:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.057491:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.057497:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 30 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.057510:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 30 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.057519:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d800, rc 0) 00000100:00100000:2.0:1746142909.057547:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867316480:12345-192.168.204.50@tcp:101:cat.0 Request processed in 104us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.057553:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14106 00000100:00100000:2.0:1746142909.057568:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14107 00000100:00100000:2.0:1746142909.057573:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867316608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.057579:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.057587:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca78 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a42e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.057616:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790592:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.057663:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.057999:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867316224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4289us (4560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.058006:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6326 00000100:00100000:0.0:1746142909.058656:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.059937:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867316864 00000100:00100000:1.0:1746142909.059946:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867316864 00002000:00100000:1.0:1746142909.059977:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2564096->2568191) req@ffff88009734e680 x1830962867316864/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.059986:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e680 with x1830962867316864 ext(2564096->2568191) 00002000:00010000:1.0:1746142909.059990:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734e680 00000100:00100000:1.0:1746142909.060010:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4302 00000100:00100000:1.0:1746142909.060017:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867316864:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142909.060134:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867316864:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 117us (1479us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142909.060140:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4302 00002000:00100000:1.0:1746142909.060145:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2564096->2568191) req@ffff88009734e680 x1830962867316864/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.060151:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e680 with x1830962867316864 ext(2564096->2568191) 00002000:00010000:1.0:1746142909.060154:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734e680 00000100:00100000:3.0:1746142909.061146:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867790464:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.061161:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.061187:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867316352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7252us (7654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.061194:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6327 00000100:00100000:0.0:1746142909.061388:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790592:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142909.061417:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca78 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a42e expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.061426:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca78 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a42e expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.061437:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d200, rc 0) 00000100:00100000:0.0:1746142909.061453:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867316608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3881us (5159us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142909.061459:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14107 00000100:00100000:0.0:1746142909.063883:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.064073:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867317120 00000100:00100000:2.0:1746142909.064080:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867317120 00002000:00100000:2.0:1746142909.064111:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009734c380 x1830962867317120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.064120:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c380 with x1830962867317120 ext(2097152->3145727) 00002000:00010000:2.0:1746142909.064123:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734c380 00000100:00100000:2.0:1746142909.064138:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4303 00000100:00100000:2.0:1746142909.064145:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867317120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.082569:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867317120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18415us (18683us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142909.082580:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4303 00002000:00100000:2.0:1746142909.082591:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009734c380 x1830962867317120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.082599:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c380 with x1830962867317120 ext(2097152->3145727) 00002000:00010000:2.0:1746142909.082605:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734c380 00000100:00100000:0.0:1746142909.085110:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.085220:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867317248 00000100:00100000:2.0:1746142909.085228:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867317248 00000100:00100000:2.0:1746142909.085268:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14108 00000100:00100000:2.0:1746142909.085274:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+9:32313:x1830962867317248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.085289:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.085303:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a435 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.085326:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.085332:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.085334:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.085337:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.085361:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.085371:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 29 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.085381:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790720:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.087521:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.094725:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfeca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867790720:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.094753:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.094768:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d200, rc 0) 00000100:00100000:2.0:1746142909.094811:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:32313:x1830962867317248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 9536us (9706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.094818:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14108 00000100:00100000:1.0:1746142909.094959:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.095002:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.095026:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.095048:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.095062:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867317376 00000100:00100000:1.0:1746142909.095067:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867317376 00002000:00100000:1.0:1746142909.095096:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2568191) req@ffff8800968e9180 x1830962867317376/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142909.095407:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867317504 00000100:00100000:3.0:1746142909.095411:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867317504 00000100:00100000:3.0:1746142909.095433:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14109 00000100:00100000:3.0:1746142909.095439:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:32307:x1830962867317504:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142909.095448:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.095458:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a43c expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.095474:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.095478:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.095487:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142909.095490:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.095513:0:12211:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.095522:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.095533:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322800, rc 0) 00000100:00100000:3.0:1746142909.095554:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+11:32307:x1830962867317504:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 115us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.095559:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14109 00000100:00100000:2.0:1746142909.095614:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867317760 00002000:00100000:1.0:1746142909.095614:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9180 with x1830962867317376 ext(2097152->2568191) 00000100:00100000:2.0:1746142909.095618:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867317760 00010000:00010000:1.0:1746142909.095621:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 30 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.095632:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 30 pid: 12211 timeout: 783 lvb_type: 0 00002000:00100000:2.0:1746142909.095633:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012c0e3800 x1830962867317760/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142909.095635:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867318016 00000100:00100000:3.0:1746142909.095637:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867318016 00002000:00010000:1.0:1746142909.095638:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e9180 00002000:00100000:2.0:1746142909.095641:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e3800 with x1830962867317760 ext(2097152->4194303) 00002000:00010000:2.0:1746142909.095644:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e3800 00002000:00100000:3.0:1746142909.095646:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2568192->4194303) req@ffff880093bcc700 x1830962867318016/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.095652:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcc700 with x1830962867318016 ext(2568192->4194303) 00000100:00100000:1.0:1746142909.095652:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1334 00010000:00010000:3.0:1746142909.095657:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 31 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.095658:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867317376:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142909.095661:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4304 00010000:00010000:3.0:1746142909.095666:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 31 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.095667:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867317760:12345-192.168.204.50@tcp:3:cat.0 00002000:00010000:3.0:1746142909.095675:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bcc700 00000100:00100000:3.0:1746142909.095689:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1335 00000100:00100000:3.0:1746142909.095693:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2003:x1830962867318016:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142909.107924:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746142909.111939:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867317376:12345-192.168.204.50@tcp:4:cat.0 Request processed in 16271us (16969us total) trans 17179873917 rc 0/0 00000100:00100000:2.0:1746142909.111949:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1334 00002000:00100000:2.0:1746142909.111959:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2568191) req@ffff8800968e9180 x1830962867317376/t17179873917(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.111967:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9180 with x1830962867317376 ext(2097152->2568191) 00010000:00010000:2.0:1746142909.111976:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 34 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.111988:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 34 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.111994:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968e9180 00000100:00100000:1.0:1746142909.114177:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.116047:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867318016:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20346us (20990us total) trans 0 rc 1626112/1626112 00000100:00100000:2.0:1746142909.116056:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1335 00002000:00100000:2.0:1746142909.116067:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2568192->4194303) req@ffff880093bcc700 x1830962867318016/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 1626112/1626112 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.116076:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcc700 with x1830962867318016 ext(2568192->4194303) 00010000:00010000:2.0:1746142909.116084:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.116101:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867318144 00010000:00010000:2.0:1746142909.116102:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.116108:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867318144 00002000:00010000:2.0:1746142909.116113:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bcc700 00000100:00100000:3.0:1746142909.116147:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14410 00000100:00100000:3.0:1746142909.116154:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:32318:x1830962867318144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142909.116171:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.116184:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067ccca8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a443 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.116224:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116234:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116241:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116251:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116256:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116260:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116315:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116324:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 40 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.116330:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.116353:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 40 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.116361:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 40 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.116370:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867790976:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.116469:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.119767:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.119930:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867318400 00000100:00100000:2.0:1746142909.119939:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867318400 00000100:00100000:3.0:1746142909.119996:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867790976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.120017:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142909.120042:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5244 00000100:00100000:2.0:1746142909.120051:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4851850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:16986:x1830962867318400:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142909.120360:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4851850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:16986:x1830962867318400:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 308us (598us total) trans 8589936565 rc 0/0 00000100:00100000:2.0:1746142909.120367:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5244 00000100:00100000:0.0:1746142909.126343:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.127947:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867318528 00000100:00100000:3.0:1746142909.127959:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867318528 00010000:00010000:3.0:1746142909.127994:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.128031:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6328 00000100:00100000:3.0:1746142909.128038:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867318528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.128052:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.128068:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.128079:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.128098:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092732400/0x2fa243e067ccca47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2568191) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a419 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.128132:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.128134:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.128140:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.128148:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.128177:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.128186:0:8381:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 10 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.128196:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867791104:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.128274:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.128546:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867317760:12345-192.168.204.50@tcp:3:cat.0 Request processed in 32877us (33517us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142909.128554:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4304 00002000:00100000:2.0:1746142909.128562:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012c0e3800 x1830962867317760/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.128571:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e3800 with x1830962867317760 ext(2097152->4194303) 00002000:00010000:2.0:1746142909.128575:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e3800 00000100:00100000:0.0:1746142909.129605:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.130189:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867318656 00000100:00100000:1.0:1746142909.130195:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867318656 00010000:00010000:1.0:1746142909.130215:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 42 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.130241:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6329 00000100:00100000:1.0:1746142909.130248:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867318656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.130257:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.130262:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 42 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.130271:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 42 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.130286:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccca1d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3f6 expref: 42 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.130314:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142909.130319:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.130326:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.130332:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.130347:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142909.130536:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130543:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142909.130583:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:3.0:1746142909.130587:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142909.130601:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130610:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130619:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130624:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130629:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130634:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130640:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.130643:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130648:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130656:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142909.130658:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142909.130661:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130666:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067ccca94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130675:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130679:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130683:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130688:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.130691:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130695:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130700:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4b00) 00010000:00010000:3.0:1746142909.130702:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142909.130704:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130708:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067ccca9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.130733:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067ccca8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.130743:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 14 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.130753:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.130755:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142909.130757:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107a00, rc 0) 00000100:00100000:1.0:1746142909.130942:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867318656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 693us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.130948:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6329 00000100:00100000:3.0:1746142909.131383:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:32318:x1830962867318144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 15228us (17211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.131390:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14410 00000100:00100000:0.0:1746142909.137427:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.138008:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867791104:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.138024:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.138067:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867318528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10028us (11731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.138076:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6328 00000100:00100000:2.0:1746142909.138215:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867318912 00000100:00100000:2.0:1746142909.138221:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867318912 00002000:00100000:2.0:1746142909.138251:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009734e300 x1830962867318912/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.138261:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e300 with x1830962867318912 ext(4194304->5033983) 00002000:00010000:2.0:1746142909.138265:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734e300 00000100:00100000:2.0:1746142909.138284:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4305 00000100:00100000:2.0:1746142909.138290:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867318912:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.139389:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867791232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746142909.140067:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.140091:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.140107:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867319424 00000100:00100000:1.0:1746142909.140111:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867319424 00002000:00100000:1.0:1746142909.140131:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800924f6a00 x1830962867319424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.140139:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f6a00 with x1830962867319424 ext(2097152->4194303) 00010000:00010000:1.0:1746142909.140147:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.140160:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.140173:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924f6a00 00000100:00100000:1.0:1746142909.140188:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1336 00000100:00100000:1.0:1746142909.140194:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867319424:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142909.140958:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867319040 00000100:00100000:2.0:1746142909.140963:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867319040 00000100:00100000:2.0:1746142909.140985:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14110 00000100:00100000:2.0:1746142909.140990:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32316:x1830962867319040:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.141000:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.141011:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a44a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.141029:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.141034:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.141039:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.141042:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.141065:0:1854:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.141074:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.141082:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d000, rc 0) 00000100:00100000:2.0:1746142909.141101:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32316:x1830962867319040:12345-192.168.204.50@tcp:101:cat.0 Request processed in 111us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.141106:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14110 00000100:00100000:3.0:1746142909.141222:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142909.141303:0:13943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867791232 00000100:00100000:2.0:1746142909.141307:0:13943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867791232 00000100:00100000:2.0:1746142909.141344:0:13943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1746142909.141349:0:13943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830962867791232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746142909.141361:0:13943:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1183886144 pending 1761280 free 3906637824 avail 3675115520 00000100:00100000:2.0:1746142909.141405:0:13943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830962867791232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.141411:0:13943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00080000:3.0:1746142909.141457:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746142909.141484:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867791232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746142909.141940:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.141980:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.142067:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.142178:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867319680 00000100:00100000:3.0:1746142909.142182:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867319680 00000100:00100000:0.0:1746142909.142202:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867319552 00000100:00100000:3.0:1746142909.142204:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867319808 00000100:00100000:3.0:1746142909.142205:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867319808 00000100:00100000:0.0:1746142909.142205:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867319552 00000100:00100000:3.0:1746142909.142218:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14111 00000100:00100000:0.0:1746142909.142221:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14112 00000100:00100000:3.0:1746142909.142222:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867319680:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1746142909.142225:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867319808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142909.142230:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.142230:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.142238:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a458 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.142238:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067cccab0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a45f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.142251:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.142251:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.142253:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.142257:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067cccab0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a45f expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.142258:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 9 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.142265:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067cccab0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a45f expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.142276:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2000, rc 0) 00000100:00100000:0.0:1746142909.142296:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867319808:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 70us (229us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142909.142301:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14112 00000100:00100000:0.0:1746142909.142312:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14113 00000100:00100000:0.0:1746142909.142316:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867319552:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142909.142321:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.142326:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a451 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.142335:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.142336:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.142340:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.142351:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.142359:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3e00, rc 0) 00000100:00100000:0.0:1746142909.142373:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867319552:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 56us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.142377:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14113 00010000:00010000:3.0:1746142909.142461:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 9 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.142468:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107400, rc 0) 00000100:00100000:3.0:1746142909.142488:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867319680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 265us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.142493:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14111 00000100:00080000:3.0:1746142909.142505:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746142909.142507:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142909.144497:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.144544:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867319936 00000100:00100000:1.0:1746142909.144551:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867319936 00002000:00100000:1.0:1746142909.144579:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009734d180 x1830962867319936/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.144589:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d180 with x1830962867319936 ext(3145728->4194303) 00002000:00010000:1.0:1746142909.144594:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734d180 00000100:00100000:1.0:1746142909.144619:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4306 00000100:00100000:1.0:1746142909.144626:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867319936:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142909.150422:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.150491:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867318912:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12198us (13069us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746142909.150500:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4305 00002000:00100000:3.0:1746142909.150509:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009734e300 x1830962867318912/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.150516:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e300 with x1830962867318912 ext(4194304->5033983) 00002000:00010000:3.0:1746142909.150521:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734e300 00000100:00100000:0.0:1746142909.150626:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867320192 00000100:00100000:0.0:1746142909.150632:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867320192 00000100:00100000:0.0:1746142909.151419:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14411 00000100:00100000:0.0:1746142909.151426:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:32318:x1830962867320192:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142909.151440:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.151455:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cccac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a466 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.151531:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.151543:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.151551:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.151574:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.151584:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 15 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746142909.151592:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867791488:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142909.151659:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.154975:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867791488:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142909.154996:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142909.158067:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.158588:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867320320 00000100:00100000:3.0:1746142909.158596:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867320320 00010000:00010000:3.0:1746142909.158627:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.158673:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6330 00000100:00100000:3.0:1746142909.158680:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867320320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.158691:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.158697:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.158707:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.158724:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107a00/0x2fa243e067cccaa2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a443 expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.158738:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.158742:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.158751:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.158757:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.158780:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.158823:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867320320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 143us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.158829:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6330 00010000:00010000:0.0:1746142909.159501:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.159509:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142909.159525:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142909.159623:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067cccac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.159638:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.159644:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142909.159647:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142909.159649:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa50200, rc 0) 00000100:00100000:0.0:1746142909.159671:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32318:x1830962867320192:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 8247us (9258us total) trans 8589936566 rc 0/0 00000100:00100000:0.0:1746142909.159681:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14411 00000100:00100000:1.0:1746142909.160164:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867319424:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 19969us (20071us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142909.160172:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1336 00002000:00100000:1.0:1746142909.160179:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800924f6a00 x1830962867319424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.160187:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f6a00 with x1830962867319424 ext(2097152->4194303) 00010000:00010000:1.0:1746142909.160194:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.160205:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.160214:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924f6a00 00000100:00100000:1.0:1746142909.164703:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867319936:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 20069us (20204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142909.164713:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4306 00002000:00100000:1.0:1746142909.164722:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009734d180 x1830962867319936/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.164730:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d180 with x1830962867319936 ext(3145728->4194303) 00002000:00010000:1.0:1746142909.164735:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734d180 00000100:00100000:0.0:1746142909.165992:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.166088:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867320448 00000100:00100000:2.0:1746142909.166095:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867320448 00000100:00100000:2.0:1746142909.166140:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14412 00000100:00100000:2.0:1746142909.166146:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32318:x1830962867320448:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142909.166164:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.166179:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3cc00/0x2fa243e067cccada lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a46d expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.166252:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.166265:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.166271:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.166295:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.166305:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.166315:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867791616:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.166387:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.166775:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.166885:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867320576 00000100:00100000:3.0:1746142909.166890:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867320576 00010000:00010000:3.0:1746142909.166936:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.166955:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6331 00000100:00100000:3.0:1746142909.166960:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867320576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.166969:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.166983:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.166993:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.167009:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d200/0x2fa243e067ccca7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a435 expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.167031:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.167033:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.167039:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.167045:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.167067:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 10 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.167074:0:8381:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 10 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.167082:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867791744:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.167117:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.169477:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.169518:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.169684:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfed880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867791616:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.169704:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:3.0:1746142909.169770:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867320704 00000100:00100000:3.0:1746142909.169775:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867320704 00000100:00100000:3.0:1746142909.169809:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14114 00000100:00100000:3.0:1746142909.169815:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:32313:x1830962867320704:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.169833:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.169845:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a474 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.169865:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.169867:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.169871:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.169879:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.169888:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107800, rc 0) 00000100:00100000:1.0:1746142909.170175:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867320832 00000100:00100000:1.0:1746142909.170179:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867320832 00010000:00010000:1.0:1746142909.170194:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 17 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.170211:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6332 00000100:00100000:1.0:1746142909.170221:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867320832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.170230:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.170235:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 17 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.170244:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 17 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.170259:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067cccacc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a466 expref: 17 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.170277:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142909.170280:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.170288:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.170294:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.170306:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142909.170342:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.170350:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142909.170389:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:2.0:1746142909.170402:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142909.170414:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.170436:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3cc00/0x2fa243e067cccada lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 17 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.170453:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.170458:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142909.170460:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142909.170462:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3ca00, rc 0) 00000100:00100000:3.0:1746142909.170614:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:32313:x1830962867320704:12345-192.168.204.50@tcp:101:cat.0 Request processed in 797us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.170621:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14114 00000100:00100000:1.0:1746142909.170699:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867320832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 482us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.170704:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6332 00000100:00100000:2.0:1746142909.170966:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32318:x1830962867320448:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4820us (4976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.170976:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14412 00000100:00100000:3.0:1746142909.171588:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867791744:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.171598:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.171638:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867320576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4677us (4862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.171644:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6331 00000100:00100000:0.0:1746142909.172072:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.172352:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867321088 00000100:00100000:1.0:1746142909.172357:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867321088 00002000:00100000:1.0:1746142909.172385:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2445312->2449407) req@ffff88009734c700 x1830962867321088/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.172404:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c700 with x1830962867321088 ext(2445312->2449407) 00010000:00010000:1.0:1746142909.172411:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.172422:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.172428:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734c700 00000100:00100000:1.0:1746142909.172452:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1337 00000100:00100000:1.0:1746142909.172458:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867321088:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142909.172559:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867321088:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 101us (487us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142909.172565:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1337 00002000:00100000:1.0:1746142909.172570:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2445312->2449407) req@ffff88009734c700 x1830962867321088/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.172577:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c700 with x1830962867321088 ext(2445312->2449407) 00010000:00010000:1.0:1746142909.172581:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.172590:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.172595:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734c700 00000100:00100000:0.0:1746142909.173645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.173702:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867321216 00000100:00100000:3.0:1746142909.173707:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867321216 00000100:00100000:3.0:1746142909.173741:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14115 00000100:00100000:3.0:1746142909.173746:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867321216:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142909.173757:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.173767:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccaef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a47b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.173802:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867791872:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.173869:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.179856:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.179996:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867321472 00000100:00100000:2.0:1746142909.180003:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867321472 00000100:00100000:3.0:1746142909.180027:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867791872:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.180054:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccaef lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a47b expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.180066:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccaef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a47b expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.180082:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107000, rc 0) 00000100:00100000:3.0:1746142909.180408:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867321216:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6659us (6762us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142909.180414:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14116 00000100:00100000:2.0:1746142909.180533:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+12:32307:x1830962867321472:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.180545:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.180558:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a482 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.180580:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.180589:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 8 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.180595:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 28 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.180601:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.180603:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.180605:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.180628:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 28 pid: 12211 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142909.180634:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14115 00010000:00010000:2.0:1746142909.180637:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 28 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746142909.180648:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792000:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.180717:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 8 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.180724:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 8 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746142909.180731:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792128:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.180754:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.180762:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.180769:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792256:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.180784:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880097e6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.181588:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.181635:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867321600 00000100:00100000:1.0:1746142909.181641:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867321600 00002000:00100000:1.0:1746142909.181665:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2445312->3145727) req@ffff88009a28c380 x1830962867321600/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.181673:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c380 with x1830962867321600 ext(2445312->3145727) 00010000:00010000:1.0:1746142909.181679:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.181688:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 11 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.181694:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a28c380 00000100:00100000:1.0:1746142909.181944:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1338 00000100:00100000:1.0:1746142909.181951:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867321600:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142909.185367:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792000:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.185378:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792128:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.185387:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792256:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.185423:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->3485695] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.185439:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c200, rc 0) 00000100:00100000:3.0:1746142909.185528:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+13:32307:x1830962867321472:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5106us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.185536:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14116 00000100:00100000:2.0:1746142909.187674:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.187997:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867321984 00000100:00100000:3.0:1746142909.188005:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867321984 00010000:00010000:3.0:1746142909.188037:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 9 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.188073:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6333 00000100:00100000:3.0:1746142909.188081:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867321984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.188094:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.188111:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 9 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746142909.188120:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 9 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746142909.188138:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccab7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a458 expref: 9 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:1.0:1746142909.188232:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142909.188258:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142909.188261:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867322112 00000100:00100000:0.0:1746142909.188264:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867322112 00000100:00100000:1.0:1746142909.188275:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142909.188275:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746142909.188291:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867322240 00000100:00100000:0.0:1746142909.188292:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867322240 00000100:00100000:3.0:1746142909.188295:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867321984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 215us (628us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142909.188298:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 29 pid: 12211 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.188301:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6333 00000100:00100000:1.0:1746142909.188306:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6334 00000100:00100000:1.0:1746142909.188313:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867322112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142909.188314:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6335 00000100:00100000:0.0:1746142909.188317:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4839c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867322240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.188321:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142909.188322:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142909.188327:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 29 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746142909.188330:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.188333:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 29 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:0.0:1746142909.188341:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccca71 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a427 expref: 29 pid: 12211 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746142909.188344:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.188356:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.188357:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092732c00/0x2fa243e067ccca40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a412 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.188357:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.188361:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.188366:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.188372:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142909.188385:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 12 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142909.188405:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867792384:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142909.188408:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867322112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.188414:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6334 00000100:00100000:0.0:1746142909.188459:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.188726:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.189164:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867321856 00000100:00100000:3.0:1746142909.189168:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867321856 00000100:00100000:3.0:1746142909.189192:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14413 00000100:00100000:3.0:1746142909.189197:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32318:x1830962867321856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142909.189210:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.189222:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x2fa243e067cccafd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a489 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.189284:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189295:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189304:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189313:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189319:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189324:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189329:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097107e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.189332:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189341:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189349:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.189351:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142909.189354:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189358:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107e00/0x2fa243e067cccb04 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.189376:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x2fa243e067cccafd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a489 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.189382:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107600/0x2fa243e067cccafd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a489 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.189388:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107600, rc 0) 00000100:00100000:3.0:1746142909.189426:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32318:x1830962867321856:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 228us (699us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.189431:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14413 00000100:00100000:0.0:1746142909.189565:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867321600:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 7614us (7978us total) trans 17179873918 rc 0/0 00000100:00100000:0.0:1746142909.189573:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1338 00002000:00100000:0.0:1746142909.189580:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2445312->3145727) req@ffff88009a28c380 x1830962867321600/t17179873918(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.189588:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c380 with x1830962867321600 ext(2445312->3145727) 00010000:00010000:0.0:1746142909.189594:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.189609:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746142909.189615:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a28c380 00000100:00100000:2.0:1746142909.191993:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a28d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867792384:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142909.192011:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.192054:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4839c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867322240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3734us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.192062:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6335 00000100:00100000:0.0:1746142909.192961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.194173:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867322496 00000100:00100000:2.0:1746142909.194181:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867322496 00000100:00100000:2.0:1746142909.194231:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5245 00000100:00100000:2.0:1746142909.194237:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32318:x1830962867322496:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142909.194437:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:32318:x1830962867322496:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 199us (1478us total) trans 8589936567 rc 0/0 00000100:00100000:2.0:1746142909.194444:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5245 00000100:00100000:2.0:1746142909.201254:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.201295:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.201368:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867322880 00000100:00100000:3.0:1746142909.201376:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867322880 00010000:00010000:3.0:1746142909.201418:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.201442:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6336 00000100:00100000:3.0:1746142909.201447:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867322880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.201461:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.201477:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.201486:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.201505:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131322800/0x2fa243e067ccca86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a43c expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.201520:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.201521:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.201527:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.201534:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.201541:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.201542:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.201544:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.201550:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.201573:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.201586:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867792512:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.203496:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.203511:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867792640:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.208477:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.208623:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867322752 00000100:00100000:0.0:1746142909.208633:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867322752 00002000:00100000:0.0:1746142909.208673:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3481600->3485695) req@ffff88009cfee680 x1830962867322752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.208682:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee680 with x1830962867322752 ext(3481600->3485695) 00002000:00010000:0.0:1746142909.208686:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfee680 00000100:00100000:0.0:1746142909.208706:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4307 00000100:00100000:0.0:1746142909.208714:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867322752:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142909.208830:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867322752:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 115us (7831us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142909.208836:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4307 00002000:00100000:0.0:1746142909.208840:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3481600->3485695) req@ffff88009cfee680 x1830962867322752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.208846:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee680 with x1830962867322752 ext(3481600->3485695) 00002000:00010000:0.0:1746142909.208848:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfee680 00000100:00100000:3.0:1746142909.208857:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.208936:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867323264 00000100:00100000:3.0:1746142909.208940:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867323264 00000100:00100000:3.0:1746142909.208966:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14414 00000100:00100000:3.0:1746142909.208971:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32321:x1830962867323264:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:2.0:1746142909.208986:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142909.208988:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142909.209000:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867323520 00010000:00010000:3.0:1746142909.209003:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccb0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a490 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.209003:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867323520 00002000:00100000:2.0:1746142909.209020:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009cfef480 x1830962867323520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.209027:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfef480 with x1830962867323520 ext(3145728->4194303) 00002000:00010000:2.0:1746142909.209030:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfef480 00000100:00100000:2.0:1746142909.209041:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4308 00000100:00100000:2.0:1746142909.209047:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867323520:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:3.0:1746142909.209055:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209065:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209088:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209099:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209104:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209110:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209188:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209198:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209203:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142909.209209:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142909.209269:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209274:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209279:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209284:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209289:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.209292:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209298:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209307:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142909.209309:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142909.209313:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209317:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106200/0x2fa243e067cccb12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209326:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209331:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209335:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209338:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097106400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142909.209340:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209344:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209348:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4f00) 00010000:00010000:3.0:1746142909.209351:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142909.209352:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209356:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106400/0x2fa243e067cccb19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.209385:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccb0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 44 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.209409:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 43 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.209415:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.209417:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142909.209419:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106e00, rc 0) 00000100:00100000:3.0:1746142909.209440:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32321:x1830962867323264:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 469us (585us total) trans 8589936568 rc 0/0 00000100:00100000:3.0:1746142909.209447:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14414 00000100:00100000:3.0:1746142909.209491:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867792512:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.217296:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867792640:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.217320:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.218162:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867322880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 16712us (16864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.218170:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6336 00000100:00100000:0.0:1746142909.218788:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.218933:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867323776 00000100:00100000:2.0:1746142909.218942:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867323776 00000100:00100000:2.0:1746142909.218990:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5246 00000100:00100000:2.0:1746142909.218999:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:32307:x1830962867323776:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142909.219190:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:32307:x1830962867323776:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 191us (402us total) trans 8589936569 rc 0/0 00000100:00100000:2.0:1746142909.219197:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5246 00000100:00080000:3.0:1746142909.219349:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142909.222385:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.223154:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324032 00000100:00100000:1.0:1746142909.223161:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324032 00002000:00100000:1.0:1746142909.223196:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88009a28f100 x1830962867324032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.223206:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28f100 with x1830962867324032 ext(2097152->3145727) 00002000:00010000:1.0:1746142909.223212:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28f100 00000100:00100000:1.0:1746142909.223241:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4309 00000100:00100000:1.0:1746142909.223248:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867324032:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.233226:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867323520:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 24172us (24232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142909.233234:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4308 00002000:00100000:2.0:1746142909.233243:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009cfef480 x1830962867323520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.233248:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfef480 with x1830962867323520 ext(3145728->4194303) 00002000:00010000:2.0:1746142909.233252:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfef480 00000100:00100000:1.0:1746142909.238586:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867324032:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15329us (16711us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142909.238597:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4309 00002000:00100000:1.0:1746142909.238606:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88009a28f100 x1830962867324032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.238615:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28f100 with x1830962867324032 ext(2097152->3145727) 00002000:00010000:1.0:1746142909.238620:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28f100 00000100:00100000:0.0:1746142909.247874:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.247937:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.248013:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324288 00000100:00100000:1.0:1746142909.248022:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324288 00002000:00100000:1.0:1746142909.248058:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009a28df80 x1830962867324288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.248067:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28df80 with x1830962867324288 ext(4194304->5033983) 00002000:00010000:1.0:1746142909.248072:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28df80 00000100:00100000:1.0:1746142909.248104:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4310 00000100:00100000:1.0:1746142909.248111:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867324288:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.248320:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324416 00000100:00100000:3.0:1746142909.248324:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324416 00000100:00100000:3.0:1746142909.248347:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14117 00000100:00100000:3.0:1746142909.248352:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32316:x1830962867324416:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.248360:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.248373:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a497 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.248402:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.248408:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.248410:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.248413:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.248461:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.248471:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.248480:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792768:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.253570:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.262750:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.262804:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792768:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.262832:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 29 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.262846:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107e00, rc 0) 00000100:00100000:2.0:1746142909.262870:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324544 00000100:00100000:2.0:1746142909.262875:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324544 00000100:00100000:3.0:1746142909.262882:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32316:x1830962867324416:12345-192.168.204.50@tcp:101:cat.0 Request processed in 14530us (14946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.262889:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14117 00002000:00100000:2.0:1746142909.262925:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3485695) req@ffff88009a28d180 x1830962867324544/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.262933:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d180 with x1830962867324544 ext(3145728->3485695) 00010000:00010000:2.0:1746142909.262939:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.262950:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.262955:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28d180 00000100:00100000:2.0:1746142909.262969:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1339 00000100:00100000:2.0:1746142909.262977:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867324544:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142909.263013:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867324288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14902us (15146us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142909.263018:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4310 00002000:00100000:1.0:1746142909.263023:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009a28df80 x1830962867324288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.263034:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28df80 with x1830962867324288 ext(4194304->5033983) 00010000:00010000:1.0:1746142909.263037:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.263045:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.263050:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28df80 00000100:00100000:2.0:1746142909.269231:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867324544:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6247us (6482us total) trans 21474841179 rc 0/0 00000100:00100000:2.0:1746142909.269242:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1339 00002000:00100000:2.0:1746142909.269251:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3485695) req@ffff88009a28d180 x1830962867324544/t21474841179(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.269264:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d180 with x1830962867324544 ext(3145728->3485695) 00010000:00010000:2.0:1746142909.269272:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.269284:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.269289:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a28d180 00000100:00100000:0.0:1746142909.272657:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.272993:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324672 00000100:00100000:3.0:1746142909.273001:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324672 00000100:00100000:3.0:1746142909.273047:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14118 00000100:00100000:3.0:1746142909.273054:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867324672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.273068:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.273082:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccb35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a49e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.273126:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792896:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.273202:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.275054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142909.275180:0:12211:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from glimpse AST (req@ffff88009862ce00 x1830962867792896) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 15 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.275206:0:12211:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 15 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.275223:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c200/0x2fa243e067cccaf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3485695) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a482 expref: 15 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.275236:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867792896:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142909.275251:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.275253:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.275259:0:12211:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 28 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.275265:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 28 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.275293:0:12211:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 28 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.275301:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867793024:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.275354:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.276938:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867793024:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142909.276960:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccb35 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a49e expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.276971:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107400/0x2fa243e067cccb35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a49e expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.276979:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107400, rc 0) 00000100:00100000:2.0:1746142909.277004:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867324672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3951us (4354us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142909.277011:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14118 00000100:00100000:3.0:1746142909.278154:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324800 00000100:00100000:3.0:1746142909.278161:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324800 00000100:00100000:3.0:1746142909.278253:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 762 00000100:00100000:3.0:1746142909.278259:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867324800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.278270:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.278272:0:7217:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 2fa243e067cccaf6) 00010000:00010000:3.0:1746142909.278273:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.279234:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867324800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 973us (4181us total) trans 0 rc 116/116 00000100:00100000:3.0:1746142909.279240:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 762 00000100:00100000:1.0:1746142909.279309:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.279933:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867324928 00000100:00100000:1.0:1746142909.279937:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867324928 00000100:00100000:1.0:1746142909.279961:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14119 00000100:00100000:1.0:1746142909.279966:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+13:32313:x1830962867324928:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.279977:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.279988:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4a5 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.280004:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.280005:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.280011:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 14 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.280021:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 14 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.280029:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092131200, rc 0) 00000100:00100000:1.0:1746142909.280062:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:32313:x1830962867324928:12345-192.168.204.50@tcp:101:cat.0 Request processed in 96us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.280067:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14119 00000100:00100000:0.0:1746142909.286093:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.286146:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867325184 00000100:00100000:2.0:1746142909.286154:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867325184 00002000:00100000:2.0:1746142909.286194:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff88009a28ca80 x1830962867325184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.286204:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ca80 with x1830962867325184 ext(5029888->5033983) 00002000:00010000:2.0:1746142909.286209:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ca80 00000100:00100000:2.0:1746142909.286255:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4311 00000100:00100000:2.0:1746142909.286263:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962867325184:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.286382:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962867325184:12345-192.168.204.50@tcp:3:cat.0 Request processed in 120us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142909.286397:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4311 00002000:00100000:2.0:1746142909.286402:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff88009a28ca80 x1830962867325184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.286409:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ca80 with x1830962867325184 ext(5029888->5033983) 00002000:00010000:2.0:1746142909.286411:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ca80 00000100:00100000:0.0:1746142909.287526:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.287562:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.287570:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867325568 00000100:00100000:3.0:1746142909.287574:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867325568 00002000:00100000:3.0:1746142909.287592:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a28dc00 x1830962867325568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.287599:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28dc00 with x1830962867325568 ext(3145728->4194303) 00002000:00010000:3.0:1746142909.287602:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28dc00 00000100:00100000:3.0:1746142909.287623:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867325696 00000100:00100000:3.0:1746142909.287626:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867325696 00002000:00100000:3.0:1746142909.287637:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009a28d880 x1830962867325696/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.287644:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d880 with x1830962867325696 ext(3145728->4194303) 00002000:00010000:3.0:1746142909.287646:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28d880 00000100:00100000:3.0:1746142909.287669:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4312 00000100:00100000:3.0:1746142909.287675:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867325568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142909.287734:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4313 00000100:00100000:1.0:1746142909.287740:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867325696:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.299976:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.302776:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867325824 00000100:00100000:2.0:1746142909.302788:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867325824 00000100:00100000:2.0:1746142909.302842:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14120 00000100:00100000:2.0:1746142909.302850:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32321:x1830962867325824:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.302867:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.302884:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4ac expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.302922:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.302931:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.302937:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 11 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.302944:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.302946:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.302948:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.302975:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 11 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.302985:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 11 pid: 9578 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.302995:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793152:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.303093:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.303100:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 10 pid: 11421 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746142909.303107:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793280:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.303130:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.303136:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 35 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.303142:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793408:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.303157:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.305384:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867325568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17704us (17855us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142909.305405:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4312 00002000:00100000:3.0:1746142909.305415:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a28dc00 x1830962867325568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.305423:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28dc00 with x1830962867325568 ext(3145728->4194303) 00002000:00010000:3.0:1746142909.305427:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28dc00 00000100:00100000:1.0:1746142909.310685:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867325696:12345-192.168.204.50@tcp:3:cat.0 Request processed in 22936us (23114us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142909.310696:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4313 00002000:00100000:1.0:1746142909.310706:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009a28d880 x1830962867325696/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.310714:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d880 with x1830962867325696 ext(3145728->4194303) 00002000:00010000:1.0:1746142909.310719:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28d880 00000100:00100000:2.0:1746142909.314696:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793280:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.314759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.314778:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793408:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.314784:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.314810:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867325952 00000100:00100000:3.0:1746142909.314816:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867325952 00000100:00100000:1.0:1746142909.314827:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142909.314845:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 11 pid: 11421 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.314867:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867326080 00000100:00100000:3.0:1746142909.314870:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867326080 00010000:00010000:3.0:1746142909.314878:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.314889:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867326208 00000100:00100000:3.0:1746142909.314891:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867326208 00010000:00010000:3.0:1746142909.314913:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 12 pid: 9578 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.314917:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6337 00000100:00100000:1.0:1746142909.315294:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867325952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.315319:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.315336:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 11 pid: 11421 timeout: 783 lvb_type: 1 00010000:00010000:1.0:1746142909.315345:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 11 pid: 11421 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.315362:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6338 00010000:00010000:1.0:1746142909.315364:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130000/0x2fa243e067ccc91a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a363 expref: 11 pid: 11421 timeout: 783 lvb_type: 1 00000100:00100000:2.0:1746142909.315368:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6339 00000100:00100000:3.0:1746142909.315369:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867326080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142909.315375:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867326208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.315378:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.315380:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.315381:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142909.315386:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.315387:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 12 pid: 9578 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.315405:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 12 pid: 9578 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.315453:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867325952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 162us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.315461:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6337 00010000:00010000:3.0:1746142909.315617:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.315635:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067ccc856 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2ec expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.315635:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.315637:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.315643:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.315650:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.315776:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.315809:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867326080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 440us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.315815:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6338 00010000:00010000:3.0:1746142909.315852:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093378c00/0x2fa243e067ccc85d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2f3 expref: 12 pid: 9578 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.315861:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793152:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.315884:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.315892:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950400, rc 0) 00000100:00100000:3.0:1746142909.315928:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32321:x1830962867325824:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 13079us (15960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.315934:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14120 00010000:00010000:2.0:1746142909.315945:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.315957:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867793536:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.316007:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4b2b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.317114:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.317222:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867326336 00000100:00100000:3.0:1746142909.317227:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867326336 00000100:00100000:3.0:1746142909.317256:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14121 00000100:00100000:3.0:1746142909.317260:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867326336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.317271:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.317280:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097106200/0x2fa243e067cccb4a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4b3 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.317307:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793664:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.317355:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.317820:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867793536:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142909.317823:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142909.317833:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.317856:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867326208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2482us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.317863:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6339 00000100:00100000:0.0:1746142909.317916:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867326592 00000100:00100000:0.0:1746142909.317919:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867326592 00002000:00100000:0.0:1746142909.317942:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1470464->1474559) req@ffff8800938d2300 x1830962867326592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.317950:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2300 with x1830962867326592 ext(1470464->1474559) 00002000:00010000:0.0:1746142909.317954:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938d2300 00000100:00100000:0.0:1746142909.317976:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4314 00000100:00100000:0.0:1746142909.317981:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867326592:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142909.318074:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867326592:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 92us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142909.318079:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4314 00002000:00100000:0.0:1746142909.318083:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1470464->1474559) req@ffff8800938d2300 x1830962867326592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.318090:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2300 with x1830962867326592 ext(1470464->1474559) 00002000:00010000:0.0:1746142909.318092:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938d2300 00002000:00010000:3.0:1746142909.320347:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142908 -> 1746142909 00002000:00010000:3.0:1746142909.320353:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142908 -> 1746142909 00002000:00010000:3.0:1746142909.320354:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142908 -> 1746142909 00000100:00100000:3.0:1746142909.320370:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867793664:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.320405:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097106200/0x2fa243e067cccb4a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4b3 expref: 33 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.320420:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106200/0x2fa243e067cccb4a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4b3 expref: 33 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.320429:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106200, rc 0) 00000100:00100000:3.0:1746142909.320474:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867326336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3209us (3358us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.320481:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14121 00000100:00100000:0.0:1746142909.324835:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.324929:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867326848 00000100:00100000:3.0:1746142909.324937:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867326848 00002000:00100000:3.0:1746142909.324975:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800979b3b80 x1830962867326848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.324991:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3b80 with x1830962867326848 ext(4194304->5033983) 00002000:00010000:3.0:1746142909.324995:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b3b80 00000100:00100000:3.0:1746142909.325014:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4315 00000100:00100000:3.0:1746142909.325020:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867326848:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.331669:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867326848:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6641us (6833us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746142909.331679:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4315 00002000:00100000:3.0:1746142909.331687:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800979b3b80 x1830962867326848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.331695:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3b80 with x1830962867326848 ext(4194304->5033983) 00002000:00010000:3.0:1746142909.331699:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b3b80 00000100:00100000:0.0:1746142909.333290:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.333512:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867326976 00000100:00100000:3.0:1746142909.333519:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867326976 00000100:00100000:3.0:1746142909.333549:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14122 00000100:00100000:3.0:1746142909.333555:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32321:x1830962867326976:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142909.333568:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.333582:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4ba expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.333605:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.333613:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 7 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.333624:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.333630:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.333632:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.333635:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.333659:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.333670:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 13 pid: 9580 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.333680:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867793792:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.334444:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 7 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.334454:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 7 pid: 9580 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.334462:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867793920:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.335505:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.335519:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.335704:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867794048:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.336565:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.340468:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867793792:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.340479:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867793920:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142909.343375:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.343421:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.343475:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867327104 00000100:00100000:3.0:1746142909.343482:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867327104 00010000:00010000:3.0:1746142909.343509:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 8 pid: 9580 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.343539:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867327232 00000100:00100000:3.0:1746142909.343540:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867327232 00010000:00010000:3.0:1746142909.343549:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 14 pid: 9580 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.343569:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6340 00000100:00100000:3.0:1746142909.343575:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867327104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.343586:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.343600:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 8 pid: 9580 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746142909.343608:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 8 pid: 9580 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746142909.343629:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3e00/0x2fa243e067cccabe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a451 expref: 8 pid: 9580 timeout: 783 lvb_type: 1 00010000:00010000:3.0:1746142909.343643:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.343660:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6341 00000100:00100000:2.0:1746142909.343669:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867327232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.343677:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142909.343683:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867327104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (315us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142909.343687:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 14 pid: 9580 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.343688:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6340 00010000:00010000:2.0:1746142909.343696:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 14 pid: 9580 timeout: 783 lvb_type: 1 00010000:00010000:2.0:1746142909.343706:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d77e00/0x2fa243e067ccca2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3fd expref: 14 pid: 9580 timeout: 783 lvb_type: 1 00000100:00100000:3.0:1746142909.343717:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867794048:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.343718:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.343736:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867327232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (314us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142909.343739:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1142783] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.343742:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6341 00010000:00010000:3.0:1746142909.343747:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106200, rc 0) 00000100:00100000:3.0:1746142909.343766:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32321:x1830962867326976:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 10211us (10481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.343771:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14122 00000100:00100000:2.0:1746142909.344202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.344251:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867327488 00000100:00100000:0.0:1746142909.344255:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867327488 00000100:00100000:0.0:1746142909.344288:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5247 00000100:00100000:0.0:1746142909.344294:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32316:x1830962867327488:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142909.344440:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32316:x1830962867327488:12345-192.168.204.50@tcp:35:cat.0 Request processed in 146us (238us total) trans 8589936570 rc 0/0 00000100:00100000:0.0:1746142909.344445:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5247 00000100:00100000:0.0:1746142909.346023:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.346189:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867327616 00000100:00100000:2.0:1746142909.346197:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867327616 00010000:00010000:2.0:1746142909.346228:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.346255:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6342 00000100:00100000:2.0:1746142909.346263:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867327616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.346277:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.346295:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.346306:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.346328:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53a00/0x2fa243e067ccc9d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a3d3 expref: 30 pid: 11421 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.346342:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.346343:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.346350:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.346356:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.346385:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 29 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.346411:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867794176:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.346484:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.349614:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867794176:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.349637:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.349673:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867327616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3410us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.349682:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6342 00000100:00100000:0.0:1746142909.355601:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.356753:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867327872 00000100:00100000:3.0:1746142909.356762:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867327872 00002000:00100000:3.0:1746142909.356800:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1138688->1142783) req@ffff8800979b2a00 x1830962867327872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.356815:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b2a00 with x1830962867327872 ext(1138688->1142783) 00002000:00010000:3.0:1746142909.356821:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b2a00 00000100:00100000:3.0:1746142909.356842:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4316 00000100:00100000:3.0:1746142909.356848:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867327872:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.357093:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867327872:12345-192.168.204.50@tcp:3:cat.0 Request processed in 244us (1498us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142909.357100:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4316 00002000:00100000:3.0:1746142909.357106:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1138688->1142783) req@ffff8800979b2a00 x1830962867327872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.357113:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b2a00 with x1830962867327872 ext(1138688->1142783) 00002000:00010000:3.0:1746142909.357115:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b2a00 00000100:00100000:0.0:1746142909.358024:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.358219:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867328128 00000100:00100000:2.0:1746142909.358223:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867328128 00000100:00100000:2.0:1746142909.358258:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14415 00000100:00100000:2.0:1746142909.358262:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:32326:x1830962867328128:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.358277:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.358290:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4c1 expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.358355:0:22383:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142909.359484:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.359491:0:22383:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 43 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.359498:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142909.359525:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 43 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.359535:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 43 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.359545:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfed180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867794304:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.359633:0:22383:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.359640:0:22383:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 15 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.359651:0:22383:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfef100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867794432:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.359669:0:22383:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.360435:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.360525:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867328384 00000100:00100000:1.0:1746142909.360531:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867328384 00000100:00100000:1.0:1746142909.360567:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5248 00000100:00100000:1.0:1746142909.360573:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32321:x1830962867328384:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142909.361178:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32321:x1830962867328384:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 603us (742us total) trans 8589936571 rc 0/0 00000100:00100000:1.0:1746142909.361185:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5248 00000100:00100000:0.0:1746142909.362823:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.363215:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.363310:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867328640 00000100:00100000:1.0:1746142909.363317:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867328640 00010000:00010000:1.0:1746142909.363341:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.364283:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfed180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867794304:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.364296:0:22383:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfef100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:22383:1830962867794432:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.364317:0:22383:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000100:00100000:1.0:1746142909.364441:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867328512 00000100:00100000:1.0:1746142909.364444:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867328512 00010000:00010000:1.0:1746142909.364457:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 45 pid: 7232 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.364492:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6343 00000100:00100000:3.0:1746142909.364500:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867328640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.364513:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.364518:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.364527:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.364544:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cccae1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a46d expref: 16 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.364558:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.364562:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142909.364570:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142909.364574:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.364610:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867328640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 111us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.364615:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6343 00000100:00100000:3.0:1746142909.364629:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6344 00000100:00100000:3.0:1746142909.364633:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867328512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.364639:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.364642:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 45 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.364648:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 45 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.364657:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106e00/0x2fa243e067cccb20 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a490 expref: 45 pid: 7232 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.364663:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.364665:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142909.364671:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142909.364676:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 22383 initiator: MDT0 00010000:00010000:3.0:1746142909.364688:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.364700:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867328512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.364705:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6344 00010000:00010000:2.0:1746142909.365273:0:22383:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00010000:00010000:2.0:1746142909.365280:0:22383:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 22383 initiator: MDT0 00000004:00200000:2.0:1746142909.365296:0:22383:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142909.365407:0:22383:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 25 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.365434:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 24 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.365439:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142909.365441:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142909.365443:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950e00, rc 0) 00000100:00100000:2.0:1746142909.365467:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:32326:x1830962867328128:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7204us (7444us total) trans 8589936572 rc 0/0 00000100:00100000:2.0:1746142909.365472:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14415 00000100:00100000:1.0:1746142909.381528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.381636:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867328768 00000100:00100000:3.0:1746142909.381643:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867328768 00000100:00100000:3.0:1746142909.381685:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14123 00000100:00100000:3.0:1746142909.381692:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+11:32326:x1830962867328768:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142909.381706:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.381720:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4c8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.381744:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.381750:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.381752:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.381755:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1724416->2068479] (req 1724416->2068479) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.381779:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.381789:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.381799:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867794560:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.381865:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.384634:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867794560:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.384659:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1724416->2068479] (req 1724416->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.384674:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3dc00, rc 0) 00000100:00100000:3.0:1746142909.384725:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:32326:x1830962867328768:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3033us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.384732:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14123 00000100:00100000:0.0:1746142909.385226:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.385530:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867328896 00000100:00100000:3.0:1746142909.385536:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867328896 00002000:00100000:3.0:1746142909.385563:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1470464->2097151) req@ffff8800979b1f80 x1830962867328896/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.385572:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1f80 with x1830962867328896 ext(1470464->2097151) 00010000:00010000:3.0:1746142909.385577:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 32 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.385587:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 32 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.385592:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979b1f80 00000100:00100000:3.0:1746142909.385606:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1340 00000100:00100000:3.0:1746142909.385611:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867328896:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142909.393016:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867328896:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7396us (7783us total) trans 17179873919 rc 0/0 00000100:00100000:3.0:1746142909.393029:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1340 00002000:00100000:3.0:1746142909.393038:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1470464->2097151) req@ffff8800979b1f80 x1830962867328896/t17179873919(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.393047:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1f80 with x1830962867328896 ext(1470464->2097151) 00010000:00010000:3.0:1746142909.393056:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.393069:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.393075:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979b1f80 00000100:00100000:0.0:1746142909.396369:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.396492:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867329024 00000100:00100000:2.0:1746142909.396501:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867329024 00010000:00010000:2.0:1746142909.396533:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.396612:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6345 00000100:00100000:2.0:1746142909.396619:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867329024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.396632:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.396649:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.396659:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.396679:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d950400/0x2fa243e067cccb43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ac expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.396855:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.396857:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.396863:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.396870:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.396988:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.397001:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867794688:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.397148:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.399578:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfef100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867794688:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142909.399600:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.399634:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867329024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3015us (3273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.399643:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6345 00000100:00100000:0.0:1746142909.402395:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.403567:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867329280 00000100:00100000:3.0:1746142909.403577:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867329280 00002000:00100000:3.0:1746142909.403630:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1724416->1728511) req@ffff8800979b0a80 x1830962867329280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.403653:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0a80 with x1830962867329280 ext(1724416->1728511) 00002000:00010000:3.0:1746142909.403658:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0a80 00000100:00100000:3.0:1746142909.403687:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4317 00000100:00100000:3.0:1746142909.403694:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867329280:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142909.403876:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867329280:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 182us (1494us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142909.403882:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4317 00002000:00100000:3.0:1746142909.403887:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1724416->1728511) req@ffff8800979b0a80 x1830962867329280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.403929:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0a80 with x1830962867329280 ext(1724416->1728511) 00002000:00010000:3.0:1746142909.403931:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0a80 00000100:00100000:3.0:1746142909.408408:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867794816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746142909.408476:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142909.408713:0:7235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867794816 00000100:00100000:0.0:1746142909.408721:0:7235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867794816 00000100:00100000:0.0:1746142909.408755:0:7235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1746142909.408761:0:7235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3763:x1830962867794816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746142909.408787:0:7235:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445654528 avail 1316192256 00000100:00100000:0.0:1746142909.408824:0:7235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3763:x1830962867794816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.408830:0:7235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1746142909.408916:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867794816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746142909.415006:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.415096:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867329536 00000100:00100000:2.0:1746142909.415105:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867329536 00002000:00100000:2.0:1746142909.415147:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (2064384->2068479) req@ffff8800979b3100 x1830962867329536/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.415156:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3100 with x1830962867329536 ext(2064384->2068479) 00002000:00010000:2.0:1746142909.415161:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b3100 00000100:00100000:2.0:1746142909.415193:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4318 00000100:00100000:2.0:1746142909.415200:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867329536:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142909.415330:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867329536:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 130us (331us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142909.415337:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4318 00002000:00100000:2.0:1746142909.415342:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (2064384->2068479) req@ffff8800979b3100 x1830962867329536/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.415348:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3100 with x1830962867329536 ext(2064384->2068479) 00002000:00010000:2.0:1746142909.415351:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b3100 00000100:00100000:1.0:1746142909.419190:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.419271:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867329664 00000100:00100000:3.0:1746142909.419279:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867329664 00000100:00100000:3.0:1746142909.419315:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14124 00000100:00100000:3.0:1746142909.419321:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867329664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.419335:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.419350:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3c600/0x2fa243e067cccb74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4cf expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.419400:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867794944:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.420044:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.421756:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867794944:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.422262:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3c600/0x2fa243e067cccb74 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4cf expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.422276:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3c600/0x2fa243e067cccb74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4cf expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.422294:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c600, rc 0) 00000100:00100000:3.0:1746142909.422348:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867329664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3025us (3165us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.422357:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14124 00000100:00100000:3.0:1746142909.424273:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3764:1830962867795072:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.424317:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142909.424380:0:8100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795072 00000100:00100000:2.0:1746142909.424397:0:8100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795072 00000100:00100000:2.0:1746142909.424469:0:8100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1746142909.424479:0:8100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11bfc4f8-19ff-4a85-a693-c4a0691b96f7+23:3764:x1830962867795072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.424514:0:8100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ddb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11bfc4f8-19ff-4a85-a693-c4a0691b96f7+23:3764:x1830962867795072:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.424519:0:8100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1746142909.424541:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830962867795328:0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.424559:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142909.424559:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867795456:0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.424572:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3762:1830962867795840:0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.424586:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142909.424587:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142909.424597:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830962867796352:0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.424604:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3763:1830962867795968:0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.424609:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142909.424622:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142909.424644:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3764:1830962867795584:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.424660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142909.424836:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867795200:0@lo:400:kworker.0 00000100:00100000:0.0:1746142909.424873:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142909.424894:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3765:1830962867795712:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.425147:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867796096:0@lo:400:kworker.0 00000100:00100000:0.0:1746142909.425155:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142909.425167:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142909.425184:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3764:1830962867795072:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.425202:0:9266:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795200 00000100:00100000:3.0:1746142909.425205:0:9266:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795200 00000100:00100000:3.0:1746142909.425221:0:9266:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1746142909.425225:0:9266:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3765:x1830962867795200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.425247:0:9266:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3765:x1830962867795200:12345-0@lo:400:kworker.0 Request processed in 22us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.425252:0:9266:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1746142909.425279:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795328 00000100:00100000:2.0:1746142909.425282:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795328 00000100:00100000:1.0:1746142909.425297:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795840 00000100:00100000:2.0:1746142909.425299:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867796352 00000100:00100000:2.0:1746142909.425301:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867796352 00000100:00100000:1.0:1746142909.425301:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795840 00000100:00100000:2.0:1746142909.425307:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795968 00000100:00100000:2.0:1746142909.425308:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795968 00000100:00100000:2.0:1746142909.425316:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795584 00000100:00100000:2.0:1746142909.425317:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795584 00000100:00100000:2.0:1746142909.425326:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1746142909.425330:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830962867795328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425335:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:1.0:1746142909.425341:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830962867796352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.425350:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830962867795328:12345-0@lo:400:kworker.0 Request processed in 20us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.425355:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1746142909.425362:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1746142909.425366:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3763:x1830962867795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425368:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830962867796352:12345-0@lo:400:kworker.0 Request processed in 28us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.425373:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1746142909.425383:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3763:x1830962867795968:12345-0@lo:400:kworker.0 Request processed in 17us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.425383:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1746142909.425401:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830962867795840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.425402:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1746142909.425410:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1746142909.425414:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830962867795584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425422:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830962867795840:12345-0@lo:400:kworker.0 Request processed in 35us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.425427:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1746142909.425434:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830962867795584:12345-0@lo:400:kworker.0 Request processed in 20us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.425438:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1746142909.425453:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3763:1830962867795968:0@lo:400:kworker.0 00000100:00100000:2.0:1746142909.425461:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830962867796352:0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425466:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795456 00000100:00100000:2.0:1746142909.425468:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830962867795328:0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425468:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795456 00000100:00100000:2.0:1746142909.425474:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3762:1830962867795840:0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425488:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867796096 00000100:00100000:1.0:1746142909.425490:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867796096 00000100:00080000:2.0:1746142909.425497:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746142909.425500:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746142909.425502:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746142909.425504:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1746142909.425508:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3763:x1830962867795456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142909.425531:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3763:x1830962867795456:12345-0@lo:400:kworker.0 Request processed in 23us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.425555:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867795712 00000100:00100000:3.0:1746142909.425557:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867795712 00000100:00100000:0.0:1746142909.425567:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867796224:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.425576:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1746142909.425580:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830962867795712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142909.425585:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142909.425605:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830962867795712:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.425605:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867795200:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.425609:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1746142909.425613:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3765:1830962867795712:0@lo:400:kworker.0 00000100:00100000:3.0:1746142909.425626:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3764:1830962867795584:0@lo:400:kworker.0 00000100:00100000:0.0:1746142909.425632:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867796224 00000100:00100000:0.0:1746142909.425634:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867796224 00000100:00100000:0.0:1746142909.425653:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1746142909.425656:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867796096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142909.425680:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867796096:12345-0@lo:400:kworker.0 Request processed in 23us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.425684:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1746142909.425688:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841168 gen 2 00000004:00080000:3.0:1746142909.425692:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d1180, transno 21474841090 00000100:00100000:0.0:1746142909.425693:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1746142909.425696:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3765:x1830962867796224:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1746142909.425698:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d2d80, transno 21474841091 00000004:00080000:3.0:1746142909.425700:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d0380, transno 21474841092 00000004:00080000:3.0:1746142909.425702:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d1c00, transno 21474841093 00000004:00080000:3.0:1746142909.425705:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d0700, transno 21474841094 00000004:00080000:3.0:1746142909.425706:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d0a80, transno 21474841095 00000004:00080000:3.0:1746142909.425708:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d1500, transno 21474841096 00000004:00080000:3.0:1746142909.425710:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d2680, transno 21474841097 00000004:00080000:3.0:1746142909.425712:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938de300, transno 21474841102 00000004:00080000:3.0:1746142909.425714:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938de680, transno 21474841103 00000004:00080000:3.0:1746142909.425715:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938ddf80, transno 21474841104 00000100:00100000:0.0:1746142909.425716:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3765:x1830962867796224:12345-0@lo:400:kworker.0 Request processed in 19us (130us total) trans 0 rc 0/0 00000004:00080000:3.0:1746142909.425717:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dd180, transno 21474841105 00000004:00080000:3.0:1746142909.425719:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dc700, transno 21474841106 00000100:00100000:0.0:1746142909.425720:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000004:00080000:3.0:1746142909.425721:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938df480, transno 21474841107 00000004:00080000:3.0:1746142909.425722:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938df100, transno 21474841108 00000004:00080000:3.0:1746142909.425724:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dca80, transno 21474841109 00000004:00080000:3.0:1746142909.425726:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61c00, transno 21474841110 00000004:00080000:3.0:1746142909.425728:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07800, transno 21474841111 00000004:00080000:3.0:1746142909.425730:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d62d80, transno 21474841112 00000004:00080000:3.0:1746142909.425732:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60700, transno 21474841113 00000004:00080000:3.0:1746142909.425734:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60e00, transno 21474841114 00000004:00080000:3.0:1746142909.425735:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61180, transno 21474841115 00000100:00100000:0.0:1746142909.425736:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873908 gen 2 00000004:00080000:3.0:1746142909.425737:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61f80, transno 21474841116 00000004:00080000:3.0:1746142909.425739:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61500, transno 21474841117 00000004:00080000:0.0:1746142909.425739:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e518380, transno 17179873822 00000004:00080000:3.0:1746142909.425740:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07b80, transno 21474841118 00000004:00080000:3.0:1746142909.425742:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c06680, transno 21474841119 00000004:00080000:3.0:1746142909.425744:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c05880, transno 21474841120 00000004:00080000:0.0:1746142909.425745:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130376a00, transno 17179873823 00000004:00080000:3.0:1746142909.425746:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c06300, transno 21474841121 00000004:00080000:0.0:1746142909.425747:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e51aa00, transno 17179873824 00000004:00080000:3.0:1746142909.425748:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c04000, transno 21474841122 00000004:00080000:3.0:1746142909.425750:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07100, transno 21474841123 00000004:00080000:0.0:1746142909.425750:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130374a80, transno 17179873825 00000004:00080000:3.0:1746142909.425752:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c06a00, transno 21474841124 00000004:00080000:0.0:1746142909.425752:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e51bb80, transno 17179873826 00000004:00080000:3.0:1746142909.425754:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07480, transno 21474841125 00000004:00080000:0.0:1746142909.425754:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e51a680, transno 17179873827 00000004:00080000:3.0:1746142909.425756:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097430a80, transno 21474841132 00000004:00080000:0.0:1746142909.425756:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e518000, transno 17179873828 00000004:00080000:3.0:1746142909.425758:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097430e00, transno 21474841133 00000004:00080000:0.0:1746142909.425758:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130374700, transno 17179873829 00000004:00080000:3.0:1746142909.425760:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097431f80, transno 21474841134 00000004:00080000:0.0:1746142909.425760:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1b480, transno 17179873830 00000004:00080000:3.0:1746142909.425762:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097433800, transno 21474841135 00000004:00080000:0.0:1746142909.425763:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c1500, transno 17179873835 00000004:00080000:3.0:1746142909.425764:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097430380, transno 21474841136 00000004:00080000:0.0:1746142909.425765:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e67aa00, transno 17179873836 00000004:00080000:3.0:1746142909.425766:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097430700, transno 21474841137 00000004:00080000:0.0:1746142909.425767:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c3b80, transno 17179873837 00000004:00080000:3.0:1746142909.425768:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097431880, transno 21474841138 00000004:00080000:3.0:1746142909.425770:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097431c00, transno 21474841139 00000004:00080000:0.0:1746142909.425770:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012e679880, transno 17179873838 00000004:00080000:3.0:1746142909.425771:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2300, transno 21474841141 00000004:00080000:0.0:1746142909.425772:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130375180, transno 17179873839 00000004:00080000:3.0:1746142909.425773:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a0a80, transno 21474841142 00000004:00080000:0.0:1746142909.425774:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c1180, transno 17179873840 00000004:00080000:3.0:1746142909.425775:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a3800, transno 21474841143 00000004:00080000:0.0:1746142909.425776:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130376d80, transno 17179873841 00000004:00080000:3.0:1746142909.425777:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1c00, transno 21474841144 00000004:00080000:0.0:1746142909.425778:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d4c3480, transno 17179873842 00000004:00080000:3.0:1746142909.425779:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a3b80, transno 21474841145 00000004:00080000:0.0:1746142909.425780:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d1c00, transno 17179873843 00000004:00080000:3.0:1746142909.425781:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2d80, transno 21474841146 00000004:00080000:0.0:1746142909.425782:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1a680, transno 17179873844 00000004:00080000:3.0:1746142909.425783:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a3480, transno 21474841147 00000004:00080000:0.0:1746142909.425784:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d2300, transno 17179873845 00000004:00080000:3.0:1746142909.425785:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2680, transno 21474841148 00000004:00080000:0.0:1746142909.425786:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f18e00, transno 17179873846 00000004:00080000:3.0:1746142909.425787:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de3800, transno 21474841152 00000004:00080000:0.0:1746142909.425788:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f19180, transno 17179873847 00000004:00080000:3.0:1746142909.425789:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e1880, transno 21474841153 00000004:00080000:0.0:1746142909.425790:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f18a80, transno 17179873848 00000004:00080000:3.0:1746142909.425791:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de0e00, transno 21474841154 00000004:00080000:0.0:1746142909.425792:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d0e00, transno 17179873849 00000004:00080000:3.0:1746142909.425793:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e0a80, transno 21474841155 00000004:00080000:0.0:1746142909.425794:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f18700, transno 17179873850 00000004:00080000:3.0:1746142909.425795:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de2a00, transno 21474841156 00000004:00080000:0.0:1746142909.425796:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088f1ad80, transno 17179873851 00000004:00080000:3.0:1746142909.425797:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e3100, transno 21474841157 00000004:00080000:0.0:1746142909.425798:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096094000, transno 17179873852 00000004:00080000:3.0:1746142909.425799:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de3480, transno 21474841158 00000004:00080000:3.0:1746142909.425800:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c0e1f80, transno 21474841159 00000004:00080000:0.0:1746142909.425800:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0380, transno 17179873853 00000004:00080000:3.0:1746142909.425802:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bcd180, transno 21474841161 00000004:00080000:0.0:1746142909.425802:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0a80, transno 17179873854 00000004:00080000:0.0:1746142909.425803:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0e00, transno 17179873855 00000004:00080000:3.0:1746142909.425804:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbf6a00, transno 21474841162 00000004:00080000:0.0:1746142909.425805:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d3100, transno 17179873856 00000004:00080000:3.0:1746142909.425806:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644f480, transno 21474841163 00000004:00080000:0.0:1746142909.425807:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de13800, transno 17179873857 00000004:00080000:3.0:1746142909.425809:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbf4000, transno 21474841164 00000004:00080000:0.0:1746142909.425809:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d0700, transno 17179873858 00000004:00080000:3.0:1746142909.425810:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bcc380, transno 21474841165 00000004:00080000:3.0:1746142909.425812:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644ce00, transno 21474841166 00000004:00080000:0.0:1746142909.425812:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d1180, transno 17179873859 00000004:00080000:0.0:1746142909.425814:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801355d3800, transno 17179873860 00000004:00080000:3.0:1746142909.425815:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bce300, transno 21474841167 00000004:00080000:3.0:1746142909.425816:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644c700, transno 21474841168 00000004:00080000:0.0:1746142909.425816:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098190380, transno 17179873861 00000004:00080000:0.0:1746142909.425818:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097348000, transno 17179873865 00000100:00100000:3.0:1746142909.425819:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867796096:0@lo:400:kworker.0 00000004:00080000:0.0:1746142909.425820:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097348e00, transno 17179873866 00000004:00080000:0.0:1746142909.425822:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734b480, transno 17179873867 00000004:00080000:0.0:1746142909.425824:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097349c00, transno 17179873868 00000004:00080000:0.0:1746142909.425825:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096142d80, transno 17179873869 00000004:00080000:0.0:1746142909.425827:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097349880, transno 17179873870 00000004:00080000:0.0:1746142909.425829:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097349180, transno 17179873871 00000004:00080000:0.0:1746142909.425831:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092406a00, transno 17179873872 00000004:00080000:0.0:1746142909.425833:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734b800, transno 17179873873 00000004:00080000:0.0:1746142909.425835:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd8000, transno 17179873875 00000004:00080000:0.0:1746142909.425837:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fdb100, transno 17179873876 00000004:00080000:0.0:1746142909.425839:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd9180, transno 17179873877 00000004:00080000:0.0:1746142909.425840:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd8e00, transno 17179873878 00000004:00080000:0.0:1746142909.425842:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fdb480, transno 17179873879 00000004:00080000:0.0:1746142909.425844:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fda300, transno 17179873880 00000004:00080000:0.0:1746142909.425846:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb0a80, transno 17179873881 00000004:00080000:0.0:1746142909.425848:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd9f80, transno 17179873882 00000004:00080000:0.0:1746142909.425849:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fdad80, transno 17179873883 00000004:00080000:0.0:1746142909.425851:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb0000, transno 17179873890 00000004:00080000:0.0:1746142909.425852:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb3480, transno 17179873891 00000004:00080000:0.0:1746142909.425854:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb3800, transno 17179873892 00000004:00080000:0.0:1746142909.425856:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb0380, transno 17179873893 00000004:00080000:0.0:1746142909.425858:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb2a00, transno 17179873894 00000004:00080000:0.0:1746142909.425859:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bce680, transno 17179873895 00000004:00080000:0.0:1746142909.425861:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb2300, transno 17179873896 00000004:00080000:0.0:1746142909.425863:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb2680, transno 17179873897 00000004:00080000:0.0:1746142909.425865:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bcc000, transno 17179873898 00000004:00080000:0.0:1746142909.425867:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097432300, transno 17179873900 00000004:00080000:0.0:1746142909.425870:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1880, transno 17179873901 00000004:00080000:0.0:1746142909.425872:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1f80, transno 17179873902 00000004:00080000:0.0:1746142909.425874:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097430000, transno 17179873903 00000004:00080000:0.0:1746142909.425875:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2a00, transno 17179873904 00000004:00080000:0.0:1746142909.425877:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dbf5c00, transno 17179873905 00000004:00080000:0.0:1746142909.425879:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de12300, transno 17179873906 00000004:00080000:0.0:1746142909.425881:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a0380, transno 17179873907 00000004:00080000:0.0:1746142909.425883:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800949d3100, transno 17179873908 00000100:00100000:0.0:1746142909.425887:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867796224:0@lo:400:kworker.0 00000100:00080000:2.0:1746142909.425970:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746142909.425972:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1746142909.426225:0:8111:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 72 done 00000100:00100000:1.0:1746142909.426287:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:1.0:1746142909.426310:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867795456:0@lo:400:kworker.0 00000004:00080000:3.0:1746142909.426348:0:8109:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 64 done 00000100:00100000:0.0:1746142909.432509:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.432663:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867329920 00000100:00100000:2.0:1746142909.432671:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867329920 00002000:00100000:2.0:1746142909.432714:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88013644f480 x1830962867329920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 504/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.432723:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f480 with x1830962867329920 ext(1048576->2097151) 00002000:00010000:2.0:1746142909.432728:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644f480 00000100:00100000:2.0:1746142909.432753:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4319 00000100:00100000:2.0:1746142909.432760:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867329920:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.438635:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867329920:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5867us (6126us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746142909.438645:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4319 00002000:00100000:2.0:1746142909.438656:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88013644f480 x1830962867329920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 504/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.438665:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f480 with x1830962867329920 ext(1048576->2097151) 00002000:00010000:2.0:1746142909.438670:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644f480 00000100:00100000:0.0:1746142909.446688:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.447198:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867330048 00000100:00100000:1.0:1746142909.447245:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867330048 00000100:00100000:1.0:1746142909.448361:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14125 00000100:00100000:1.0:1746142909.448425:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:32331:x1830962867330048:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.448468:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.448506:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4d6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.448606:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.448658:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142909.448660:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142909.448672:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.448722:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.448733:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 28 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.448759:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867796480:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.448935:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.453113:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867796480:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142909.453161:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.453178:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a0e00, rc 0) 00000100:00100000:1.0:1746142909.453217:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:32331:x1830962867330048:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4848us (6552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.453225:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14125 00000100:00100000:0.0:1746142909.454301:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.454382:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867330176 00000100:00100000:2.0:1746142909.454403:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867330176 00002000:00100000:2.0:1746142909.454438:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1142783) req@ffff88013644c700 x1830962867330176/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.454447:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644c700 with x1830962867330176 ext(1048576->1142783) 00010000:00010000:2.0:1746142909.454453:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 29 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.454464:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 29 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.454469:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644c700 00000100:00100000:2.0:1746142909.454524:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1341 00000100:00100000:2.0:1746142909.454531:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867330176:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142909.458762:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867330176:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4222us (4454us total) trans 21474841180 rc 0/0 00000100:00100000:2.0:1746142909.458797:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1341 00002000:00100000:2.0:1746142909.458809:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1142783) req@ffff88013644c700 x1830962867330176/t21474841180(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.458822:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644c700 with x1830962867330176 ext(1048576->1142783) 00010000:00010000:2.0:1746142909.458831:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.458845:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.458852:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013644c700 00000100:00100000:0.0:1746142909.461635:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.461782:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867330304 00000100:00100000:2.0:1746142909.461790:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867330304 00010000:00010000:2.0:1746142909.461820:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.462188:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6346 00000100:00100000:2.0:1746142909.462196:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867330304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.462207:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.462224:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.462234:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.462253:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccb51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1142783) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4ba expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.462281:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.462283:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.462290:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.462297:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.462325:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.462336:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867796608:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.462410:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.468123:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.468314:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867796608:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142909.468335:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.468380:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867330304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6185us (6752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.468399:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6346 00000100:00100000:3.0:1746142909.468646:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867330560 00000100:00100000:3.0:1746142909.468651:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867330560 00002000:00100000:3.0:1746142909.468681:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88011e13fb80 x1830962867330560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.468689:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13fb80 with x1830962867330560 ext(1048576->2097151) 00002000:00010000:3.0:1746142909.468693:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13fb80 00000100:00100000:3.0:1746142909.468718:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4320 00000100:00100000:3.0:1746142909.468725:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867330560:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.473866:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746142909.473884:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867796736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746142909.473956:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142909.474314:0:7235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867796736 00000100:00100000:1.0:1746142909.474321:0:7235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867796736 00000100:00100000:1.0:1746142909.474439:0:7235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1746142909.474446:0:7235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867796736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746142909.474472:0:7235:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445638144 avail 1316175872 00000100:00100000:1.0:1746142909.474676:0:7235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867796736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 230us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.474682:0:7235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1746142909.477926:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867796736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746142909.479060:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867330560:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10330us (10939us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142909.479070:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4320 00002000:00100000:3.0:1746142909.479078:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88011e13fb80 x1830962867330560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.479087:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13fb80 with x1830962867330560 ext(1048576->2097151) 00002000:00010000:3.0:1746142909.479091:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13fb80 00000100:00100000:0.0:1746142909.492650:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.492781:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867330816 00000100:00100000:2.0:1746142909.492790:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867330816 00000100:00100000:2.0:1746142909.493213:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14416 00000100:00100000:2.0:1746142909.493222:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32337:x1830962867330816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.493242:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.493258:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cccb82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4dd expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.493318:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493329:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493338:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493348:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493354:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493358:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493443:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950600/0x2fa243e067cccb97 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493452:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950600/0x2fa243e067cccb97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493457:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950600/0x2fa243e067cccb97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142909.493464:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142909.493518:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493523:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493528:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493533:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493537:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d950000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142909.493540:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493545:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493553:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142909.493555:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142909.493558:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.493562:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950000/0x2fa243e067cccb89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496560:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496574:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496579:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496585:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d951e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142909.496588:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496596:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496609:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880088ce2800) 00010000:00010000:2.0:1746142909.496611:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142909.496614:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496618:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951e00/0x2fa243e067cccb90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.496674:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951c00/0x2fa243e067cccb82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4dd expref: 47 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.496685:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950600/0x2fa243e067cccb97 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4dd expref: 46 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.496691:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142909.496693:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746142909.496695:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950600, rc 0) 00000100:00100000:2.0:1746142909.496761:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32337:x1830962867330816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3539us (4117us total) trans 8589936573 rc 0/0 00000100:00100000:2.0:1746142909.496768:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14416 00000100:00100000:0.0:1746142909.503176:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.503224:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.503246:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.503281:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867331840 00000100:00100000:0.0:1746142909.503289:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867331840 00000100:00100000:0.0:1746142909.503339:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14417 00000100:00100000:0.0:1746142909.503347:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32336:x1830962867331840:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142909.503366:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.503381:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb800/0x2fa243e067cccba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4f2 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.503453:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503464:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503473:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503483:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503489:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503494:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503565:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067cccbba lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503573:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067cccbba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503579:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067cccbba lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142909.503586:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142909.503643:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503649:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503654:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503659:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503664:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fa000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142909.503668:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503673:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503681:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142909.503683:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142909.503686:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503690:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa000/0x2fa243e067cccbac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503702:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503706:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503710:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503714:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fbe00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142909.503715:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503719:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503725:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736a00) 00010000:00010000:0.0:1746142909.503727:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142909.503730:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503733:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbe00/0x2fa243e067cccbb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.503761:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb800/0x2fa243e067cccba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f2 expref: 49 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.503771:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067cccbba lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f2 expref: 48 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.503776:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142909.503778:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142909.503780:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fb600, rc 0) 00000100:00100000:0.0:1746142909.503816:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32336:x1830962867331840:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 469us (591us total) trans 8589936574 rc 0/0 00000100:00100000:0.0:1746142909.503822:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14417 00000100:00100000:0.0:1746142909.503842:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867331200 00000100:00100000:0.0:1746142909.503845:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867331200 00002000:00100000:0.0:1746142909.503865:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13e680 x1830962867331200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.503872:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13e680 with x1830962867331200 ext(2097152->4194303) 00002000:00010000:0.0:1746142909.503876:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13e680 00000100:00100000:0.0:1746142909.503885:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867331328 00000100:00100000:0.0:1746142909.503887:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867331328 00002000:00100000:0.0:1746142909.503895:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88011e13ce00 x1830962867331328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.503925:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ce00 with x1830962867331328 ext(2097152->3145727) 00002000:00010000:0.0:1746142909.503929:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13ce00 00000100:00100000:0.0:1746142909.503938:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4321 00000100:00100000:0.0:1746142909.503944:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867331200:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.506141:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4322 00000100:00100000:0.0:1746142909.506151:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867331328:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142909.518094:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.518696:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.518750:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.518781:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867331584 00000100:00100000:1.0:1746142909.518788:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867331584 00000100:00100000:1.0:1746142909.518818:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867331968 00000100:00100000:1.0:1746142909.518820:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867331968 00000100:00100000:1.0:1746142909.518835:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14126 00000100:00100000:1.0:1746142909.518842:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867331584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.518856:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.518871:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800987fe200/0x2fa243e067cccbc8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4e4 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142909.518967:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867796864:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.519059:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.519076:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14127 00000100:00100000:1.0:1746142909.519097:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2004:x1830962867331968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.519104:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.519112:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4eb expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.519138:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.519140:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.519146:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 31 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.519169:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 31 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.519178:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800987fe600, rc 0) 00000100:00100000:1.0:1746142909.519210:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867331968:12345-192.168.204.50@tcp:101:cat.0 Request processed in 128us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.519215:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14127 00000100:00100000:3.0:1746142909.519411:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867331456 00000100:00100000:3.0:1746142909.519416:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867331456 00000100:00100000:3.0:1746142909.519465:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 763 00000100:00100000:3.0:1746142909.519470:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867331456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.519492:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.519509:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950600/0x2fa243e067cccb97 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4dd expref: 48 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.519535:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.519538:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.519570:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867331456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.519576:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 763 00000100:00100000:2.0:1746142909.525343:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867796992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746142909.525412:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142909.527314:0:3103:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867796992 00000100:00100000:1.0:1746142909.527323:0:3103:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867796992 00000100:00100000:1.0:1746142909.527375:0:3103:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1746142909.527381:0:3103:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867796992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746142909.527413:0:3103:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 368640 granted 1306414784 pending 2981888 free 3908063232 avail 3676540928 00000100:00100000:1.0:1746142909.527459:0:3103:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867796992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.527464:0:3103:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1746142909.527508:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867796992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746142909.527988:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.528742:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332096 00000100:00100000:2.0:1746142909.528749:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332096 00000100:00100000:2.0:1746142909.528791:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 764 00000100:00100000:2.0:1746142909.528797:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867332096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.528808:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.528829:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067cccbba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f2 expref: 47 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.528846:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142909.528849:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.528879:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867332096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.528884:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 764 00002000:00010000:1.0:1746142909.529072:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142909 -> 1746142910 00002000:00010000:1.0:1746142909.529075:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142909 -> 1746142910 00002000:00010000:1.0:1746142909.529077:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142909 -> 1746142910 00000100:00100000:1.0:1746142909.529092:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867796864:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142909.529114:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800987fe200/0x2fa243e067cccbc8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4e4 expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.529125:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800987fe200/0x2fa243e067cccbc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4e4 expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.529136:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800987fe200, rc 0) 00000100:00100000:1.0:1746142909.529160:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867331584:12345-192.168.204.50@tcp:101:cat.0 Request processed in 10319us (10464us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.529166:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14126 00000100:00100000:1.0:1746142909.539483:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746142909.539501:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867797120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746142909.539556:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142909.539656:0:13943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867797120 00000100:00100000:2.0:1746142909.539663:0:13943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867797120 00000100:00100000:2.0:1746142909.539708:0:13943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1746142909.539715:0:13943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867797120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746142909.539733:0:13943:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1184369472 pending 2244608 free 3906637824 avail 3675115520 00000100:00100000:2.0:1746142909.539767:0:13943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867797120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.539772:0:13943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1746142909.540652:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867797120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746142909.544033:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867331200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 40080us (40856us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142909.544045:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4321 00002000:00100000:0.0:1746142909.544054:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13e680 x1830962867331200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.544063:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13e680 with x1830962867331200 ext(2097152->4194303) 00002000:00010000:0.0:1746142909.544068:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13e680 00000100:00100000:2.0:1746142909.545209:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867331328:12345-192.168.204.50@tcp:3:cat.0 Request processed in 39056us (41958us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142909.545217:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4322 00002000:00100000:2.0:1746142909.545223:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88011e13ce00 x1830962867331328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.545230:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ce00 with x1830962867331328 ext(2097152->3145727) 00002000:00010000:2.0:1746142909.545234:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13ce00 00000100:00100000:0.0:1746142909.548694:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.548787:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332224 00000100:00100000:1.0:1746142909.548795:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332224 00000100:00100000:1.0:1746142909.548829:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14128 00000100:00100000:1.0:1746142909.548835:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32337:x1830962867332224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.548852:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.548866:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a4f9 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.548890:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.548918:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142909.548920:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142909.548923:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.548948:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.548958:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 11 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.548968:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867797248:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.549053:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.549924:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867797248:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142909.549945:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 34 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.549955:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf15a00, rc 0) 00000100:00100000:1.0:1746142909.549975:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32337:x1830962867332224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1140us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.549981:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14128 00000100:00100000:0.0:1746142909.557702:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.558617:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332352 00000100:00100000:2.0:1746142909.558627:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332352 00002000:00100000:2.0:1746142909.558666:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1724416->2068479) req@ffff88011e13c000 x1830962867332352/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.558676:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13c000 with x1830962867332352 ext(1724416->2068479) 00010000:00010000:2.0:1746142909.558684:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 12 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.558697:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 12 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.558703:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e13c000 00000100:00100000:2.0:1746142909.558721:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1342 00000100:00100000:2.0:1746142909.558728:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867332352:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142909.572317:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.572408:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332608 00000100:00100000:1.0:1746142909.572416:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332608 00002000:00100000:1.0:1746142909.572453:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff8800938d3b80 x1830962867332608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.572462:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3b80 with x1830962867332608 ext(4194304->5029887) 00002000:00010000:1.0:1746142909.572467:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d3b80 00000100:00100000:1.0:1746142909.572494:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4323 00000100:00100000:1.0:1746142909.572500:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867332608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.578789:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867332352:12345-192.168.204.50@tcp:4:cat.0 Request processed in 20052us (21084us total) trans 17179873920 rc 0/0 00000100:00100000:0.0:1746142909.578800:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1342 00002000:00100000:0.0:1746142909.578811:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1724416->2068479) req@ffff88011e13c000 x1830962867332352/t17179873920(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.578819:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13c000 with x1830962867332352 ext(1724416->2068479) 00010000:00010000:0.0:1746142909.578828:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.578846:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746142909.578851:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011e13c000 00000100:00100000:2.0:1746142909.583288:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867332608:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10779us (10969us total) trans 0 rc 835584/835584 00000100:00100000:2.0:1746142909.583298:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4323 00002000:00100000:2.0:1746142909.583307:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff8800938d3b80 x1830962867332608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.583315:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3b80 with x1830962867332608 ext(4194304->5029887) 00002000:00010000:2.0:1746142909.583321:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d3b80 00000100:00100000:0.0:1746142909.586193:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.586253:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332736 00000100:00100000:2.0:1746142909.586261:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332736 00010000:00010000:2.0:1746142909.586293:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.586329:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6347 00000100:00100000:2.0:1746142909.586336:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867332736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.586353:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.586370:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.586380:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.586408:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067cccb6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1724416->2068479) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c8 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.586431:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.586433:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.586439:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.586446:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.586542:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.586552:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867797376:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.586634:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.589361:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.589735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.589897:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332864 00000100:00100000:2.0:1746142909.590027:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332864 00000100:00100000:2.0:1746142909.590145:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14129 00000100:00100000:2.0:1746142909.590155:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:32339:x1830962867332864:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.590170:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.590183:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a500 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.590207:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.590214:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.590220:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.590221:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.590224:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3928064->4001791] (req 3928064->4001791) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.590247:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.590258:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.590268:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867797504:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.590339:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.590348:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.590356:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867797632:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.590374:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.590556:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867332992 00000100:00100000:0.0:1746142909.590559:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867332992 00000100:00100000:0.0:1746142909.590578:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14130 00000100:00100000:0.0:1746142909.590584:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867332992:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142909.590590:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.590597:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a507 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.590607:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.590609:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.590615:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.590626:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.590634:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445200, rc 0) 00000100:00100000:0.0:1746142909.590658:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867332992:12345-192.168.204.50@tcp:101:cat.0 Request processed in 74us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.590667:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14130 00000100:00100000:2.0:1746142909.591092:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867797376:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142909.591105:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.591307:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867332736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4970us (5121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.591314:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6347 00000100:00100000:0.0:1746142909.594814:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.594969:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867797504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.595106:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867333120 00000100:00100000:1.0:1746142909.595111:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867333120 00000100:00100000:0.0:1746142909.595135:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.595142:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14131 00000100:00100000:1.0:1746142909.595149:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867333120:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.595163:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.595237:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed1c00/0x2fa243e067cccbeb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a50e expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.595256:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.595265:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1c00/0x2fa243e067cccbeb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a50e expref: 17 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.595273:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1c00/0x2fa243e067cccbeb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a50e expref: 17 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.595288:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1c00, rc 0) 00000100:00100000:1.0:1746142909.595316:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867333120:12345-192.168.204.50@tcp:101:cat.0 Request processed in 168us (510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.595321:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14131 00000100:00100000:2.0:1746142909.595362:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867797632:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.595394:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3928064->4001791] (req 3928064->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.595403:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d951e00, rc 0) 00000100:00100000:2.0:1746142909.595418:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:32339:x1830962867332864:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5265us (6066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.595422:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14129 00000100:00100000:3.0:1746142909.595755:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867333376 00000100:00100000:3.0:1746142909.595759:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867333376 00010000:00010000:3.0:1746142909.595776:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.595803:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6348 00000100:00100000:3.0:1746142909.595808:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867333376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.595817:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.595833:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.595842:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.595857:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067cccaa9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a44a expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.595881:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.595924:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867333376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.595929:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6348 00000100:00100000:0.0:1746142909.595992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.596019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.596032:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867333632 00000100:00100000:2.0:1746142909.596035:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867333632 00000100:00100000:1.0:1746142909.596043:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867333888 00000100:00100000:1.0:1746142909.596049:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867333888 00002000:00100000:2.0:1746142909.596055:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800981ce680 x1830962867333632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.596063:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981ce680 with x1830962867333632 ext(1048576->2097151) 00002000:00010000:2.0:1746142909.596067:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981ce680 00002000:00100000:1.0:1746142909.596072:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800981cd180 x1830962867333888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.596080:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cd180 with x1830962867333888 ext(1048576->2097151) 00002000:00010000:1.0:1746142909.596084:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cd180 00000100:00100000:2.0:1746142909.596085:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4324 00000100:00100000:2.0:1746142909.596091:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867333632:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.596113:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4325 00000100:00100000:0.0:1746142909.596120:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867333888:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.598003:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.599057:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867333248 00000100:00100000:3.0:1746142909.599068:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867333248 00010000:00010000:3.0:1746142909.599099:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.599133:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6349 00000100:00100000:3.0:1746142909.599142:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867333248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.599156:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.599176:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.599188:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.599211:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107800/0x2fa243e067cccae8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a474 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.599238:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.599240:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.599247:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.599255:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.599288:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.599300:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867797760:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.599368:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.602546:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867333888:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6419us (6519us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142909.602556:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4325 00002000:00100000:1.0:1746142909.602568:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800981cd180 x1830962867333888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.602576:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cd180 with x1830962867333888 ext(1048576->2097151) 00002000:00010000:1.0:1746142909.602581:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cd180 00000100:00100000:3.0:1746142909.602679:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867797760:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.602694:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.602712:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867333248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3572us (4714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.602718:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6349 00000100:00100000:1.0:1746142909.604140:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.604205:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867334144 00000100:00100000:2.0:1746142909.604213:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867334144 00002000:00100000:2.0:1746142909.604244:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3997696->4001791) req@ffff880096af1f80 x1830962867334144/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.604253:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af1f80 with x1830962867334144 ext(3997696->4001791) 00002000:00010000:2.0:1746142909.604257:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af1f80 00000100:00100000:2.0:1746142909.604282:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4326 00000100:00100000:2.0:1746142909.604288:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962867334144:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.604414:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962867334144:12345-192.168.204.50@tcp:3:cat.0 Request processed in 126us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142909.604421:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4326 00002000:00100000:2.0:1746142909.604425:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3997696->4001791) req@ffff880096af1f80 x1830962867334144/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.604432:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af1f80 with x1830962867334144 ext(3997696->4001791) 00002000:00010000:2.0:1746142909.604435:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af1f80 00000100:00100000:3.0:1746142909.604535:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867333632:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8442us (8541us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142909.604542:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4324 00002000:00100000:3.0:1746142909.604547:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800981ce680 x1830962867333632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.604554:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981ce680 with x1830962867333632 ext(1048576->2097151) 00002000:00010000:3.0:1746142909.604557:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981ce680 00000100:00100000:0.0:1746142909.614234:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.614352:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867334400 00000100:00100000:3.0:1746142909.614361:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867334400 00002000:00100000:3.0:1746142909.614405:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800981cc380 x1830962867334400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.614416:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc380 with x1830962867334400 ext(2097152->3145727) 00002000:00010000:3.0:1746142909.614420:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cc380 00000100:00100000:3.0:1746142909.616288:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4327 00000100:00100000:3.0:1746142909.616300:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867334400:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.623232:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867334400:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6927us (8996us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142909.623244:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4327 00002000:00100000:3.0:1746142909.623255:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800981cc380 x1830962867334400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.623264:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc380 with x1830962867334400 ext(2097152->3145727) 00002000:00010000:3.0:1746142909.623269:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800981cc380 00000100:00100000:0.0:1746142909.628402:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.628663:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867334528 00000100:00100000:2.0:1746142909.628672:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867334528 00000100:00100000:2.0:1746142909.628721:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14132 00000100:00100000:2.0:1746142909.628728:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32337:x1830962867334528:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.628743:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.628757:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a515 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.628782:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.628789:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.628791:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.628794:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.628817:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.628827:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 13 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.628837:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867797888:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.628937:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.630879:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867797888:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.630924:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.630938:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2a00, rc 0) 00000100:00100000:2.0:1746142909.632247:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32337:x1830962867334528:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3514us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.632256:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14132 00000100:00100000:0.0:1746142909.632550:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.632656:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867334656 00000100:00100000:3.0:1746142909.632662:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867334656 00002000:00100000:3.0:1746142909.632695:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3928064->4001791) req@ffff8800981cdc00 x1830962867334656/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.632704:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cdc00 with x1830962867334656 ext(3928064->4001791) 00010000:00010000:3.0:1746142909.632710:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.632722:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.632728:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800981cdc00 00000100:00100000:3.0:1746142909.632741:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1343 00000100:00100000:3.0:1746142909.632748:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867334656:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142909.639267:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867334656:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6513us (6711us total) trans 17179873921 rc 0/0 00000100:00100000:0.0:1746142909.639277:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1343 00002000:00100000:0.0:1746142909.639286:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3928064->4001791) req@ffff8800981cdc00 x1830962867334656/t17179873921(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.639294:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cdc00 with x1830962867334656 ext(3928064->4001791) 00010000:00010000:0.0:1746142909.639302:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 16 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.639316:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 16 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746142909.639322:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800981cdc00 00000100:00100000:0.0:1746142909.641847:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.642167:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867334784 00000100:00100000:3.0:1746142909.642175:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867334784 00010000:00010000:3.0:1746142909.642205:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 16 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.642238:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6350 00000100:00100000:3.0:1746142909.642244:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867334784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.642257:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142909.642269:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142909 -> 1746142910 00002000:00010000:3.0:1746142909.642272:0:13297:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142909 -> 1746142910 00010000:00010000:3.0:1746142909.642276:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 16 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.642287:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 16 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.642305:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067cccbdd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3928064->4001791) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a500 expref: 16 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.643509:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.643512:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.643519:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.643527:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.643552:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.643567:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867798016:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.644532:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.654161:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.654261:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867798016:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.654276:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.655685:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867334784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 13437us (13840us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.655696:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6350 00000100:00100000:1.0:1746142909.655769:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867335040 00000100:00100000:1.0:1746142909.655775:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867335040 00002000:00100000:1.0:1746142909.655807:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800981cce00 x1830962867335040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.655816:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cce00 with x1830962867335040 ext(2097152->4194303) 00002000:00010000:1.0:1746142909.655820:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cce00 00000100:00100000:1.0:1746142909.656634:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4328 00000100:00100000:1.0:1746142909.656642:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867335040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142909.673658:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867335040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17008us (19496us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142909.673669:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4328 00002000:00100000:1.0:1746142909.673679:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800981cce00 x1830962867335040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.673688:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cce00 with x1830962867335040 ext(2097152->4194303) 00002000:00010000:1.0:1746142909.673693:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cce00 00000100:00100000:0.0:1746142909.681648:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.681687:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.681757:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867335424 00000100:00100000:1.0:1746142909.681764:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867335424 00000100:00100000:2.0:1746142909.681787:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867335168 00000100:00100000:2.0:1746142909.681795:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867335168 00000100:00100000:1.0:1746142909.681799:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5249 00000100:00100000:1.0:1746142909.681805:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32337:x1830962867335424:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142909.681843:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14133 00000100:00100000:2.0:1746142909.681850:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32336:x1830962867335168:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.681866:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.681884:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a51c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.681936:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.681944:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.681946:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.681950:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3645440->4194303] (req 3645440->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.681981:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.681994:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.682003:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32337:x1830962867335424:12345-192.168.204.50@tcp:35:cat.0 Request processed in 197us (315us total) trans 8589936575 rc 0/0 00000100:00100000:2.0:1746142909.682005:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867798144:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.682010:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5249 00000100:00100000:2.0:1746142909.682920:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.684511:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867798144:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.684537:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3645440->4194303] (req 3645440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.684553:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3c00, rc 0) 00000100:00100000:2.0:1746142909.685240:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32336:x1830962867335168:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3389us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.685248:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14133 00000100:00100000:0.0:1746142909.686718:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.686937:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867335552 00000100:00100000:3.0:1746142909.686944:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867335552 00010000:00010000:3.0:1746142909.686971:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.687003:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6351 00000100:00100000:3.0:1746142909.687010:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867335552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.687021:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.687037:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.687048:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.687067:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067cccbf2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a515 expref: 35 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.687098:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.687100:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.687105:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.687113:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.687138:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 34 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.687149:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867798272:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.687231:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.688235:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867798272:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.688248:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.688280:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867335552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1271us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.688286:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6351 00000100:00100000:0.0:1746142909.688803:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.689048:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867335808 00000100:00100000:1.0:1746142909.689054:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867335808 00002000:00100000:1.0:1746142909.689082:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3645440->3649535) req@ffff880092135180 x1830962867335808/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.689090:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135180 with x1830962867335808 ext(3645440->3649535) 00002000:00010000:1.0:1746142909.689094:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092135180 00000100:00100000:1.0:1746142909.689120:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4329 00000100:00100000:1.0:1746142909.689126:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867335808:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142909.689230:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867335808:12345-192.168.204.50@tcp:3:cat.0 Request processed in 103us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142909.689236:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4329 00002000:00100000:1.0:1746142909.689241:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3645440->3649535) req@ffff880092135180 x1830962867335808/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.689253:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135180 with x1830962867335808 ext(3645440->3649535) 00002000:00010000:1.0:1746142909.689255:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092135180 00000100:00100000:1.0:1746142909.699703:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.699751:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867335936 00000100:00100000:2.0:1746142909.699764:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867335936 00000100:00100000:2.0:1746142909.699808:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14134 00000100:00100000:2.0:1746142909.699815:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32336:x1830962867335936:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.699831:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.699846:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a523 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.699871:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.699879:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.699884:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.699886:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.699888:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.700872:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 13 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.700884:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 13 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.700894:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867798400:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.701010:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.701017:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.701025:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867798528:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.701042:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.703314:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867798400:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.703322:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867798528:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142909.703342:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->4460543] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 32 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.703352:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3e00, rc 0) 00000100:00100000:2.0:1746142909.703398:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32336:x1830962867335936:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3578us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.703405:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14134 00000100:00100000:0.0:1746142909.707735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.707897:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867336064 00000100:00100000:3.0:1746142909.707937:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867336064 00010000:00010000:3.0:1746142909.707967:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.707990:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6352 00000100:00100000:3.0:1746142909.707997:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867336064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.708011:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.708029:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.708043:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.708062:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092131200/0x2fa243e067cccb3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4a5 expref: 14 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.708091:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.708133:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867336064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 135us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.708138:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6352 00000100:00100000:1.0:1746142909.708286:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.708335:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867336192 00000100:00100000:3.0:1746142909.708338:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867336192 00010000:00010000:3.0:1746142909.708350:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.708451:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6353 00000100:00100000:3.0:1746142909.708457:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867336192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.708464:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.708472:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.708480:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.708492:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107e00/0x2fa243e067cccb2e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a497 expref: 32 pid: 12211 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.708501:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.708502:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.708508:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.708515:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.708540:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 31 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.708551:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867798656:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.708613:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.710410:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867798656:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.710424:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.710448:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867336192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1990us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.710455:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6353 00000100:00100000:0.0:1746142909.715095:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.715238:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867336448 00000100:00100000:1.0:1746142909.715247:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867336448 00002000:00100000:1.0:1746142909.715283:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4456448->4460543) req@ffff880092137800 x1830962867336448/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.715304:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137800 with x1830962867336448 ext(4456448->4460543) 00002000:00010000:1.0:1746142909.715309:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137800 00000100:00100000:1.0:1746142909.715351:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4330 00000100:00100000:1.0:1746142909.715358:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867336448:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142909.716024:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867336448:12345-192.168.204.50@tcp:3:cat.0 Request processed in 665us (935us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142909.716030:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4330 00002000:00100000:1.0:1746142909.716036:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4456448->4460543) req@ffff880092137800 x1830962867336448/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.716043:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137800 with x1830962867336448 ext(4456448->4460543) 00002000:00010000:1.0:1746142909.716046:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137800 00000100:00100000:0.0:1746142909.724064:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.724140:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867336704 00000100:00100000:2.0:1746142909.724149:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867336704 00000100:00100000:2.0:1746142909.724305:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5250 00000100:00100000:2.0:1746142909.724314:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4851450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32336:x1830962867336704:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142909.724554:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4851450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32336:x1830962867336704:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 241us (496us total) trans 8589936576 rc 0/0 00000100:00100000:2.0:1746142909.724560:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5250 00000100:00100000:0.0:1746142909.735697:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.735739:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.735772:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867336832 00000100:00100000:2.0:1746142909.735788:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867336832 00000100:00100000:2.0:1746142909.735847:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867336960 00000100:00100000:2.0:1746142909.735850:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867336960 00000100:00100000:0.0:1746142909.735865:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14135 00000100:00100000:0.0:1746142909.735873:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867336832:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142909.735887:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.735919:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0e00/0x2fa243e067cccc07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a52a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142909.735959:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867798784:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142909.736031:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.736584:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14136 00000100:00100000:2.0:1746142909.736597:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867336960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.736605:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.736613:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067cccc0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a531 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.736643:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867798912:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.736674:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00002000:00010000:2.0:1746142909.739209:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142909 -> 1746142910 00002000:00010000:2.0:1746142909.739214:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142909 -> 1746142910 00002000:00010000:2.0:1746142909.739216:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142909 -> 1746142910 00000100:00100000:2.0:1746142909.739234:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867798784:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142909.739256:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0e00/0x2fa243e067cccc07 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a52a expref: 14 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.739267:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0e00/0x2fa243e067cccc07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a52a expref: 14 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.739279:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0e00, rc 0) 00000100:00100000:2.0:1746142909.739320:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867336832:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3448us (3628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142909.739326:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14135 00002000:00010000:3.0:1746142909.739405:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142909 -> 1746142910 00000100:00100000:3.0:1746142909.739416:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867798912:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.739431:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067cccc0e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a531 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.739444:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067cccc0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a531 expref: 16 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.739453:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3000, rc 0) 00000100:00100000:3.0:1746142909.739470:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867336960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2875us (3730us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.739474:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14136 00000100:00100000:3.0:1746142909.756059:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.756136:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337216 00000100:00100000:2.0:1746142909.756145:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337216 00002000:00100000:2.0:1746142909.756182:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009862fb80 x1830962867337216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.756192:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862fb80 with x1830962867337216 ext(1048576->2097151) 00002000:00010000:2.0:1746142909.756196:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862fb80 00000100:00100000:2.0:1746142909.756789:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4331 00000100:00100000:2.0:1746142909.756798:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867337216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.770396:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867337216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13582us (14328us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142909.770407:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4331 00002000:00100000:2.0:1746142909.770418:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009862fb80 x1830962867337216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.770428:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862fb80 with x1830962867337216 ext(1048576->2097151) 00002000:00010000:2.0:1746142909.770432:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862fb80 00000100:00100000:0.0:1746142909.774594:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.776123:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337344 00000100:00100000:3.0:1746142909.776133:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337344 00000100:00100000:3.0:1746142909.776190:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14137 00000100:00100000:3.0:1746142909.776197:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:32347:x1830962867337344:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142909.776211:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.776232:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a538 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.776256:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.776262:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.776264:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.776267:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.776293:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 30 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.776311:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 30 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.776321:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867799040:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.777189:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.777891:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867799040:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.777931:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [4120576->4194303] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.777943:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106e00, rc 0) 00000100:00100000:3.0:1746142909.777997:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:32347:x1830962867337344:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1801us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.778004:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14137 00000100:00100000:0.0:1746142909.779857:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.780462:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337472 00000100:00100000:3.0:1746142909.780469:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337472 00000100:00100000:0.0:1746142909.781046:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.781138:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14138 00000100:00100000:3.0:1746142909.781145:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867337472:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.781158:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.781169:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccc1c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a53f expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.781203:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867799168:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.781765:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337600 00000100:00100000:2.0:1746142909.781769:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337600 00002000:00100000:2.0:1746142909.781792:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4460543) req@ffff88009a358000 x1830962867337600/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.781799:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358000 with x1830962867337600 ext(4194304->4460543) 00010000:00010000:2.0:1746142909.781804:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.781814:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 31 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:2.0:1746142909.781823:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a358000 00000100:00100000:3.0:1746142909.782009:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.782402:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1344 00000100:00100000:2.0:1746142909.782408:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867337600:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142909.782856:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.783037:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337728 00000100:00100000:3.0:1746142909.783041:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337728 00000100:00100000:3.0:1746142909.783062:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14139 00000100:00100000:3.0:1746142909.783067:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867337728:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.783073:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.783083:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccc23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a546 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.783132:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867799296:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.783158:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.785474:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867799296:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.785496:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccc23 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a546 expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.785507:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccc23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a546 expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.786061:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106400, rc 0) 00000100:00100000:3.0:1746142909.786091:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867337728:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3023us (3235us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.786097:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14139 00000100:00100000:3.0:1746142909.786141:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867799168:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.786155:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccc1c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a53f expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.786163:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067cccc1c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a53f expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.786176:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106200, rc 0) 00000100:00100000:3.0:1746142909.786192:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867337472:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5047us (6337us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.786197:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14138 00000100:00100000:0.0:1746142909.788584:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867337600:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6169us (7531us total) trans 21474841181 rc 0/0 00000100:00100000:0.0:1746142909.788594:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1344 00002000:00100000:0.0:1746142909.788603:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4460543) req@ffff88009a358000 x1830962867337600/t21474841181(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.788615:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a358000 with x1830962867337600 ext(4194304->4460543) 00010000:00010000:0.0:1746142909.788623:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.788635:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746142909.788640:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a358000 00000100:00100000:0.0:1746142909.789244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.789881:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337856 00000100:00100000:3.0:1746142909.789889:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337856 00000100:00100000:3.0:1746142909.789950:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14140 00000100:00100000:3.0:1746142909.789956:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:32348:x1830962867337856:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.789969:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.789982:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a54d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.790002:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.790004:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.790007:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.790017:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.790025:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107600, rc 0) 00000100:00100000:3.0:1746142909.790352:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:32348:x1830962867337856:12345-192.168.204.50@tcp:101:cat.0 Request processed in 394us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.790357:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14140 00000100:00100000:0.0:1746142909.791160:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.791305:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867337984 00000100:00100000:3.0:1746142909.791308:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867337984 00010000:00010000:3.0:1746142909.791328:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.791515:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6354 00000100:00100000:3.0:1746142909.791521:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867337984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.791530:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.791546:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.791555:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.791571:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccc00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4460543) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a523 expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.791581:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.791583:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.791588:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.791596:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.791602:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.791603:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.791606:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.791616:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.791638:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.791647:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867799424:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.791952:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.791959:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867799552:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.792286:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.796606:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.796698:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867799424:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.796706:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867799552:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.796722:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142909.797493:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867338240 00000100:00100000:0.0:1746142909.797500:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867338240 00002000:00100000:0.0:1746142909.797536:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4120576->4124671) req@ffff880096af2680 x1830962867338240/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.797545:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2680 with x1830962867338240 ext(4120576->4124671) 00002000:00010000:0.0:1746142909.797549:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af2680 00000100:00100000:0.0:1746142909.797565:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4332 00000100:00100000:0.0:1746142909.797570:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867338240:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.797939:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867337984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6416us (6783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.797946:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6354 00000100:00100000:0.0:1746142909.798339:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867338240:12345-192.168.204.50@tcp:3:cat.0 Request processed in 767us (1740us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142909.798344:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4332 00002000:00100000:0.0:1746142909.798349:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4120576->4124671) req@ffff880096af2680 x1830962867338240/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.798355:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2680 with x1830962867338240 ext(4120576->4124671) 00002000:00010000:0.0:1746142909.798358:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af2680 00000100:00100000:0.0:1746142909.799889:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.799958:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867338496 00000100:00100000:1.0:1746142909.799963:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867338496 00002000:00100000:1.0:1746142909.799984:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096070a80 x1830962867338496/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.799996:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070a80 with x1830962867338496 ext(2097152->3145727) 00002000:00010000:1.0:1746142909.799999:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096070a80 00000100:00100000:1.0:1746142909.800019:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4333 00000100:00100000:1.0:1746142909.800024:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867338496:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.804853:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.805392:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867338624 00000100:00100000:2.0:1746142909.805399:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867338624 00000100:00100000:1.0:1746142909.805415:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867338496:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5388us (5526us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142909.805424:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4333 00002000:00100000:1.0:1746142909.805434:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880096070a80 x1830962867338496/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.805441:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070a80 with x1830962867338496 ext(2097152->3145727) 00002000:00010000:1.0:1746142909.805447:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096070a80 00000100:00100000:2.0:1746142909.805622:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14141 00000100:00100000:2.0:1746142909.805630:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:32347:x1830962867338624:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142909.805642:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.805655:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a554 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.805678:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.805685:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.805686:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142909.805689:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->3551231] (req 3145728->3551231) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.805714:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 33 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.805725:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 33 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.805739:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867799680:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142909.806129:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.810709:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.811767:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867338752 00000100:00100000:3.0:1746142909.811775:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867338752 00000100:00100000:3.0:1746142909.811841:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14142 00000100:00100000:3.0:1746142909.811849:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+17:32348:x1830962867338752:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.811864:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.811879:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a55b expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.811926:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.811929:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.811933:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 18 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.811943:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 18 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.811952:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107000, rc 0) 00000100:00100000:3.0:1746142909.811999:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+18:32348:x1830962867338752:12345-192.168.204.50@tcp:101:cat.0 Request processed in 151us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.812005:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14142 00000100:00100000:0.0:1746142909.812428:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867799680:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142909.812448:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->3551231] (req 3145728->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.812456:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2e00, rc 0) 00000100:00100000:2.0:1746142909.812469:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.812488:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32347:x1830962867338624:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6859us (7747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.812494:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14141 00000100:00100000:1.0:1746142909.812560:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867338880 00000100:00100000:1.0:1746142909.812564:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867338880 00002000:00100000:1.0:1746142909.812587:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3645440->4194303) req@ffff88009cfece00 x1830962867338880/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.812597:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfece00 with x1830962867338880 ext(3645440->4194303) 00010000:00010000:1.0:1746142909.812603:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.812614:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 34 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:1.0:1746142909.812621:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cfece00 00000100:00100000:1.0:1746142909.812639:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1345 00000100:00100000:1.0:1746142909.812645:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867338880:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142909.819687:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867338880:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7033us (7211us total) trans 17179873922 rc 0/0 00000100:00100000:0.0:1746142909.819697:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1345 00002000:00100000:0.0:1746142909.819707:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3645440->4194303) req@ffff88009cfece00 x1830962867338880/t17179873922(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142909.819715:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfece00 with x1830962867338880 ext(3645440->4194303) 00010000:00010000:0.0:1746142909.819724:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:0.0:1746142909.819737:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:0.0:1746142909.819743:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cfece00 00000100:00100000:0.0:1746142909.820778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.820936:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339008 00000100:00100000:1.0:1746142909.820943:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339008 00000100:00100000:1.0:1746142909.820978:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14418 00000100:00100000:1.0:1746142909.820985:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:32350:x1830962867339008:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142909.821003:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.821017:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cccc3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a562 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.821065:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821557:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821566:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821577:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821582:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821587:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821642:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821651:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 23 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.821661:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.821685:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 23 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.821694:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 23 pid: 22383 timeout: 783 lvb_type: 0 00000100:00100000:1.0:1746142909.821704:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867799808:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142909.821778:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.822841:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.823125:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339136 00000100:00100000:3.0:1746142909.823132:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339136 00010000:00010000:3.0:1746142909.823154:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746142909.823494:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.823550:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867799808:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142909.823569:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142909.824074:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339264 00000100:00100000:3.0:1746142909.824078:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339264 00010000:00010000:3.0:1746142909.824090:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 24 pid: 22383 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.824111:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6355 00000100:00100000:3.0:1746142909.824117:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867339136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.824127:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.824143:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.824152:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.824167:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3c00/0x2fa243e067cccbf9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3645440->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a51c expref: 36 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.824180:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.824182:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.824186:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.824193:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.824199:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.824200:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.824203:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.824208:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.824228:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 16 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.824236:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867799936:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.824297:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.824304:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867800064:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142909.824304:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6356 00000100:00100000:1.0:1746142909.824311:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867339264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.824317:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142909.824321:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746142909.824322:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 24 pid: 22383 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.824329:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 24 pid: 22383 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.824458:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067cccb5f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4c1 expref: 24 pid: 22383 timeout: 783 lvb_type: 0 00010000:00010000:1.0:1746142909.824476:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142909.824480:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.824487:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.824492:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.824507:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142909.824516:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824522:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142909.824527:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867339264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 217us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.824532:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6356 00000004:00200000:0.0:1746142909.824559:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142909.824563:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142909.824705:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824714:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824722:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824727:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824737:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824742:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c7a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142909.824746:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824751:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824759:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142909.824761:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142909.824764:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824768:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cccc46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824789:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824793:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824795:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824798:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c7000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142909.824799:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824801:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824805:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b53d1800) 00010000:00010000:0.0:1746142909.824806:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142909.824807:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824809:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cccc4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.824831:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cccc3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.824837:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 16 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.824841:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142909.824842:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142909.824843:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7e00, rc 0) 00000100:00100000:0.0:1746142909.824868:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:32350:x1830962867339008:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3884us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.824872:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14418 00000100:00100000:3.0:1746142909.826077:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867799936:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142909.826086:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867800064:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142909.826100:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.826129:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2003:x1830962867339136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2011us (3295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.826136:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6355 00000100:00100000:0.0:1746142909.828712:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.828838:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.828872:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.828926:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339392 00000100:00100000:2.0:1746142909.828934:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339392 00000100:00100000:0.0:1746142909.828938:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.828950:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339520 00000100:00100000:0.0:1746142909.828953:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339520 00000100:00100000:2.0:1746142909.828968:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339648 00000100:00100000:2.0:1746142909.828970:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339648 00000100:00100000:0.0:1746142909.829370:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867339904 00000100:00100000:0.0:1746142909.829374:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867339904 00000100:00100000:2.0:1746142909.829375:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14143 00000100:00100000:2.0:1746142909.829393:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867339392:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1746142909.829398:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14144 00000100:00100000:0.0:1746142909.829402:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867339520:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142909.829409:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.829409:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.829422:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a569 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.829422:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a570 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.829440:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.829442:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.829448:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.829461:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.829469:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3e00, rc 0) 00010000:00010000:0.0:1746142909.829487:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.829488:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142909.829493:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 9 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.829501:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 9 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.829513:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0800, rc 0) 00000100:00100000:0.0:1746142909.829527:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867339520:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 126us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.829528:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867339392:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 147us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142909.829533:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14144 00000100:00100000:2.0:1746142909.829535:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14143 00000100:00100000:2.0:1746142909.829545:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14145 00000100:00100000:2.0:1746142909.829550:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867339648:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142909.829556:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.829562:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccc69 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a577 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.829598:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867800192:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.829639:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.830112:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14146 00000100:00100000:0.0:1746142909.830119:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867339904:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142909.830125:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.830131:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed1400/0x2fa243e067cccc70 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a57e expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.830148:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.830151:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867800320:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142909.830172:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.830184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.830210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.830224:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867340032 00000100:00100000:2.0:1746142909.830226:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867340032 00002000:00100000:2.0:1746142909.830267:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3547136->3551231) req@ffff88009cfed880 x1830962867340032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.830275:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfed880 with x1830962867340032 ext(3547136->3551231) 00002000:00010000:2.0:1746142909.830279:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfed880 00000100:00100000:2.0:1746142909.830299:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867340288 00000100:00100000:2.0:1746142909.830302:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867340288 00002000:00100000:2.0:1746142909.830312:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88009cfedc00 x1830962867340288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.830319:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfedc00 with x1830962867340288 ext(2097152->3145727) 00002000:00010000:2.0:1746142909.830321:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfedc00 00000100:00100000:2.0:1746142909.830328:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867340544 00000100:00100000:2.0:1746142909.830329:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867340544 00002000:00100000:2.0:1746142909.830337:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4120575) req@ffff88009cfec380 x1830962867340544/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.830347:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec380 with x1830962867340544 ext(3145728->4120575) 00002000:00010000:2.0:1746142909.830349:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfec380 00000100:00100000:2.0:1746142909.830357:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4334 00000100:00100000:2.0:1746142909.830361:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867340032:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142909.830453:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867340032:12345-192.168.204.50@tcp:3:cat.0 Request processed in 91us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142909.830459:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4334 00002000:00100000:2.0:1746142909.830463:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3547136->3551231) req@ffff88009cfed880 x1830962867340032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/4536 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.830469:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfed880 with x1830962867340032 ext(3547136->3551231) 00002000:00010000:2.0:1746142909.830472:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfed880 00000100:00100000:2.0:1746142909.830481:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4335 00000100:00100000:2.0:1746142909.830486:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867340288:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142909.830541:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4336 00000100:00100000:1.0:1746142909.830549:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867340544:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142909.832446:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867800320:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142909.832479:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1400/0x2fa243e067cccc70 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a57e expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.832492:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1400/0x2fa243e067cccc70 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a57e expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.832504:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1400, rc 0) 00000100:00100000:0.0:1746142909.832533:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867339904:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2414us (3594us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142909.832539:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14146 00000100:00100000:3.0:1746142909.832758:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867800192:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.832775:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccc69 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a577 expref: 9 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.832784:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccc69 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a577 expref: 9 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.832795:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2a00, rc 0) 00000100:00100000:3.0:1746142909.832827:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867339648:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3276us (3954us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.832833:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14145 00000100:00100000:0.0:1746142909.836266:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.836301:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867341056 00000100:00100000:0.0:1746142909.836310:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867341056 00000100:00100000:0.0:1746142909.836355:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14419 00000100:00100000:0.0:1746142909.836362:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:32350:x1830962867341056:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142909.836395:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.836412:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f000/0x2fa243e067cccc77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a585 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.836497:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.836511:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.836519:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142909.836549:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.836560:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 17 pid: 13326 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746142909.836570:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867800448:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142909.836640:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.836690:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.837334:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867340544:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6784us (7121us total) trans 0 rc 974848/974848 00000100:00100000:1.0:1746142909.837342:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4336 00002000:00100000:1.0:1746142909.837349:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4120575) req@ffff88009cfec380 x1830962867340544/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142909.837357:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec380 with x1830962867340544 ext(3145728->4120575) 00002000:00010000:1.0:1746142909.837362:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfec380 00000100:00100000:1.0:1746142909.837392:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867340800 00000100:00100000:1.0:1746142909.837395:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867340800 00000100:00100000:1.0:1746142909.837416:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5251 00000100:00100000:1.0:1746142909.837421:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:32347:x1830962867340800:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142909.837534:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:32347:x1830962867340800:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 112us (843us total) trans 8589936577 rc 0/0 00000100:00100000:1.0:1746142909.837540:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5251 00000100:00100000:0.0:1746142909.842047:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867800448:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142909.842074:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142909.842652:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.843402:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867340288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12913us (13215us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142909.843413:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4335 00002000:00100000:2.0:1746142909.843422:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff88009cfedc00 x1830962867340288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.843430:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfedc00 with x1830962867340288 ext(2097152->3145727) 00002000:00010000:2.0:1746142909.843434:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfedc00 00000100:00100000:3.0:1746142909.843651:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867341184 00000100:00100000:3.0:1746142909.843657:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867341184 00010000:00010000:3.0:1746142909.843680:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 18 pid: 13326 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.847367:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6357 00000100:00100000:3.0:1746142909.847392:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867341184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.847411:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.847420:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 18 pid: 13326 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.847432:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 18 pid: 13326 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.847451:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7e00/0x2fa243e067cccc54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a562 expref: 18 pid: 13326 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.847473:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.847478:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142909.847487:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142909.847493:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142909.847511:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.847564:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867341184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (4912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.847570:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6357 00010000:00010000:0.0:1746142909.848259:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142909.848267:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142909.848267:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142909.848284:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000100:00100000:2.0:1746142909.848288:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867341440 00000100:00100000:2.0:1746142909.848295:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867341440 00002000:00100000:2.0:1746142909.848323:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3551232->4194303) req@ffff88009cfefb80 x1830962867341440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.848331:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfefb80 with x1830962867341440 ext(3551232->4194303) 00002000:00010000:2.0:1746142909.848335:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfefb80 00000100:00100000:2.0:1746142909.848351:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4337 00000100:00100000:2.0:1746142909.848355:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867341440:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1746142909.848405:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f000/0x2fa243e067cccc77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 18 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.848419:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.848425:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142909.848427:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142909.848429:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2e400, rc 0) 00000100:00100000:0.0:1746142909.848451:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:32350:x1830962867341056:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 12091us (12199us total) trans 8589936578 rc 0/0 00000100:00100000:0.0:1746142909.848456:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14419 00000100:00100000:0.0:1746142909.852645:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.852743:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.852767:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867341568 00000100:00100000:0.0:1746142909.852775:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867341568 00000100:00100000:0.0:1746142909.852822:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867341824 00000100:00100000:0.0:1746142909.852825:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867341824 00000100:00100000:0.0:1746142909.852841:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14420 00000100:00100000:0.0:1746142909.852847:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:32350:x1830962867341568:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142909.852870:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.852887:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067cccc8c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a58c expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.852997:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.853010:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 18 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.853017:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.853042:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 18 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.853053:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 18 pid: 13326 timeout: 783 lvb_type: 0 00000100:00100000:0.0:1746142909.853064:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867800576:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142909.853133:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.853244:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14421 00000100:00100000:1.0:1746142909.853252:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32352:x1830962867341824:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142909.853262:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.853270:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098291a00/0x2fa243e067cccc9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a593 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.853310:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853318:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853326:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853338:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853343:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853347:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853427:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445800/0x2fa243e067ccccaf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853437:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098445800/0x2fa243e067ccccaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853443:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098445800/0x2fa243e067ccccaf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142909.853449:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:1.0:1746142909.853510:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853516:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853521:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853525:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098290400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142909.853529:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853535:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853544:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142909.853547:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142909.853549:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853553:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098290400/0x2fa243e067cccca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853569:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853576:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853580:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853584:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098444400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142909.853586:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853590:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853595:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b53d1800) 00010000:00010000:1.0:1746142909.853597:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142909.853599:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853604:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098444400/0x2fa243e067cccca8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142909.853634:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098291a00/0x2fa243e067cccc9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a593 expref: 51 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.853649:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445800/0x2fa243e067ccccaf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a593 expref: 50 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.853654:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142909.853656:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142909.853658:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.853667:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.853672:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445800, rc 0) 00000100:00100000:1.0:1746142909.853698:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32352:x1830962867341824:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 446us (955us total) trans 8589936579 rc 0/0 00000100:00100000:1.0:1746142909.853703:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14421 00000100:00100000:2.0:1746142909.857463:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867341440:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9096us (9184us total) trans 0 rc 643072/643072 00000100:00100000:2.0:1746142909.857475:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4337 00002000:00100000:2.0:1746142909.857486:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3551232->4194303) req@ffff88009cfefb80 x1830962867341440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142909.857494:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfefb80 with x1830962867341440 ext(3551232->4194303) 00002000:00010000:2.0:1746142909.857499:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfefb80 00000100:00100000:0.0:1746142909.857653:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.857719:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867341952 00000100:00100000:1.0:1746142909.857727:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867341952 00000100:00100000:1.0:1746142909.857780:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 765 00000100:00100000:1.0:1746142909.857788:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867341952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142909.857801:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142909.857822:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445800/0x2fa243e067ccccaf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a593 expref: 50 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.857836:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142909.857841:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.857849:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.857853:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142909.857858:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142909.857876:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867341952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.857885:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 765 00000100:00100000:1.0:1746142909.858275:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867800576:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142909.858293:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142909.858464:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.858524:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867342080 00000100:00100000:3.0:1746142909.858527:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867342080 00010000:00010000:3.0:1746142909.858541:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 19 pid: 13326 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.858559:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6358 00000100:00100000:3.0:1746142909.858565:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:2005:x1830962867342080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142909.858571:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142909.858575:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 19 pid: 13326 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.858583:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 19 pid: 13326 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.858594:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e400/0x2fa243e067cccc7e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a585 expref: 19 pid: 13326 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.858607:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142909.858610:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.858617:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.858624:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142909.858639:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142909.858659:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867342080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.858665:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6358 00010000:00010000:2.0:1746142909.859145:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.859151:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142909.859195:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:2.0:1746142909.859199:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142909.859211:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.859237:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067cccc8c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 18 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.859267:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 17 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.859273:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142909.859276:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142909.859279:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3200, rc 0) 00000100:00100000:2.0:1746142909.859302:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:32350:x1830962867341568:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6455us (6666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.859307:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14420 00000100:00100000:0.0:1746142909.860841:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.860874:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.860927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.860971:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.861040:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867342336 00000100:00100000:1.0:1746142909.861050:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867342336 00000100:00100000:1.0:1746142909.861082:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867342208 00000100:00100000:1.0:1746142909.861085:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867342208 00000100:00100000:1.0:1746142909.861098:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867342592 00000100:00100000:1.0:1746142909.861100:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867342592 00000100:00100000:3.0:1746142909.861104:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867342464 00000100:00100000:3.0:1746142909.861108:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867342464 00000100:00100000:1.0:1746142909.861113:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14147 00000100:00100000:1.0:1746142909.861119:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867342336:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142909.861125:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14148 00000100:00100000:3.0:1746142909.861129:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867342208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.861137:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.861137:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.861152:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067ccccbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a59a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.861152:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6800/0x2fa243e067ccccc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5a1 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.861201:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867800704:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.861201:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867800832:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.861263:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14149 00000100:00100000:2.0:1746142909.861270:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867342592:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142909.861277:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.861283:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067cccccb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5af expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142909.861293:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14150 00000100:00100000:0.0:1746142909.861299:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867342464:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:2.0:1746142909.861305:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867800960:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142909.861307:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.861312:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067ccccd2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5a8 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142909.861330:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867801088:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.861548:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.861893:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.862125:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.862131:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.863346:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867800704:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.863371:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067ccccbd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a59a expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.863390:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106200/0x2fa243e067ccccbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a59a expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.863405:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106200, rc 0) 00000100:00100000:3.0:1746142909.863446:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867342208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2314us (2569us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.863453:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14148 00000100:00100000:0.0:1746142909.865603:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867801088:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142909.865627:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067ccccd2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5a8 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.865638:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067ccccd2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5a8 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142909.865650:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d0200, rc 0) 00000100:00100000:3.0:1746142909.865669:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867800960:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142909.865676:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867342464:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4378us (4705us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142909.865682:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14150 00010000:00010000:3.0:1746142909.865685:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067cccccb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5af expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.865693:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c7a00/0x2fa243e067cccccb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5af expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.865703:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7a00, rc 0) 00000100:00100000:3.0:1746142909.865718:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867342592:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4450us (4791us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.865723:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14149 00000100:00100000:1.0:1746142909.866089:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867800832:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142909.866104:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6800/0x2fa243e067ccccc4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5a1 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.866113:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6800/0x2fa243e067ccccc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5a1 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.866126:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e6800, rc 0) 00000100:00100000:1.0:1746142909.866158:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867342336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5038us (5323us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.866163:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14147 00000100:00100000:0.0:1746142909.868338:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.869912:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867342848 00000100:00100000:2.0:1746142909.869921:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867342848 00000100:00100000:2.0:1746142909.869971:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14422 00000100:00100000:2.0:1746142909.869978:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:32350:x1830962867342848:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142909.869993:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142909.870002:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142909.870007:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccccd9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5b6 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.870078:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867343104 00000100:00100000:3.0:1746142909.870082:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867343104 00002000:00100000:3.0:1746142909.870105:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880096af0700 x1830962867343104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.870113:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0700 with x1830962867343104 ext(4194304->5033983) 00002000:00010000:3.0:1746142909.870117:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af0700 00000100:00100000:3.0:1746142909.870129:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4338 00000100:00100000:3.0:1746142909.870133:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867343104:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1746142909.870145:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870157:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870166:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870175:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870180:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870185:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870190:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c6000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142909.870193:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870197:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870205:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142909.870208:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142909.870210:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870215:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067cccce0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142909.870246:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccccd9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5b6 expref: 18 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.870252:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6400/0x2fa243e067ccccd9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5b6 expref: 18 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.870259:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6400, rc 0) 00000100:00100000:2.0:1746142909.870291:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:32350:x1830962867342848:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 314us (1960us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142909.870296:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14422 00000100:00100000:1.0:1746142909.874415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.874491:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867343360 00000100:00100000:2.0:1746142909.874499:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867343360 00000100:00100000:2.0:1746142909.874544:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5252 00000100:00100000:2.0:1746142909.874551:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:32350:x1830962867343360:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142909.874708:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+18:32350:x1830962867343360:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 156us (298us total) trans 8589936580 rc 0/0 00000100:00100000:2.0:1746142909.874714:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5252 00000100:00100000:3.0:1746142909.875369:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867343104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5233us (5367us total) trans 0 rc 839680/839680 00000100:00100000:3.0:1746142909.875385:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4338 00002000:00100000:3.0:1746142909.875392:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff880096af0700 x1830962867343104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.875400:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0700 with x1830962867343104 ext(4194304->5033983) 00002000:00010000:3.0:1746142909.875405:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af0700 00000100:00100000:0.0:1746142909.883202:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.883240:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867343488 00000100:00100000:1.0:1746142909.883253:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867343488 00000100:00100000:1.0:1746142909.883294:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14151 00000100:00100000:1.0:1746142909.883300:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867343488:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.883314:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.883370:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7000/0x2fa243e067cccce7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5bd expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.883390:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.883405:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867343616 00000100:00100000:0.0:1746142909.883409:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867343616 00000100:00100000:0.0:1746142909.883431:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14152 00000100:00100000:0.0:1746142909.883435:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867343616:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1746142909.883441:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867801216:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142909.883443:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.883452:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974cc200/0x2fa243e067ccccee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5c4 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142909.883483:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130374700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867801344:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.883537:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.883540:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433240 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.885568:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867801216:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.885574:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130374700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867801344:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142909.885590:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974cc200/0x2fa243e067ccccee lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5c4 expref: 18 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.885590:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7000/0x2fa243e067cccce7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5bd expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.885601:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974cc200/0x2fa243e067ccccee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5c4 expref: 18 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.885601:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7000/0x2fa243e067cccce7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5bd expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.885612:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc200, rc 0) 00010000:00010000:1.0:1746142909.885612:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e7000, rc 0) 00000100:00100000:2.0:1746142909.885757:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867343616:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2320us (2367us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.885757:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867343488:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2456us (2561us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.885764:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14151 00000100:00100000:2.0:1746142909.885766:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14152 00000100:00100000:0.0:1746142909.888463:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.888502:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.888552:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867343872 00000100:00100000:1.0:1746142909.888561:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867343872 00000100:00100000:1.0:1746142909.888763:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867343744 00000100:00100000:1.0:1746142909.888767:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867343744 00000100:00100000:1.0:1746142909.889030:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14153 00000100:00100000:1.0:1746142909.889037:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867343872:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.889053:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.889066:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7e00/0x2fa243e067ccccf5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5d2 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142909.889120:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867801472:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.889184:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.889748:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14154 00000100:00100000:2.0:1746142909.889756:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867343744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.889764:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.889774:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccccfc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5cb expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.889796:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867801600:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142909.889821:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.892216:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867801600:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.892216:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867801472:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142909.892238:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccccfc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5cb expref: 16 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.892238:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7e00/0x2fa243e067ccccf5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d2 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.892249:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccccfc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5cb expref: 16 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.892249:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7e00/0x2fa243e067ccccf5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d2 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.892257:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6600, rc 0) 00010000:00010000:1.0:1746142909.892257:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e7e00, rc 0) 00000100:00100000:2.0:1746142909.892321:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867343744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2566us (3817us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.892321:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867343872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3284us (3863us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142909.892327:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14154 00000100:00100000:1.0:1746142909.892330:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14153 00000100:00100000:2.0:1746142909.912446:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.913048:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867344128 00000100:00100000:0.0:1746142909.913060:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867344128 00000100:00100000:0.0:1746142909.913103:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14423 00000100:00100000:0.0:1746142909.913109:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32358:x1830962867344128:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142909.913128:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142909.913144:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd000/0x2fa243e067cccd03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5d9 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.913198:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913206:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913212:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913221:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913224:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913227:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913294:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913300:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913304:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142909.913308:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142909.913352:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913356:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913359:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913362:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913365:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cd600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142909.913368:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913372:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913390:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142909.913393:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142909.913396:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913404:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cccd0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913426:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913430:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913434:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913437:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cc400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142909.913439:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913444:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913450:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736100) 00010000:00010000:0.0:1746142909.913452:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142909.913454:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913458:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc400/0x2fa243e067cccd11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142909.913488:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd000/0x2fa243e067cccd03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 52 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.913497:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 51 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142909.913507:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142909.913508:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142909.913510:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cca00, rc 0) 00000100:00100000:0.0:1746142909.913797:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32358:x1830962867344128:12345-192.168.204.50@tcp:101:cat.0 Request processed in 687us (1358us total) trans 8589936581 rc 0/0 00000100:00100000:0.0:1746142909.913803:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14423 00000100:00100000:0.0:1746142909.915943:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142909.916047:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.916094:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867344256 00000100:00100000:2.0:1746142909.916101:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867344256 00000100:00100000:2.0:1746142909.916136:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867344384 00000100:00100000:2.0:1746142909.916138:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867344384 00000100:00100000:2.0:1746142909.916151:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14155 00000100:00100000:2.0:1746142909.916157:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867344256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142909.916169:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142909.916181:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7600/0x2fa243e067cccd26 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5e0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.916219:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867801728:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.916243:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14156 00000100:00100000:1.0:1746142909.916250:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867344384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.916258:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.916267:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cccd2d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5e7 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.916271:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.916289:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867801856:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.916315:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.917700:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867801728:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142909.917721:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7600/0x2fa243e067cccd26 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5e0 expref: 33 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.917733:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7600/0x2fa243e067cccd26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5e0 expref: 33 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142909.917828:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7600, rc 0) 00000100:00100000:2.0:1746142909.917891:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867344256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1733us (1953us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142909.917915:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14155 00000100:00100000:1.0:1746142909.918222:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867801856:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142909.918238:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cccd2d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5e7 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.918248:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6000/0x2fa243e067cccd2d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5e7 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.918258:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e6000, rc 0) 00000100:00100000:1.0:1746142909.918293:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867344384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2043us (2246us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.918299:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14156 00000100:00100000:0.0:1746142909.926042:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.927119:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867344640 00000100:00100000:1.0:1746142909.927129:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867344640 00000100:00100000:1.0:1746142909.927177:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14157 00000100:00100000:1.0:1746142909.927185:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867344640:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.927200:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.927214:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067cccd34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5f5 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142909.927260:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867801984:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142909.927333:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142909.928308:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.928483:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867344512 00000100:00100000:3.0:1746142909.928488:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867344512 00000100:00100000:3.0:1746142909.928509:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14158 00000100:00100000:3.0:1746142909.928514:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867344512:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.928525:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.928535:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067cccd3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5ee expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142909.928562:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802112:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142909.929085:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142909.931120:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867801984:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142909.931147:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067cccd34 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5f5 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.931159:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6c00/0x2fa243e067cccd34 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5f5 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142909.931184:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e6c00, rc 0) 00000100:00100000:1.0:1746142909.931220:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867344640:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4035us (5184us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142909.931227:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14157 00000100:00100000:3.0:1746142909.931313:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802112:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142909.931328:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067cccd3b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5ee expref: 33 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.931337:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067cccd3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5ee expref: 33 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142909.931348:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106400, rc 0) 00000100:00100000:3.0:1746142909.931365:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867344512:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2851us (3060us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142909.931370:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14158 00000100:00100000:0.0:1746142909.934520:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.935508:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867344768 00000100:00100000:3.0:1746142909.935516:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867344768 00000100:00100000:3.0:1746142909.935592:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14159 00000100:00100000:3.0:1746142909.935602:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32358:x1830962867344768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.935627:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.935654:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a5fc expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.935683:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.935685:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142909.935699:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.935715:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.935732:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106000, rc 0) 00000100:00100000:3.0:1746142909.935809:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32358:x1830962867344768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 204us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.935815:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14159 00000100:00100000:0.0:1746142909.940608:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.940689:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867345024 00000100:00100000:3.0:1746142909.940699:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867345024 00002000:00100000:3.0:1746142909.940732:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880097430000 x1830962867345024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.940741:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430000 with x1830962867345024 ext(2097152->3145727) 00002000:00010000:3.0:1746142909.940745:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430000 00000100:00100000:3.0:1746142909.940773:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4339 00000100:00100000:3.0:1746142909.940787:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867345024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.953387:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867345024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12590us (12770us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142909.953398:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4339 00002000:00100000:3.0:1746142909.953409:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880097430000 x1830962867345024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.953419:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430000 with x1830962867345024 ext(2097152->3145727) 00002000:00010000:3.0:1746142909.953423:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430000 00000100:00100000:0.0:1746142909.961689:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142909.961785:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867345152 00000100:00100000:1.0:1746142909.961793:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867345152 00000100:00100000:1.0:1746142909.961844:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14160 00000100:00100000:1.0:1746142909.961851:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32358:x1830962867345152:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142909.961869:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142909.961883:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a603 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.961933:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.961934:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142909.961940:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 36 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.961960:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 36 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142909.961969:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e6200, rc 0) 00000100:00100000:1.0:1746142909.962012:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32358:x1830962867345152:12345-192.168.204.50@tcp:101:cat.0 Request processed in 161us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142909.962017:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14160 00000100:00100000:0.0:1746142909.966719:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.966779:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867345408 00000100:00100000:3.0:1746142909.966787:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867345408 00002000:00100000:3.0:1746142909.966821:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880097430e00 x1830962867345408/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.966829:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430e00 with x1830962867345408 ext(2097152->3145727) 00002000:00010000:3.0:1746142909.966833:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097430e00 00000100:00100000:3.0:1746142909.966865:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4340 00000100:00100000:3.0:1746142909.966871:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867345408:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142909.974980:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867345408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8101us (8260us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142909.974991:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4340 00002000:00100000:3.0:1746142909.975001:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880097430e00 x1830962867345408/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.975010:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430e00 with x1830962867345408 ext(2097152->3145727) 00002000:00010000:3.0:1746142909.975015:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097430e00 00000100:00100000:0.0:1746142909.981717:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.982076:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867345536 00000100:00100000:3.0:1746142909.982084:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867345536 00000100:00100000:3.0:1746142909.982131:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14161 00000100:00100000:3.0:1746142909.982139:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32358:x1830962867345536:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142909.982154:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142909.982167:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a60a expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.982192:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.982204:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.982205:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142909.982208:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.982233:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.982244:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 14 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:3.0:1746142909.982254:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802240:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142909.982338:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142909.983450:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802240:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142909.983465:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142909.983475:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107800, rc 0) 00000100:00100000:3.0:1746142909.983497:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32358:x1830962867345536:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1359us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142909.983503:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14161 00000100:00100000:0.0:1746142909.984851:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.984927:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867345664 00000100:00100000:3.0:1746142909.984932:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867345664 00002000:00100000:3.0:1746142909.984959:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4120576->4194303) req@ffff880097433800 x1830962867345664/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.984974:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433800 with x1830962867345664 ext(4120576->4194303) 00010000:00010000:3.0:1746142909.984980:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.984990:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 15 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.984996:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097433800 00000100:00100000:3.0:1746142909.985021:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1346 00000100:00100000:3.0:1746142909.985028:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867345664:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142909.987311:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867345664:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2278us (2456us total) trans 21474841182 rc 0/0 00000100:00100000:3.0:1746142909.987321:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1346 00002000:00100000:3.0:1746142909.987328:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4120576->4194303) req@ffff880097433800 x1830962867345664/t21474841182(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:60/0 lens 488/448 e 0 to 0 dl 1746142920 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.987411:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433800 with x1830962867345664 ext(4120576->4194303) 00010000:00010000:3.0:1746142909.987419:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 17 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:3.0:1746142909.987431:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 17 pid: 1854 timeout: 783 lvb_type: 0 00002000:00010000:3.0:1746142909.987436:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097433800 00000100:00100000:0.0:1746142909.989989:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142909.990141:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867345792 00000100:00100000:2.0:1746142909.990152:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867345792 00010000:00010000:2.0:1746142909.990183:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 17 pid: 1854 timeout: 783 lvb_type: 0 00000100:00100000:2.0:1746142909.990223:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6359 00000100:00100000:2.0:1746142909.990229:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867345792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142909.990240:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142909.990256:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 17 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.990266:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 17 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.990286:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccc15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 4120576->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a538 expref: 17 pid: 1854 timeout: 783 lvb_type: 0 00010000:00010000:2.0:1746142909.990329:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.990331:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142909.990337:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.990344:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142909.990373:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142909.990396:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867802368:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142909.990509:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142909.992659:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867802368:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142909.992676:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142909.992715:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867345792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2486us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142909.992724:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6359 00000100:00100000:0.0:1746142909.994102:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142909.994245:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346048 00000100:00100000:3.0:1746142909.994252:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346048 00002000:00100000:3.0:1746142909.994284:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880097430380 x1830962867346048/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/0 e 0 to 0 dl 1746142920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142909.994293:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430380 with x1830962867346048 ext(3145728->4194303) 00002000:00010000:3.0:1746142909.994296:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430380 00000100:00100000:3.0:1746142909.994325:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4341 00000100:00100000:3.0:1746142909.994332:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867346048:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.000986:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867346048:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6640us (6873us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142910.000997:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4341 00002000:00100000:3.0:1746142910.001006:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880097430380 x1830962867346048/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:60/0 lens 488/440 e 0 to 0 dl 1746142920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.001018:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430380 with x1830962867346048 ext(3145728->4194303) 00002000:00010000:3.0:1746142910.001022:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430380 00000100:00100000:0.0:1746142910.004553:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.004646:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346176 00000100:00100000:3.0:1746142910.004653:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346176 00000100:00100000:3.0:1746142910.004742:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14162 00000100:00100000:3.0:1746142910.004749:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32358:x1830962867346176:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.004765:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.004789:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a611 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.004975:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.004987:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.004988:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.004991:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.005017:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.005026:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 16 pid: 9580 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.005037:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867802496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.005250:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.008131:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.008269:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867802496:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.008290:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.008304:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106400, rc 0) 00000100:00100000:3.0:1746142910.008334:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32358:x1830962867346176:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3586us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.008341:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14162 00000100:00100000:2.0:1746142910.008416:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346304 00000100:00100000:2.0:1746142910.008422:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346304 00002000:00100000:2.0:1746142910.008449:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3551231) req@ffff880097431880 x1830962867346304/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.008456:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431880 with x1830962867346304 ext(3145728->3551231) 00010000:00010000:2.0:1746142910.008462:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 17 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.008471:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 17 pid: 9580 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.008476:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097431880 00000100:00100000:2.0:1746142910.008828:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1347 00000100:00100000:2.0:1746142910.008835:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867346304:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142910.016922:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867346304:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8059us (8769us total) trans 17179873923 rc 0/0 00000100:00100000:2.0:1746142910.016933:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1347 00002000:00100000:2.0:1746142910.016943:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3551231) req@ffff880097431880 x1830962867346304/t17179873923(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.016952:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431880 with x1830962867346304 ext(3145728->3551231) 00010000:00010000:2.0:1746142910.016960:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 19 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.016973:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 19 pid: 9580 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.016979:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097431880 00000100:00100000:0.0:1746142910.019813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.019922:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346432 00000100:00100000:2.0:1746142910.019929:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346432 00010000:00010000:2.0:1746142910.019956:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 19 pid: 9580 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.019991:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6360 00000100:00100000:2.0:1746142910.019998:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867346432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.020008:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.020026:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 19 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.020035:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 19 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.020054:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2e00/0x2fa243e067cccc31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3551231) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a554 expref: 19 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.020425:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.020427:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.020539:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.020548:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.020576:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.020587:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867802624:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.020685:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.025351:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.025456:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867802624:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.025474:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.025509:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867346432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5511us (5701us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.025518:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6360 00000100:00100000:3.0:1746142910.025598:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346560 00000100:00100000:3.0:1746142910.025604:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346560 00000100:00100000:3.0:1746142910.025777:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14163 00000100:00100000:3.0:1746142910.025785:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32352:x1830962867346560:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142910.025808:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.025825:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a618 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.025849:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.025861:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 7 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.025868:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.025873:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.025875:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.025878:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 35 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.025929:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 35 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.025939:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 35 pid: 11421 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746142910.025953:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802752:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.026010:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 7 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.026025:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 7 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746142910.026032:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802880:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.027294:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 15 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.027309:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 15 pid: 1854 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.027318:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803008:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.027859:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.028119:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.028176:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802752:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.028552:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346816 00000100:00100000:2.0:1746142910.028557:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346816 00002000:00100000:2.0:1746142910.028586:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880097431500 x1830962867346816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.028596:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431500 with x1830962867346816 ext(3145728->4194303) 00002000:00010000:2.0:1746142910.028599:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097431500 00000100:00100000:0.0:1746142910.028877:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.028924:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.028995:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4342 00000100:00100000:1.0:1746142910.029003:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867346816:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142910.029622:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867802880:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.030044:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867346944 00000100:00100000:2.0:1746142910.030048:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867346944 00010000:00010000:2.0:1746142910.030068:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 8 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.030088:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867347072 00000100:00100000:2.0:1746142910.030091:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867347072 00010000:00010000:2.0:1746142910.030100:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 36 pid: 11421 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.030114:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6361 00000100:00100000:2.0:1746142910.030119:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867346944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.030126:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.030141:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 8 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.030149:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 8 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.030169:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0800/0x2fa243e067cccc5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a570 expref: 8 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.030186:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.030206:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867346944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.030212:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6361 00000100:00100000:2.0:1746142910.030223:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6362 00000100:00100000:2.0:1746142910.030228:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867347072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.030234:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.030241:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 36 pid: 11421 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.030253:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 36 pid: 11421 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.030263:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800987fe600/0x2fa243e067cccbcf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4eb expref: 36 pid: 11421 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.030272:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.030286:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867347072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 58us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.030290:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6362 00000100:00100000:2.0:1746142910.030325:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803008:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.030347:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1957888->2097151] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.030356:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106e00, rc 0) 00000100:00100000:2.0:1746142910.030385:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32352:x1830962867346560:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4592us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.030391:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14163 00000100:00100000:0.0:1746142910.034476:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.034571:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867347200 00000100:00100000:3.0:1746142910.034582:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867347200 00010000:00010000:3.0:1746142910.034615:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 16 pid: 1854 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.034645:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6363 00000100:00100000:3.0:1746142910.034652:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867347200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.034662:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.034683:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 16 pid: 1854 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.034693:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 16 pid: 1854 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.034719:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a0e00/0x2fa243e067cccb7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4d6 expref: 16 pid: 1854 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.034752:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.034754:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.034765:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.034773:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.034802:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.034813:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867803136:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142910.034879:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.037095:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867346816:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 8082us (8967us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142910.037103:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4342 00002000:00100000:1.0:1746142910.037113:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880097431500 x1830962867346816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.037126:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431500 with x1830962867346816 ext(3145728->4194303) 00002000:00010000:1.0:1746142910.037130:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097431500 00000100:00100000:0.0:1746142910.039877:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.042112:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867803136:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.042129:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.042176:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867347200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7524us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.042185:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6363 00000100:00100000:1.0:1746142910.042265:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867347456 00000100:00100000:1.0:1746142910.042271:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867347456 00002000:00100000:1.0:1746142910.042300:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1957888->1961983) req@ffff880097348e00 x1830962867347456/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.042309:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348e00 with x1830962867347456 ext(1957888->1961983) 00002000:00010000:1.0:1746142910.042313:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097348e00 00000100:00100000:1.0:1746142910.042340:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4343 00000100:00100000:1.0:1746142910.042347:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867347456:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142910.042463:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867347456:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 115us (2591us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142910.042468:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4343 00002000:00100000:1.0:1746142910.042473:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1957888->1961983) req@ffff880097348e00 x1830962867347456/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.042479:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348e00 with x1830962867347456 ext(1957888->1961983) 00002000:00010000:1.0:1746142910.042482:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097348e00 00000100:00100000:0.0:1746142910.043061:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.043384:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867347712 00000100:00100000:1.0:1746142910.043388:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867347712 00002000:00100000:1.0:1746142910.043403:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009734b480 x1830962867347712/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.043410:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734b480 with x1830962867347712 ext(4194304->5033983) 00002000:00010000:1.0:1746142910.043413:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734b480 00000100:00100000:1.0:1746142910.043436:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4344 00000100:00100000:1.0:1746142910.043441:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867347712:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142910.049481:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.049574:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867347840 00000100:00100000:2.0:1746142910.049582:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867347840 00000100:00100000:2.0:1746142910.049636:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14164 00000100:00100000:2.0:1746142910.049643:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32352:x1830962867347840:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.049662:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.049684:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a61f expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049713:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049720:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049725:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049730:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142910.049732:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142910.049739:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->2961407] (req 2097152->2961407) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049774:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049784:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.049802:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803264:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.049888:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049918:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 14 pid: 1854 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.049934:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803392:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.049966:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.049973:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.049979:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803520:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.049991:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.051223:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867347712:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7763us (8144us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142910.051233:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4344 00002000:00100000:1.0:1746142910.051241:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009734b480 x1830962867347712/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 839680/839680 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.051250:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734b480 with x1830962867347712 ext(4194304->5033983) 00010000:00010000:1.0:1746142910.051256:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.051266:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746142910.051272:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734b480 00000100:00100000:1.0:1746142910.052966:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.053073:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803264:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.053082:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803392:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.053088:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867803520:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.053118:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->2961407] (req 2097152->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 35 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.053135:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6600, rc 0) 00000100:00100000:3.0:1746142910.053354:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867347968 00000100:00100000:3.0:1746142910.053360:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867347968 00010000:00010000:3.0:1746142910.053395:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.053426:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6364 00000100:00100000:3.0:1746142910.053432:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867347968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.053441:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.053461:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.053469:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.053491:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106000/0x2fa243e067cccd42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5fc expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.053513:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.053765:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32352:x1830962867347840:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4121us (4295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.053777:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14164 00000100:00100000:3.0:1746142910.054325:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867347968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 892us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.054331:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6364 00000100:00100000:0.0:1746142910.054506:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.054731:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348096 00000100:00100000:3.0:1746142910.054735:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348096 00010000:00010000:3.0:1746142910.054748:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 15 pid: 1854 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.054789:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6365 00000100:00100000:3.0:1746142910.054795:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867348096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.054804:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.054813:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 15 pid: 1854 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.054822:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 15 pid: 1854 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.054834:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107600/0x2fa243e067cccc2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a54d expref: 15 pid: 1854 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.054844:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.054862:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867348096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.054867:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6365 00000100:00100000:0.0:1746142910.055169:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.055351:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348224 00000100:00100000:3.0:1746142910.055354:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348224 00000100:00100000:3.0:1746142910.055390:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14165 00000100:00100000:3.0:1746142910.055396:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867348224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.055407:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.055415:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a626 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.055429:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.055435:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd6c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a626 expref: 35 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.055443:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a626 expref: 35 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.055450:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337a000, rc 0) 00000100:00100000:3.0:1746142910.055468:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867348224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (300us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.055473:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14165 00000100:00100000:0.0:1746142910.059099:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.059171:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348352 00000100:00100000:2.0:1746142910.059179:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348352 00010000:00010000:2.0:1746142910.059207:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.059320:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6366 00000100:00100000:2.0:1746142910.059328:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867348352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.059343:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.059360:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.059370:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.059405:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067cccd50 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a60a expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.059610:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.059612:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.059619:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.059626:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.059654:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.059664:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867803648:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.059996:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.060454:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.060583:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348480 00000100:00100000:1.0:1746142910.060588:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348480 00000100:00100000:1.0:1746142910.060622:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14166 00000100:00100000:1.0:1746142910.060629:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32358:x1830962867348480:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.060640:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.060650:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a62d expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.060666:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 35 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.060675:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142910.060676:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142910.060679:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.060696:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 35 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.060705:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 35 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.060717:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867803776:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.060745:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.062828:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867803776:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.062850:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.062862:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8e600, rc 0) 00000100:00100000:1.0:1746142910.062920:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32358:x1830962867348480:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2291us (2466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.062928:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14166 00000100:00100000:3.0:1746142910.063366:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867803648:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.063391:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.063424:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867348352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4096us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.063432:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6366 00000100:00100000:0.0:1746142910.064478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.064544:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348736 00000100:00100000:2.0:1746142910.064550:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348736 00000100:00100000:2.0:1746142910.064592:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14424 00000100:00100000:2.0:1746142910.064599:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:32360:x1830962867348736:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.064617:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.064631:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x2fa243e067cccd7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a634 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.064715:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.064727:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 17 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.064734:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 50 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.064740:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.064763:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 50 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.064772:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 50 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.064781:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867803904:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.064848:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 17 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.064860:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 17 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.064867:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867804032:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.064886:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18780 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.068086:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867803904:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.068097:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867804032:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.068118:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142910.069124:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.069227:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348864 00000100:00100000:3.0:1746142910.069235:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348864 00010000:00010000:3.0:1746142910.069261:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 51 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.069296:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6367 00000100:00100000:3.0:1746142910.069304:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2006:x1830962867348864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.069315:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.069321:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 51 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.069329:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 51 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.069349:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cccd18 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a5d9 expref: 51 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.069387:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.069391:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.069398:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.069402:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.069434:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867348864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.069440:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6367 00000100:00100000:0.0:1746142910.069714:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.069752:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867348992 00000100:00100000:3.0:1746142910.069755:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867348992 00010000:00010000:3.0:1746142910.069775:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 18 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.069788:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6368 00000100:00100000:3.0:1746142910.069797:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+18:2006:x1830962867348992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.069803:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.069806:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 18 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.069813:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 18 pid: 7232 timeout: 784 lvb_type: 0 00000100:00080000:2.0:1746142910.069820:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746142910.069824:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cccc93 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a58c expref: 18 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.069835:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.069837:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.069844:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.069849:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.069875:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.069892:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867348992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.069897:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6368 00010000:00010000:2.0:1746142910.070014:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.070021:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142910.070037:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142910.070136:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097107800/0x2fa243e067cccd7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.070515:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.070522:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.070525:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142910.070526:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106600, rc 0) 00000100:00100000:2.0:1746142910.071015:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:32360:x1830962867348736:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6302us (6424us total) trans 8589936582 rc 0/0 00000100:00100000:2.0:1746142910.071021:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14424 00000100:00100000:0.0:1746142910.071484:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.071684:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867349248 00000100:00100000:1.0:1746142910.071690:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867349248 00002000:00100000:1.0:1746142910.071717:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2957312->2961407) req@ffff880088fdb100 x1830962867349248/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.071726:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb100 with x1830962867349248 ext(2957312->2961407) 00010000:00010000:1.0:1746142910.071733:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.071743:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746142910.071749:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fdb100 00000100:00100000:1.0:1746142910.071772:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1348 00000100:00100000:1.0:1746142910.071778:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867349248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142910.071884:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867349248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 106us (399us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142910.071890:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1348 00002000:00100000:1.0:1746142910.071895:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2957312->2961407) req@ffff880088fdb100 x1830962867349248/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.071917:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb100 with x1830962867349248 ext(2957312->2961407) 00010000:00010000:1.0:1746142910.071921:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.071930:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746142910.071935:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fdb100 00000100:00100000:1.0:1746142910.078713:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.078840:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867349504 00000100:00100000:2.0:1746142910.078849:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867349504 00002000:00100000:2.0:1746142910.078883:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2961407) req@ffff880096af2300 x1830962867349504/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.078893:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2300 with x1830962867349504 ext(2097152->2961407) 00010000:00010000:2.0:1746142910.078922:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.078935:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.078942:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096af2300 00000100:00100000:2.0:1746142910.078968:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1349 00000100:00100000:2.0:1746142910.078975:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867349504:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142910.080087:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.080296:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867349760 00000100:00100000:2.0:1746142910.080306:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867349760 00000100:00100000:2.0:1746142910.080343:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5253 00000100:00100000:2.0:1746142910.080348:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32352:x1830962867349760:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142910.080588:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32352:x1830962867349760:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 238us (501us total) trans 8589936583 rc 0/0 00000100:00100000:2.0:1746142910.080594:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5253 00000100:00100000:2.0:1746142910.093232:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867349504:12345-192.168.204.50@tcp:4:cat.0 Request processed in 14247us (14517us total) trans 21474841183 rc 0/0 00000100:00100000:2.0:1746142910.093245:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1349 00002000:00100000:2.0:1746142910.093256:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2961407) req@ffff880096af2300 x1830962867349504/t21474841183(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.093265:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2300 with x1830962867349504 ext(2097152->2961407) 00010000:00010000:2.0:1746142910.093274:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.093288:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.093295:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096af2300 00000100:00100000:0.0:1746142910.097505:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.097572:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867349888 00000100:00100000:3.0:1746142910.097585:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867349888 00010000:00010000:3.0:1746142910.097618:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.097659:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6369 00000100:00100000:3.0:1746142910.097672:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867349888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.097682:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.097704:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.097715:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.097750:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c6600/0x2fa243e067cccd65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2961407) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a61f expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.097781:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.097783:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.097789:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.097796:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.097828:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.097845:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867804160:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142910.097954:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.099714:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867804160:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.099729:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.099766:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867349888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2094us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.099774:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6369 00000100:00100000:0.0:1746142910.100419:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.100548:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867350144 00000100:00100000:2.0:1746142910.100554:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867350144 00002000:00100000:2.0:1746142910.100587:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff880088fd8e00 x1830962867350144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.100596:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8e00 with x1830962867350144 ext(5029888->5033983) 00002000:00010000:2.0:1746142910.100600:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd8e00 00000100:00100000:2.0:1746142910.100625:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4345 00000100:00100000:2.0:1746142910.100632:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867350144:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.100731:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867350144:12345-192.168.204.50@tcp:3:cat.0 Request processed in 100us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142910.100737:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4345 00002000:00100000:2.0:1746142910.100741:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5033983) req@ffff880088fd8e00 x1830962867350144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.100753:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8e00 with x1830962867350144 ext(5029888->5033983) 00002000:00010000:2.0:1746142910.100756:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd8e00 00000100:00100000:0.0:1746142910.104210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.104253:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.104260:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867350400 00000100:00100000:2.0:1746142910.104276:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867350400 00000100:00100000:1.0:1746142910.104318:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867350528 00000100:00100000:1.0:1746142910.104321:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867350528 00000100:00100000:1.0:1746142910.104361:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14167 00000100:00100000:1.0:1746142910.104368:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:32360:x1830962867350528:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142910.104392:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.104405:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a63b expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.104430:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 36 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.104442:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.104449:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.104455:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.104457:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.104459:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1609728->2007039] (req 1609728->2007039) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 19 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.104483:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.104494:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.104504:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867804288:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.104577:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.104584:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 10 pid: 9580 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.104592:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867804416:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.104616:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 36 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.104624:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 36 pid: 9580 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.104631:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867804544:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.104650:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.104703:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5254 00000100:00100000:2.0:1746142910.104709:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32358:x1830962867350400:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142910.104846:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32358:x1830962867350400:12345-192.168.204.50@tcp:35:cat.0 Request processed in 137us (643us total) trans 8589936584 rc 0/0 00000100:00100000:2.0:1746142910.104853:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5254 00000100:00100000:1.0:1746142910.107269:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867804288:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.107279:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867804416:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.107286:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867804544:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.107309:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1609728->2007039] (req 1609728->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 19 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.107320:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8fe00, rc 0) 00000100:00100000:1.0:1746142910.107345:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:32360:x1830962867350528:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2978us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.107351:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14167 00010000:00010000:3.0:1746142910.108105:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142910.108835:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.108993:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867350656 00000100:00100000:3.0:1746142910.109000:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867350656 00010000:00010000:3.0:1746142910.109021:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 11 pid: 9580 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746142910.109048:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6370 00000100:00100000:3.0:1746142910.109055:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867350656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.109065:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.109080:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 11 pid: 9580 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.109088:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 11 pid: 9580 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.109104:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067cccc62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a569 expref: 11 pid: 9580 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.109116:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.109139:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867350656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.109144:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6370 00000100:00100000:0.0:1746142910.109727:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.109747:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867350784 00000100:00100000:2.0:1746142910.109751:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867350784 00010000:00010000:2.0:1746142910.109766:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 37 pid: 9580 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.109795:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6371 00000100:00100000:2.0:1746142910.109801:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867350784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.109808:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.109816:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 37 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.109823:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 37 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.109833:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf15a00/0x2fa243e067cccbd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a4f9 expref: 37 pid: 9580 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.109845:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.109875:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867350784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.109880:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6371 00000100:00100000:0.0:1746142910.112814:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.112890:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867350912 00000100:00100000:3.0:1746142910.112916:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867350912 00010000:00010000:3.0:1746142910.113105:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746142910.113174:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6372 00000100:00100000:3.0:1746142910.113180:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867350912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.113191:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.115044:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.115059:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.115080:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098445200/0x2fa243e067cccbe4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a507 expref: 19 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.115093:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.115095:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.115101:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.115108:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.115140:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.115151:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867804672:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142910.115242:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.119580:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867804672:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.119596:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.119631:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867350912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6451us (6827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.119640:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6372 00000100:00100000:0.0:1746142910.124160:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.124219:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867351168 00000100:00100000:2.0:1746142910.124226:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867351168 00002000:00100000:2.0:1746142910.124263:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1609728->1613823) req@ffff88009ceb0000 x1830962867351168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.124273:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0000 with x1830962867351168 ext(1609728->1613823) 00002000:00010000:2.0:1746142910.124277:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb0000 00000100:00100000:2.0:1746142910.124300:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4346 00000100:00100000:2.0:1746142910.124307:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867351168:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142910.124416:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867351168:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 109us (262us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142910.124421:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4346 00002000:00100000:2.0:1746142910.124426:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1609728->1613823) req@ffff88009ceb0000 x1830962867351168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.124433:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0000 with x1830962867351168 ext(1609728->1613823) 00002000:00010000:2.0:1746142910.124435:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb0000 00000100:00100000:0.0:1746142910.130728:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.131088:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867351424 00000100:00100000:1.0:1746142910.131095:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867351424 00002000:00100000:1.0:1746142910.131126:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (2002944->2007039) req@ffff88009ceb3480 x1830962867351424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.131135:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb3480 with x1830962867351424 ext(2002944->2007039) 00002000:00010000:1.0:1746142910.131139:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb3480 00000100:00100000:1.0:1746142910.131165:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4347 00000100:00100000:1.0:1746142910.131171:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867351424:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142910.131273:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867351424:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 102us (553us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142910.131279:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4347 00002000:00100000:1.0:1746142910.131284:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (2002944->2007039) req@ffff88009ceb3480 x1830962867351424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.131291:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb3480 with x1830962867351424 ext(2002944->2007039) 00002000:00010000:1.0:1746142910.131294:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb3480 00000100:00100000:0.0:1746142910.135776:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.136251:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867351552 00000100:00100000:1.0:1746142910.136258:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867351552 00000100:00100000:1.0:1746142910.136308:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14168 00000100:00100000:1.0:1746142910.136315:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962867351552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.136329:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.136343:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cccd96 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a642 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142910.136399:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867804800:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142910.136469:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.136748:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.136919:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867351680 00000100:00100000:3.0:1746142910.136923:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867351680 00000100:00100000:3.0:1746142910.136941:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14169 00000100:00100000:3.0:1746142910.136946:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+16:2003:x1830962867351680:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.136956:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.136963:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a649 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.136975:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.136977:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.136984:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.136997:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.137005:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337a000, rc 0) 00000100:00100000:3.0:1746142910.137029:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867351680:12345-192.168.204.50@tcp:101:cat.0 Request processed in 83us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.137035:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14169 00000100:00100000:3.0:1746142910.137078:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.137532:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867351808 00000100:00100000:0.0:1746142910.137535:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867351808 00000100:00100000:3.0:1746142910.138059:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14170 00000100:00100000:3.0:1746142910.138064:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867351808:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.138072:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.138080:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a650 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.138091:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.138093:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.138097:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 19 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.138106:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 19 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.138112:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337b000, rc 0) 00000100:00100000:3.0:1746142910.138141:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867351808:12345-192.168.204.50@tcp:101:cat.0 Request processed in 76us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.138146:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14170 00002000:00010000:1.0:1746142910.139261:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746142909 -> 1746142910 00002000:00010000:1.0:1746142910.139265:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142909 -> 1746142910 00002000:00010000:1.0:1746142910.139267:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746142909 -> 1746142910 00000100:00100000:1.0:1746142910.139281:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867804800:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142910.139302:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cccd96 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a642 expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.139315:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cccd96 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a642 expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.139327:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8f200, rc 0) 00000100:00100000:1.0:1746142910.139359:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867351552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3044us (3590us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142910.139364:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14168 00000100:00100000:0.0:1746142910.144495:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.144563:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867352064 00000100:00100000:2.0:1746142910.144570:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867352064 00002000:00100000:2.0:1746142910.144754:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009ceb2a00 x1830962867352064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 504/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.144770:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb2a00 with x1830962867352064 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.144774:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb2a00 00000100:00100000:2.0:1746142910.144803:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4348 00000100:00100000:2.0:1746142910.144811:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867352064:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142910.152535:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867352064:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7717us (8039us total) trans 0 rc 651264/651264 00000100:00100000:1.0:1746142910.152545:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4348 00002000:00100000:1.0:1746142910.152556:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009ceb2a00 x1830962867352064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 504/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.152565:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb2a00 with x1830962867352064 ext(1048576->2097151) 00002000:00010000:1.0:1746142910.152570:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb2a00 00000100:00100000:0.0:1746142910.159505:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.159589:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867352192 00000100:00100000:1.0:1746142910.159596:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867352192 00000100:00100000:1.0:1746142910.159826:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14171 00000100:00100000:1.0:1746142910.159834:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:32365:x1830962867352192:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.159850:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.159863:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a657 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.160002:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.160015:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142910.160017:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142910.160021:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.160045:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.160057:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 34 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.160067:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867804928:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.160428:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.162220:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.162285:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867352320 00000100:00100000:1.0:1746142910.162287:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867804928:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.162290:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867352320 00010000:00010000:1.0:1746142910.162310:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.162322:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8e000, rc 0) 00000100:00100000:1.0:1746142910.162353:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:32365:x1830962867352192:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2521us (2856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.162361:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14171 00002000:00100000:2.0:1746142910.162425:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1957888->2097151) req@ffff88009ceb2680 x1830962867352320/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.162433:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb2680 with x1830962867352320 ext(1957888->2097151) 00010000:00010000:2.0:1746142910.162439:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 35 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.162448:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 35 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.162453:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ceb2680 00000100:00100000:2.0:1746142910.162477:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1350 00000100:00100000:2.0:1746142910.162483:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867352320:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142910.168240:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867352320:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5750us (6018us total) trans 21474841184 rc 0/0 00000100:00100000:2.0:1746142910.168251:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1350 00002000:00100000:2.0:1746142910.168261:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1957888->2097151) req@ffff88009ceb2680 x1830962867352320/t21474841184(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.168275:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb2680 with x1830962867352320 ext(1957888->2097151) 00010000:00010000:2.0:1746142910.168283:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.168296:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.168302:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ceb2680 00000100:00100000:0.0:1746142910.173384:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.173448:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867352448 00000100:00100000:3.0:1746142910.173457:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867352448 00010000:00010000:3.0:1746142910.173489:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.173523:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6373 00000100:00100000:3.0:1746142910.173530:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867352448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.173541:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.173560:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.173571:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.173591:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097106e00/0x2fa243e067cccd5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1957888->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a618 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.173624:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.173626:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.173632:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.173639:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.173670:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.173681:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867805056:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142910.173755:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4adb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.175871:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867805056:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.175886:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.175952:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867352448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2421us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.175960:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6373 00000100:00100000:0.0:1746142910.177488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.178387:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867352704 00000100:00100000:2.0:1746142910.178396:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867352704 00002000:00100000:2.0:1746142910.178431:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009ceb0a80 x1830962867352704/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.178439:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0a80 with x1830962867352704 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.178444:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb0a80 00000100:00100000:2.0:1746142910.178472:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4349 00000100:00100000:2.0:1746142910.178479:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867352704:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.186628:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867352704:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8139us (9134us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.186638:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4349 00002000:00100000:2.0:1746142910.186649:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009ceb0a80 x1830962867352704/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.186657:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0a80 with x1830962867352704 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.186662:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ceb0a80 00000100:00100000:0.0:1746142910.201765:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.201816:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.201920:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867353088 00000100:00100000:2.0:1746142910.201932:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867353088 00002000:00100000:2.0:1746142910.201970:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012de13800 x1830962867353088/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.201979:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de13800 with x1830962867353088 ext(2097152->4194303) 00002000:00010000:2.0:1746142910.201983:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de13800 00000100:00100000:2.0:1746142910.202370:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867353216 00000100:00100000:2.0:1746142910.202381:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867353216 00002000:00100000:2.0:1746142910.202398:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88012de12300 x1830962867353216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.202405:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12300 with x1830962867353216 ext(3145728->4194303) 00002000:00010000:2.0:1746142910.202408:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de12300 00000100:00100000:1.0:1746142910.202430:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4350 00000100:00100000:1.0:1746142910.202439:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867353088:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.202988:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4351 00000100:00100000:2.0:1746142910.202994:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867353216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142910.211497:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.212956:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867353472 00000100:00100000:2.0:1746142910.212965:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867353472 00000100:00100000:2.0:1746142910.213026:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14425 00000100:00100000:2.0:1746142910.213033:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32368:x1830962867353472:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.213052:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.213068:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cccdb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a65e expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.213128:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213139:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213147:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213159:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213164:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213168:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213242:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067cccdc7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213250:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067cccdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213256:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067cccdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142910.213263:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142910.213317:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213323:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213327:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213332:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213337:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0cf400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142910.213340:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213346:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213354:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142910.213356:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142910.213359:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213363:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067cccdb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213396:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213400:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213404:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213408:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc2c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142910.213410:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213414:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213420:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880088ce2300) 00010000:00010000:2.0:1746142910.213422:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142910.213424:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213427:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2c00/0x2fa243e067cccdc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.213457:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106000/0x2fa243e067cccdb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a65e expref: 55 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.213467:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067cccdc7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a65e expref: 54 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.213472:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.213474:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746142910.213476:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2e00, rc 0) 00000100:00100000:2.0:1746142910.213517:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32368:x1830962867353472:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 485us (2027us total) trans 8589936585 rc 0/0 00000100:00100000:2.0:1746142910.213523:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14425 00000100:00100000:2.0:1746142910.227940:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867353216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 24937us (26114us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.227951:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4351 00002000:00100000:2.0:1746142910.227962:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88012de12300 x1830962867353216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.227971:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12300 with x1830962867353216 ext(3145728->4194303) 00002000:00010000:2.0:1746142910.227976:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de12300 00000100:00100000:1.0:1746142910.233967:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867353088:12345-192.168.204.50@tcp:3:cat.0 Request processed in 31522us (32202us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142910.233978:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4350 00002000:00100000:1.0:1746142910.233987:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012de13800 x1830962867353088/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.233994:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de13800 with x1830962867353088 ext(2097152->4194303) 00002000:00010000:1.0:1746142910.233999:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de13800 00000100:00100000:0.0:1746142910.234343:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.234390:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.234415:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867353856 00000100:00100000:0.0:1746142910.234421:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867353856 00000100:00100000:0.0:1746142910.234452:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14426 00000100:00100000:0.0:1746142910.234458:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32371:x1830962867353856:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142910.234477:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142910.234491:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2e00/0x2fa243e067cccdd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a665 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.234552:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234562:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234571:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234580:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234585:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234589:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234665:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3a00/0x2fa243e067cccdea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234673:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3a00/0x2fa243e067cccdea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234679:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3a00/0x2fa243e067cccdea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142910.234686:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:0.0:1746142910.234742:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234748:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234752:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234757:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234761:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d3e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142910.234764:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234769:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234777:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142910.234780:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142910.234783:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234790:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3e00/0x2fa243e067cccddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234801:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234805:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234809:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234812:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d2a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142910.234814:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234818:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234822:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736600) 00010000:00010000:0.0:1746142910.234824:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142910.234826:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234829:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067cccde3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.234855:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2e00/0x2fa243e067cccdd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a665 expref: 57 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.234863:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3a00/0x2fa243e067cccdea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a665 expref: 56 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.234872:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142910.234874:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746142910.234876:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3a00, rc 0) 00000100:00100000:3.0:1746142910.234950:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867353600 00000100:00100000:3.0:1746142910.234953:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867353600 00000100:00100000:3.0:1746142910.234979:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 766 00000100:00100000:3.0:1746142910.234984:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2006:x1830962867353600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.234992:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.235001:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2e00/0x2fa243e067cccdc7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a65e expref: 57 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142910.237286:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32371:x1830962867353856:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2818us (2886us total) trans 8589936586 rc 0/0 00000100:00100000:0.0:1746142910.237295:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14426 00010000:00010000:3.0:1746142910.237808:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.237814:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.237851:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2006:x1830962867353600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2866us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.237860:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 766 00000100:00100000:0.0:1746142910.240702:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.241412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.241437:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867353984 00000100:00100000:3.0:1746142910.241445:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867353984 00000100:00100000:3.0:1746142910.241494:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 767 00000100:00100000:3.0:1746142910.241501:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2006:x1830962867353984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.241513:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.241534:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3a00/0x2fa243e067cccdea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a665 expref: 55 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.241547:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.241551:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.241598:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2006:x1830962867353984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.241604:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 767 00000100:00100000:3.0:1746142910.242792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.242860:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867354112 00000100:00100000:2.0:1746142910.242865:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867354112 00000100:00100000:2.0:1746142910.243181:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867354240 00000100:00100000:2.0:1746142910.243184:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867354240 00000100:00100000:2.0:1746142910.243789:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14172 00000100:00100000:2.0:1746142910.243796:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867354112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.243811:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.243823:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067cccdf8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a66c expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.243861:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867805184:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142910.244491:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14173 00000100:00100000:1.0:1746142910.244500:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867354240:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.244508:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.244518:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a673 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.244530:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.244532:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.244538:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.244550:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.244558:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d7000, rc 0) 00000100:00100000:2.0:1746142910.244652:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.244854:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867354240:12345-192.168.204.50@tcp:101:cat.0 Request processed in 354us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.244860:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14173 00000100:00100000:2.0:1746142910.246139:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867805184:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142910.246160:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067cccdf8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a66c expref: 37 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.246171:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067cccdf8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a66c expref: 37 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.246191:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3200, rc 0) 00000100:00100000:2.0:1746142910.246778:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867354112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2980us (5364us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142910.246785:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14172 00000100:00100000:0.0:1746142910.248006:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.248093:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867354496 00000100:00100000:1.0:1746142910.248099:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867354496 00002000:00100000:1.0:1746142910.248131:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800949d0a80 x1830962867354496/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.248139:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0a80 with x1830962867354496 ext(4194304->5033983) 00002000:00010000:1.0:1746142910.248143:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0a80 00000100:00100000:1.0:1746142910.248318:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4352 00000100:00100000:1.0:1746142910.248325:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962867354496:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142910.253444:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962867354496:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5098us (5425us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142910.253456:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4352 00002000:00100000:1.0:1746142910.253466:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff8800949d0a80 x1830962867354496/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.253476:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0a80 with x1830962867354496 ext(4194304->5033983) 00002000:00010000:1.0:1746142910.253482:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0a80 00000100:00100000:0.0:1746142910.253831:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.254016:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867354624 00000100:00100000:2.0:1746142910.254023:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867354624 00000100:00100000:2.0:1746142910.254070:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14174 00000100:00100000:2.0:1746142910.254076:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32371:x1830962867354624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.254090:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.254104:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a67a expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.255983:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.255992:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142910.255994:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142910.255998:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.256027:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.256039:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.256050:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867805312:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.256139:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.258519:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867805312:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.258547:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.258562:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3e00, rc 0) 00000100:00100000:2.0:1746142910.258607:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32371:x1830962867354624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4530us (4781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.258616:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14174 00000100:00100000:0.0:1746142910.259745:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.259808:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867354752 00000100:00100000:1.0:1746142910.259814:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867354752 00002000:00100000:1.0:1746142910.260424:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1609728->2007039) req@ffff8800949d2680 x1830962867354752/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.260434:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d2680 with x1830962867354752 ext(1609728->2007039) 00010000:00010000:1.0:1746142910.260442:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 19 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.260455:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 19 pid: 1397 timeout: 784 lvb_type: 0 00002000:00010000:1.0:1746142910.260461:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d2680 00000100:00100000:1.0:1746142910.260522:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1351 00000100:00100000:1.0:1746142910.260530:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867354752:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142910.267190:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867354752:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6654us (7439us total) trans 17179873924 rc 0/0 00000100:00100000:2.0:1746142910.267202:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1351 00002000:00100000:2.0:1746142910.267211:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1609728->2007039) req@ffff8800949d2680 x1830962867354752/t17179873924(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.267220:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d2680 with x1830962867354752 ext(1609728->2007039) 00010000:00010000:2.0:1746142910.267229:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 21 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.267242:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 21 pid: 1397 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.267248:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d2680 00000100:00100000:0.0:1746142910.274750:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.274809:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867354880 00000100:00100000:3.0:1746142910.274818:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867354880 00010000:00010000:3.0:1746142910.274849:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 21 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.274889:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6374 00000100:00100000:3.0:1746142910.274897:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867354880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.274941:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.274959:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 21 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.274970:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 21 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.274989:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8fe00/0x2fa243e067cccd8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1609728->2007039) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a63b expref: 21 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.275009:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.275011:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.275017:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.275024:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.275049:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.275060:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867805440:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.278036:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.283970:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867805440:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.283989:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.285330:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867354880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10428us (10581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.285341:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6374 00000100:00100000:0.0:1746142910.290853:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.291964:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867355264 00000100:00100000:2.0:1746142910.291974:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867355264 00002000:00100000:2.0:1746142910.292015:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800949d0e00 x1830962867355264/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.292025:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0e00 with x1830962867355264 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.292030:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d0e00 00000100:00100000:2.0:1746142910.292069:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4353 00000100:00100000:2.0:1746142910.292076:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867355264:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142910.293222:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.293263:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867355392 00000100:00100000:3.0:1746142910.293268:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867355392 00002000:00100000:3.0:1746142910.293290:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800949d3100 x1830962867355392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.293298:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3100 with x1830962867355392 ext(1048576->2097151) 00002000:00010000:3.0:1746142910.293302:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d3100 00000100:00100000:3.0:1746142910.293316:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4354 00000100:00100000:3.0:1746142910.293321:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867355392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.309189:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867355264:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17104us (18333us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.309200:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4353 00002000:00100000:2.0:1746142910.309210:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800949d0e00 x1830962867355264/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.309218:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0e00 with x1830962867355264 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.309223:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d0e00 00000100:00100000:3.0:1746142910.314747:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867355392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21416us (21519us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142910.314757:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4354 00002000:00100000:3.0:1746142910.314766:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800949d3100 x1830962867355392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.314775:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3100 with x1830962867355392 ext(1048576->2097151) 00002000:00010000:3.0:1746142910.314779:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d3100 00000100:00100000:0.0:1746142910.314839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.314886:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867355520 00000100:00100000:2.0:1746142910.314893:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867355520 00000100:00100000:2.0:1746142910.314943:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14175 00000100:00100000:2.0:1746142910.314950:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32368:x1830962867355520:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.314964:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.314978:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a681 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.315000:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.315008:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.315009:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.315012:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1560576->2097151] (req 1560576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 38 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.315036:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.315046:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.315061:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867805568:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.315120:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.318555:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867805568:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.318581:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1560576->2097151] (req 1560576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 38 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.318595:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3200, rc 0) 00000100:00100000:2.0:1746142910.318642:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32368:x1830962867355520:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3692us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.318649:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14175 00000100:00100000:0.0:1746142910.320709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.321518:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867355648 00000100:00100000:2.0:1746142910.321526:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867355648 00010000:00010000:2.0:1746142910.321553:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.321578:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6375 00000100:00100000:2.0:1746142910.321584:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867355648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.321595:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.321609:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.321618:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.321639:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067ccce06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a67a expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.321659:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.321661:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.321666:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.321674:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.321700:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.321710:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867805696:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.321776:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.322579:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.323689:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867355904 00000100:00100000:3.0:1746142910.323696:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867355904 00002000:00100000:3.0:1746142910.323729:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012e51bb80 x1830962867355904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.323737:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e51bb80 with x1830962867355904 ext(2097152->4194303) 00002000:00010000:3.0:1746142910.323740:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e51bb80 00000100:00100000:3.0:1746142910.323764:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4355 00000100:00100000:3.0:1746142910.323771:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867355904:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142910.325420:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.325495:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867805696:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.325512:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.326064:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867355648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4478us (5358us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.326072:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6375 00000100:00100000:3.0:1746142910.327779:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867356160 00000100:00100000:3.0:1746142910.327788:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867356160 00002000:00100000:3.0:1746142910.327819:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1560576->1564671) req@ffff88012e51a680 x1830962867356160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.327828:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e51a680 with x1830962867356160 ext(1560576->1564671) 00002000:00010000:3.0:1746142910.327833:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e51a680 00000100:00100000:3.0:1746142910.327866:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4356 00000100:00100000:3.0:1746142910.327872:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867356160:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.327984:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867356160:12345-192.168.204.50@tcp:3:cat.0 Request processed in 111us (2568us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142910.327989:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4356 00002000:00100000:3.0:1746142910.327994:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1560576->1564671) req@ffff88012e51a680 x1830962867356160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.328000:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e51a680 with x1830962867356160 ext(1560576->1564671) 00002000:00010000:3.0:1746142910.328003:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e51a680 00000100:00100000:3.0:1746142910.337341:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867355904:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13563us (14755us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142910.337352:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4355 00002000:00100000:3.0:1746142910.337361:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012e51bb80 x1830962867355904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.337377:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e51bb80 with x1830962867355904 ext(2097152->4194303) 00002000:00010000:3.0:1746142910.337382:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e51bb80 00000100:00100000:0.0:1746142910.357590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.357647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.357932:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867356288 00000100:00100000:2.0:1746142910.357940:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867356288 00000100:00100000:2.0:1746142910.357988:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14176 00000100:00100000:2.0:1746142910.357995:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32368:x1830962867356288:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.358012:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.358026:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a688 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.358050:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.358059:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 38 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.358064:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.358066:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.358069:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.358097:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 38 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.358106:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 38 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.358115:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867805824:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.358189:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.358197:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 15 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.358208:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867805952:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.358225:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.358321:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867356544 00000100:00100000:3.0:1746142910.358325:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867356544 00002000:00100000:3.0:1746142910.358349:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff88012e519500 x1830962867356544/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.358358:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e519500 with x1830962867356544 ext(4194304->5029887) 00002000:00010000:3.0:1746142910.358362:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e519500 00000100:00100000:3.0:1746142910.358384:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4357 00000100:00100000:3.0:1746142910.358389:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867356544:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.364451:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867805824:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142910.365966:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.366788:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867356672 00000100:00100000:2.0:1746142910.366795:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867356672 00010000:00010000:2.0:1746142910.366821:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 41 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.366853:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6376 00000100:00100000:2.0:1746142910.366858:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867356672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.366868:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.366882:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 41 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.366891:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 41 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.366932:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d7000/0x2fa243e067cccdff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a673 expref: 41 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.366953:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.366987:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867356672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 128us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.366993:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6376 00000100:00100000:3.0:1746142910.367919:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867356544:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9528us (10269us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746142910.367926:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4357 00002000:00100000:3.0:1746142910.367933:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff88012e519500 x1830962867356544/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.367941:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e519500 with x1830962867356544 ext(4194304->5029887) 00002000:00010000:3.0:1746142910.367945:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e519500 00000100:00100000:0.0:1746142910.370232:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.370807:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.370846:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867356800 00000100:00100000:1.0:1746142910.370853:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867356800 00000100:00100000:1.0:1746142910.370918:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14177 00000100:00100000:1.0:1746142910.370925:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:32374:x1830962867356800:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142910.370941:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.370954:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a68f expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.370978:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 6 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.370985:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.370992:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 37 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.370997:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.370999:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.371001:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [499712->598015] (req 499712->598015) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 17 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.371025:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 37 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.371039:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 37 pid: 9579 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.371050:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867806080:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.371117:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.371125:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 17 pid: 1397 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.371132:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867806208:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.371153:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 6 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.371161:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 6 pid: 1853 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.371169:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867806336:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.371181:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.371329:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867805952:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.371350:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1224703] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 37 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.371360:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2a00, rc 0) 00000100:00100000:2.0:1746142910.371392:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32368:x1830962867356288:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 13397us (13810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.371398:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14176 00000100:00100000:1.0:1746142910.372031:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867356928 00000100:00100000:1.0:1746142910.372035:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867356928 00010000:00010000:1.0:1746142910.372050:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.372124:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6377 00000100:00100000:1.0:1746142910.372130:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867356928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142910.372138:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142910.372152:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.372161:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.372175:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e000/0x2fa243e067cccdab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a657 expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.372626:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.372628:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.372634:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.372641:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.372661:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142910.372670:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867806464:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142910.372976:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.375571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.375650:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867357056 00000100:00100000:3.0:1746142910.375658:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867357056 00000100:00100000:3.0:1746142910.375689:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14178 00000100:00100000:3.0:1746142910.375694:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867357056:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.375707:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.375719:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009337a800/0x2fa243e067ccce22 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a696 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.375757:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867806592:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142910.376194:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.377604:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867806464:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.377619:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.377653:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867356928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5522us (6847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.377661:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6377 00000100:00100000:0.0:1746142910.377718:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867806080:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142910.377726:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867806208:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142910.377734:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867806336:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142910.377750:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [499712->598015] (req 499712->598015) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.377763:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f200, rc 0) 00000100:00100000:0.0:1746142910.377779:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:32374:x1830962867356800:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6855us (7554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142910.377784:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14177 00000100:00100000:0.0:1746142910.379409:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.379435:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.379465:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.379518:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867357184 00000100:00100000:3.0:1746142910.379525:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867357184 00000100:00100000:2.0:1746142910.379527:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867357312 00000100:00100000:2.0:1746142910.379530:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867357312 00010000:00010000:3.0:1746142910.379550:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 16 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.379550:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 7 pid: 1853 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.379568:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6378 00000100:00100000:2.0:1746142910.379573:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867357312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142910.379584:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6379 00000100:00100000:3.0:1746142910.379590:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867357184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.379594:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.379598:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.379608:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 7 pid: 1853 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.379610:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 16 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.379617:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 7 pid: 1853 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.379629:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 16 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.379646:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880e00/0x2fa243e067ccc77d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a267 expref: 16 pid: 1397 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.379664:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.379702:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867357184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.379708:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6379 00010000:00010000:2.0:1746142910.379714:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d600/0x2fa243e067ccc626 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a1c6 expref: 7 pid: 1853 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.379731:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.379754:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+6:2006:x1830962867357312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 181us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.379759:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6378 00000100:00100000:3.0:1746142910.379766:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867357568 00000100:00100000:3.0:1746142910.379770:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867357568 00002000:00100000:3.0:1746142910.379791:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1220608->1224703) req@ffff88009a28c000 x1830962867357568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.379799:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c000 with x1830962867357568 ext(1220608->1224703) 00002000:00010000:3.0:1746142910.379803:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28c000 00000100:00100000:3.0:1746142910.379814:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4358 00000100:00100000:3.0:1746142910.379819:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867357568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.379921:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867357568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 101us (454us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142910.379926:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4358 00002000:00100000:3.0:1746142910.379931:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1220608->1224703) req@ffff88009a28c000 x1830962867357568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.379942:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c000 with x1830962867357568 ext(1220608->1224703) 00002000:00010000:3.0:1746142910.379945:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28c000 00000100:00100000:1.0:1746142910.380680:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.380799:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867357696 00000100:00100000:0.0:1746142910.380803:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867357696 00010000:00010000:0.0:1746142910.380817:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 39 pid: 9579 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746142910.381016:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6380 00000100:00100000:0.0:1746142910.381023:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867357696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142910.381031:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142910.381041:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 39 pid: 9579 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746142910.381050:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 39 pid: 9579 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746142910.381062:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714400/0x2fa243e067ccc6c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a205 expref: 39 pid: 9579 timeout: 784 lvb_type: 1 00010000:00010000:0.0:1746142910.381087:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142910.381089:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142910.381095:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 14 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.381101:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 14 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.381126:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 14 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142910.381136:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867806720:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142910.381191:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.382106:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867806592:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.382127:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009337a800/0x2fa243e067ccce22 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a696 expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.382136:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009337a800/0x2fa243e067ccce22 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a696 expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.382144:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337a800, rc 0) 00000100:00100000:3.0:1746142910.382180:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867357056:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6485us (6615us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.383268:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14178 00000100:00100000:2.0:1746142910.384945:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a28e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867806720:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.384963:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.384991:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867357696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3967us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.384999:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6380 00000100:00100000:0.0:1746142910.385458:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.385492:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.385530:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.385649:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867358336 00000100:00100000:2.0:1746142910.385656:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867358336 00000100:00100000:2.0:1746142910.385685:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14179 00000100:00100000:2.0:1746142910.385691:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867358336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.385705:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.385720:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067ccce29 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a69d expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.385758:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867806848:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142910.385950:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867357952 00000100:00100000:3.0:1746142910.385954:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867357952 00000100:00100000:3.0:1746142910.385979:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5255 00000100:00100000:3.0:1746142910.385984:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32368:x1830962867357952:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142910.386974:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867358208 00000100:00100000:0.0:1746142910.386979:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867358208 00002000:00100000:0.0:1746142910.387001:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (499712->503807) req@ffff88009a28e300 x1830962867358208/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142910.387010:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28e300 with x1830962867358208 ext(499712->503807) 00002000:00010000:0.0:1746142910.387013:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28e300 00000100:00100000:0.0:1746142910.387026:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4359 00000100:00100000:0.0:1746142910.387031:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867358208:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142910.387813:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.388046:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:32368:x1830962867357952:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 2059us (2587us total) trans 8589936587 rc 0/0 00000100:00100000:3.0:1746142910.388055:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5255 00000100:00100000:0.0:1746142910.389174:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867358208:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 2139us (3640us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142910.389184:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4359 00002000:00100000:0.0:1746142910.389191:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (499712->503807) req@ffff88009a28e300 x1830962867358208/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142910.389199:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28e300 with x1830962867358208 ext(499712->503807) 00002000:00010000:0.0:1746142910.389202:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28e300 00002000:00010000:2.0:1746142910.390870:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746142908 -> 1746142911 00002000:00010000:2.0:1746142910.390875:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746142908 -> 1746142910 00002000:00010000:2.0:1746142910.390876:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746142908 -> 1746142911 00000100:00100000:2.0:1746142910.390893:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867806848:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142910.390934:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067ccce29 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a69d expref: 37 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.390947:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067ccce29 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a69d expref: 37 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.391335:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3600, rc 0) 00000100:00100000:2.0:1746142910.391386:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867358336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5694us (5892us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142910.391392:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14179 00000100:00100000:0.0:1746142910.396954:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.397049:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.397200:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867358592 00000100:00100000:2.0:1746142910.397207:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867358592 00002000:00100000:2.0:1746142910.397241:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (593920->598015) req@ffff88009a28ed80 x1830962867358592/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.397250:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ed80 with x1830962867358592 ext(593920->598015) 00002000:00010000:2.0:1746142910.397255:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ed80 00000100:00100000:2.0:1746142910.397270:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4360 00000100:00100000:2.0:1746142910.397276:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867358592:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142910.397427:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867358848 00000100:00100000:3.0:1746142910.397431:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867358848 00000100:00100000:3.0:1746142910.397451:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5256 00000100:00100000:3.0:1746142910.397456:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4851050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:32371:x1830962867358848:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142910.397608:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4851050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32371:x1830962867358848:12345-192.168.204.50@tcp:35:cat.0 Request processed in 150us (557us total) trans 8589936588 rc 0/0 00000100:00100000:3.0:1746142910.397614:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5256 00000100:00100000:2.0:1746142910.397980:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867358592:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 702us (1033us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142910.397987:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4360 00002000:00100000:2.0:1746142910.397992:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (593920->598015) req@ffff88009a28ed80 x1830962867358592/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.397999:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ed80 with x1830962867358592 ext(593920->598015) 00002000:00010000:2.0:1746142910.398003:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ed80 00000100:00100000:0.0:1746142910.476425:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.476609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.476665:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867358976 00000100:00100000:1.0:1746142910.476667:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867359104 00000100:00100000:2.0:1746142910.476671:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867358976 00000100:00100000:1.0:1746142910.476672:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867359104 00000100:00100000:2.0:1746142910.476705:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14180 00000100:00100000:1.0:1746142910.476717:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14181 00000100:00100000:1.0:1746142910.476723:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867359104:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:2.0:1746142910.476724:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867358976:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.476735:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.476735:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.476746:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc2200/0x2fa243e067ccce30 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6a4 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.476747:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067ccce37 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6ab expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.476780:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867806976:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142910.476780:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867807104:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.476850:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.476857:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00002000:00010000:2.0:1746142910.477932:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142910 -> 1746142911 00002000:00010000:2.0:1746142910.477937:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142910 -> 1746142911 00002000:00010000:2.0:1746142910.477938:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142910 -> 1746142911 00000100:00100000:2.0:1746142910.477954:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867806976:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142910.477975:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2200/0x2fa243e067ccce30 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6a4 expref: 21 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.477984:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2200/0x2fa243e067ccce30 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6a4 expref: 21 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.478008:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2200, rc 0) 00000100:00100000:2.0:1746142910.478033:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867358976:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1321us (1615us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142910.478038:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14180 00002000:00010000:1.0:1746142910.478105:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746142910 -> 1746142911 00002000:00010000:1.0:1746142910.478108:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142910 -> 1746142911 00002000:00010000:1.0:1746142910.478109:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746142910 -> 1746142911 00000100:00100000:1.0:1746142910.478119:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867807104:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142910.478214:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067ccce37 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ab expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.478223:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067ccce37 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ab expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.478234:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ec00, rc 0) 00000100:00100000:1.0:1746142910.478253:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867359104:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1531us (1643us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142910.478258:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14181 00000100:00100000:0.0:1746142910.481621:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.481787:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867359360 00000100:00100000:2.0:1746142910.481794:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867359360 00002000:00100000:2.0:1746142910.481826:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009734df80 x1830962867359360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 504/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.481833:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734df80 with x1830962867359360 ext(0->1048575) 00002000:00010000:2.0:1746142910.481836:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734df80 00000100:00100000:2.0:1746142910.481857:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4361 00000100:00100000:2.0:1746142910.481863:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867359360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.488659:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867359360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6787us (7034us total) trans 0 rc 950272/950272 00000100:00100000:2.0:1746142910.488669:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4361 00002000:00100000:2.0:1746142910.488680:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009734df80 x1830962867359360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 504/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 950272/950272 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.488688:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734df80 with x1830962867359360 ext(0->1048575) 00002000:00010000:2.0:1746142910.488693:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734df80 00000100:00100000:1.0:1746142910.496028:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.496066:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867359488 00000100:00100000:0.0:1746142910.496074:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867359488 00000100:00100000:1.0:1746142910.496075:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.496116:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867359616 00000100:00100000:2.0:1746142910.496119:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867359616 00000100:00100000:2.0:1746142910.496154:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14182 00000100:00100000:2.0:1746142910.496161:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:32381:x1830962867359616:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.496174:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.496187:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6b9 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.496208:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.496215:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142910.496217:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142910.496220:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.496242:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 36 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.496252:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.496263:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867807232:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.496334:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.497292:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14427 00000100:00100000:0.0:1746142910.497300:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:32382:x1830962867359488:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142910.497312:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142910.497322:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e800/0x2fa243e067ccce45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6b2 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.497361:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497380:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497389:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497399:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497405:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497410:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497457:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497466:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 25 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.497472:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.497486:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 25 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.497493:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 25 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746142910.497501:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867807360:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142910.497544:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.499449:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092430380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867807232:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.499471:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.499484:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3600, rc 0) 00000100:00100000:2.0:1746142910.499569:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867807360:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.499580:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142910.499743:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:32381:x1830962867359616:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3581us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.499751:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14182 00000100:00100000:1.0:1746142910.499923:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.500024:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867359872 00000100:00100000:3.0:1746142910.500029:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867359872 00000100:00100000:3.0:1746142910.500067:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5257 00000100:00100000:3.0:1746142910.500074:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:30464:x1830962867359872:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746142910.500214:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+27:30464:x1830962867359872:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 140us (293us total) trans 8589936589 rc 0/0 00000100:00100000:3.0:1746142910.500220:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5257 00000100:00100000:0.0:1746142910.501933:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.501985:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360000 00000100:00100000:2.0:1746142910.501991:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360000 00002000:00100000:2.0:1746142910.502019:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1560576->2097151) req@ffff88009734ed80 x1830962867360000/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.502027:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ed80 with x1830962867360000 ext(1560576->2097151) 00010000:00010000:2.0:1746142910.502034:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.502044:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 37 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.502049:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734ed80 00000100:00100000:2.0:1746142910.502065:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1352 00000100:00100000:2.0:1746142910.502070:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867360000:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142910.502839:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.502883:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360128 00000100:00100000:0.0:1746142910.502887:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360128 00010000:00010000:0.0:1746142910.502933:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 27 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.502985:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6381 00000100:00100000:1.0:1746142910.502997:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867360128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142910.503008:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142910.503014:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 27 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.503024:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 27 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.503041:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097106600/0x2fa243e067cccd81 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a634 expref: 27 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.503056:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142910.503060:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142910.503069:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142910.503075:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142910.503092:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142910.503114:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867360128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 122us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.503120:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6381 00010000:00010000:2.0:1746142910.503265:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503274:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142910.503309:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:2.0:1746142910.503312:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142910.503325:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503333:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503342:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503347:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503352:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503357:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503362:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3e600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142910.503375:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503381:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503389:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142910.503392:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142910.503394:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503399:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e600/0x2fa243e067ccce4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503410:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503415:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503419:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503423:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3fa00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142910.503425:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503429:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503435:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736e00) 00010000:00010000:2.0:1746142910.503437:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142910.503439:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503443:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fa00/0x2fa243e067ccce53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.503466:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3e800/0x2fa243e067ccce45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.503477:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 18 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.503483:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.503485:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142910.503487:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3fe00, rc 0) 00000100:00100000:2.0:1746142910.503508:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:32382:x1830962867359488:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 6209us (7488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.503514:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14427 00000100:00100000:2.0:1746142910.510654:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.510685:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.510699:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.510710:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.510729:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360256 00000100:00100000:2.0:1746142910.510736:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360256 00000100:00100000:2.0:1746142910.510769:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360384 00000100:00100000:2.0:1746142910.510771:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360384 00000100:00100000:2.0:1746142910.510780:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360512 00000100:00100000:2.0:1746142910.510781:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360512 00000100:00100000:2.0:1746142910.510788:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360640 00000100:00100000:2.0:1746142910.510790:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360640 00000100:00100000:2.0:1746142910.510800:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14183 00000100:00100000:2.0:1746142910.510807:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867360256:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142910.510822:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.510836:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc2200/0x2fa243e067ccce61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6c0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142910.510837:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.510881:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867807488:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.510969:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.510983:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360768 00000100:00100000:2.0:1746142910.510986:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360768 00000100:00100000:2.0:1746142910.511005:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14184 00000100:00100000:2.0:1746142910.511010:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867360384:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142910.511016:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.511024:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097106000/0x2fa243e067ccce68 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6c7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.511051:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867807616:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.511069:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.511080:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14185 00000100:00100000:2.0:1746142910.511084:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867360512:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142910.511090:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.511096:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cd800/0x2fa243e067ccce6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6ce expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.511114:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867807744:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.511128:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.511187:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14186 00000100:00100000:2.0:1746142910.511192:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867360640:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142910.511198:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.511203:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6d5 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.511212:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.511221:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.511227:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.511238:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.511246:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:2.0:1746142910.511264:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867360640:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 73us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.511269:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14186 00000100:00100000:2.0:1746142910.511280:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14187 00000100:00100000:2.0:1746142910.511284:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867360768:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142910.511289:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.511293:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6dc expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.511300:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.511301:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.511304:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.511312:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.511321:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cda00, rc 0) 00000100:00100000:2.0:1746142910.511331:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867360768:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 47us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.511335:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14187 00000100:00100000:2.0:1746142910.514631:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867360000:12345-192.168.204.50@tcp:4:cat.0 Request processed in 12552us (12693us total) trans 17179873925 rc 0/0 00000100:00100000:2.0:1746142910.514641:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1352 00002000:00100000:2.0:1746142910.514652:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1560576->2097151) req@ffff88009734ed80 x1830962867360000/t17179873925(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.514660:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ed80 with x1830962867360000 ext(1560576->2097151) 00010000:00010000:2.0:1746142910.514667:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 39 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.514679:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 39 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.514684:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734ed80 00002000:00010000:2.0:1746142910.520832:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746142910 -> 1746142911 00000100:00100000:2.0:1746142910.520857:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867807488:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142910.520889:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc2200/0x2fa243e067ccce61 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6c0 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.520928:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2200/0x2fa243e067ccce61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6c0 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.520958:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2200, rc 0) 00000100:00100000:2.0:1746142910.520997:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867360256:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10189us (10349us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142910.521005:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14183 00000100:00100000:3.0:1746142910.521557:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867807616:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.521574:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097106000/0x2fa243e067ccce68 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6c7 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.521583:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106000/0x2fa243e067ccce68 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6c7 expref: 12 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.521598:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106000, rc 0) 00000100:00100000:3.0:1746142910.521620:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867360384:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10609us (10933us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.521625:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14184 00000100:00100000:3.0:1746142910.521737:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867807744:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.521749:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cd800/0x2fa243e067ccce6f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ce expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.521756:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd800/0x2fa243e067ccce6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ce expref: 8 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.521762:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cd800, rc 0) 00000100:00100000:3.0:1746142910.521782:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867360512:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10697us (11082us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.521786:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14185 00000100:00100000:1.0:1746142910.525387:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.525423:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.525478:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867360896 00000100:00100000:2.0:1746142910.525485:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867360896 00010000:00010000:2.0:1746142910.525515:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 39 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.525536:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6382 00000100:00100000:2.0:1746142910.525546:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867360896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.525558:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.525573:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 39 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.525584:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 39 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.525601:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3200/0x2fa243e067ccce0d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1560576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a681 expref: 39 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.525611:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.525613:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.525617:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 20 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.525628:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 20 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.525652:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 20 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.525661:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867807872:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.525798:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.525856:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867361152 00000100:00100000:3.0:1746142910.525860:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867361152 00000100:00100000:3.0:1746142910.525886:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14428 00000100:00100000:3.0:1746142910.525891:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:32382:x1830962867361152:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142910.525922:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.525932:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a800/0x2fa243e067ccce84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6e3 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.526428:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.526441:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.526448:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.526466:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.526474:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 19 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.526481:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867808000:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.526671:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.528290:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.528392:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867361408 00000100:00100000:2.0:1746142910.528398:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867361408 00000100:00100000:2.0:1746142910.528427:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14429 00000100:00100000:2.0:1746142910.528432:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:32384:x1830962867361408:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.528446:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.528457:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccce92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6ea expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.528525:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.528536:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.528556:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142910.529684:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867807872:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.529703:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.529746:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867360896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4199us (4364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.529754:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6382 00000100:00100000:0.0:1746142910.529859:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.529886:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.529979:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867808000:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.529993:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142910.530010:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867361792 00000100:00100000:3.0:1746142910.530012:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867361792 00010000:00010000:3.0:1746142910.530026:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 20 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.530039:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6383 00000100:00100000:3.0:1746142910.530043:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:2005:x1830962867361792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.530051:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.530056:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 20 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.530064:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 20 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.530077:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3fe00/0x2fa243e067ccce5a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b2 expref: 20 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.530086:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.530089:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.530096:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.530100:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.530105:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.530110:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.530114:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142910.530124:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142910.530201:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142910.530206:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142910.530217:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142910.530295:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6000/0x2fa243e067ccce92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 29 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.530304:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.530309:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.530311:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142910.530312:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c6600, rc 0) 00000100:00100000:3.0:1746142910.530364:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:2005:x1830962867361792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 319us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.530377:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6383 00010000:00010000:3.0:1746142910.530393:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.530401:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142910.530411:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142910.530454:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a800/0x2fa243e067ccce84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6e3 expref: 20 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.530463:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6e3 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.530468:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.530470:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142910.530471:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337be00, rc 0) 00000100:00100000:2.0:1746142910.530788:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:32384:x1830962867361408:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2354us (2500us total) trans 8589936590 rc 0/0 00000100:00100000:2.0:1746142910.530793:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14429 00000100:00100000:2.0:1746142910.530810:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867361664 00000100:00100000:2.0:1746142910.530813:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867361664 00002000:00100000:2.0:1746142910.530832:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009734c000 x1830962867361664/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.530840:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c000 with x1830962867361664 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.530844:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734c000 00000100:00100000:2.0:1746142910.530853:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4362 00000100:00100000:2.0:1746142910.530857:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867361664:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.531202:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:32382:x1830962867361152:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 5309us (5777us total) trans 8589936591 rc 0/0 00000100:00100000:3.0:1746142910.531207:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14428 00000100:00100000:0.0:1746142910.539537:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.539953:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867362048 00000100:00100000:3.0:1746142910.539960:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867362048 00000100:00100000:3.0:1746142910.540000:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14430 00000100:00100000:3.0:1746142910.540007:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b400bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:32382:x1830962867362048:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142910.540026:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.540029:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746142910.540048:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccce8b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6e3 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.540064:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.540068:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142910.540088:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccceae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6f1 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.540159:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.540171:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.540177:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.540202:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.540212:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 27 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.540222:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867808128:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.540282:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.544228:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867361664:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13362us (14362us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.544238:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4362 00002000:00100000:2.0:1746142910.544247:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009734c000 x1830962867361664/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.544255:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c000 with x1830962867361664 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.544261:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734c000 00000100:00100000:0.0:1746142910.545548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.545623:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867808128:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.545644:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142910.545822:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867362176 00000100:00100000:2.0:1746142910.545827:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867362176 00010000:00010000:2.0:1746142910.545848:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 28 pid: 7232 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.545877:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6384 00000100:00100000:2.0:1746142910.545883:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867362176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.545894:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.545928:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 28 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.545937:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 28 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.545954:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067ccce99 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ea expref: 28 pid: 7232 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.545973:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.545977:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.545985:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.545990:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.546003:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.546025:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867362176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 142us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.546030:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6384 00010000:00010000:3.0:1746142910.546137:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546143:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546157:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546163:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546167:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546171:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedde00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142910.546174:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546178:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546185:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.546187:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142910.546189:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546193:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceb5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.546221:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccceae lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f1 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.546227:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccceae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f1 expref: 19 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.546232:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337ac00, rc 0) 00000100:00100000:3.0:1746142910.546250:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b400bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:32382:x1830962867362048:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 6244us (6721us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.546256:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14430 00000100:00100000:0.0:1746142910.547159:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.547263:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867362304 00000100:00100000:3.0:1746142910.547267:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867362304 00000100:00100000:3.0:1746142910.547300:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14188 00000100:00100000:3.0:1746142910.547306:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+15:32381:x1830962867362304:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.547317:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.547329:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6f8 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.547346:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 35 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.547353:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.547355:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.547357:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.547388:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 35 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.547397:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 35 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.547407:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867808256:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.548608:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.552376:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867808256:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.552402:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 16 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.552421:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a0000, rc 0) 00000100:00100000:3.0:1746142910.552465:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+16:32381:x1830962867362304:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5158us (5307us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.552471:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14188 00000100:00100000:0.0:1746142910.552735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.553821:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867362432 00000100:00100000:2.0:1746142910.553827:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867362432 00002000:00100000:2.0:1746142910.553856:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1224703) req@ffff88009734f100 x1830962867362432/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.553865:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734f100 with x1830962867362432 ext(1048576->1224703) 00010000:00010000:2.0:1746142910.553871:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.553881:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 36 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.553887:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734f100 00000100:00100000:2.0:1746142910.553917:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1353 00000100:00100000:2.0:1746142910.553922:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867362432:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142910.554621:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.554660:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.554685:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867362688 00000100:00100000:3.0:1746142910.554689:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867362688 00000100:00100000:3.0:1746142910.554710:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867362944 00000100:00100000:3.0:1746142910.554711:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867362944 00000100:00100000:3.0:1746142910.554721:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5258 00000100:00100000:3.0:1746142910.554726:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+18:32382:x1830962867362688:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:0.0:1746142910.554737:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5259 00000100:00100000:0.0:1746142910.554745:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:32384:x1830962867362944:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142910.555610:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+19:32382:x1830962867362688:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 882us (988us total) trans 8589936593 rc 0/0 00000100:00100000:0.0:1746142910.555610:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:32384:x1830962867362944:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 864us (947us total) trans 8589936592 rc 0/0 00000100:00100000:0.0:1746142910.555616:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5259 00000100:00100000:3.0:1746142910.555619:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5258 00000100:00100000:0.0:1746142910.557659:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867362432:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3731us (4919us total) trans 21474841185 rc 0/0 00000100:00100000:0.0:1746142910.557668:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1353 00002000:00100000:0.0:1746142910.557676:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1224703) req@ffff88009734f100 x1830962867362432/t21474841185(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142910.557685:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734f100 with x1830962867362432 ext(1048576->1224703) 00010000:00010000:0.0:1746142910.557693:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.557706:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746142910.557713:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734f100 00000100:00100000:0.0:1746142910.563304:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.563376:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867363072 00000100:00100000:2.0:1746142910.563383:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867363072 00010000:00010000:2.0:1746142910.563413:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.563451:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6385 00000100:00100000:2.0:1746142910.563458:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867363072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.563469:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.563487:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.563497:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.563514:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc2a00/0x2fa243e067ccce14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1224703) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a688 expref: 38 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.563542:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.563544:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.563550:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.563558:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.563584:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 15 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.563598:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867808384:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.563668:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18780 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.565329:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867808384:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.565343:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.565520:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867363072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2061us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.565529:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6385 00000100:00100000:0.0:1746142910.569170:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.569246:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867363328 00000100:00100000:2.0:1746142910.569253:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867363328 00002000:00100000:2.0:1746142910.569288:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009734d500 x1830962867363328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.569297:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d500 with x1830962867363328 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.569302:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734d500 00000100:00100000:2.0:1746142910.569327:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4363 00000100:00100000:2.0:1746142910.569334:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867363328:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142910.575697:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867363328:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 6355us (6525us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.575706:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4363 00002000:00100000:2.0:1746142910.575716:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009734d500 x1830962867363328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.575724:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d500 with x1830962867363328 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.575729:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734d500 00000100:00100000:0.0:1746142910.615553:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.617939:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867363584 00000100:00100000:3.0:1746142910.617949:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867363584 00000100:00100000:3.0:1746142910.618011:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14431 00000100:00100000:3.0:1746142910.618019:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32390:x1830962867363584:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142910.618039:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.618055:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cccec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a6ff expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.618114:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618125:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618137:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618148:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618153:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618157:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618231:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618240:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618245:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142910.618251:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142910.618305:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618311:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618316:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618321:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618326:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bedde00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142910.618329:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618335:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618344:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142910.618346:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142910.618349:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618353:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bedde00/0x2fa243e067ccceca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618391:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618396:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618400:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618403:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009337ac00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142910.618406:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618409:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618414:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4b00) 00010000:00010000:3.0:1746142910.618416:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142910.618418:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618424:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337ac00/0x2fa243e067ccced1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.618452:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cccec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 59 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.618461:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 58 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.618466:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.618467:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142910.618469:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337be00, rc 0) 00000100:00100000:3.0:1746142910.618527:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32390:x1830962867363584:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 509us (2980us total) trans 8589936594 rc 0/0 00000100:00100000:3.0:1746142910.618533:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14431 00000100:00100000:0.0:1746142910.627417:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.627504:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867363840 00000100:00100000:3.0:1746142910.627511:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867363840 00000100:00100000:3.0:1746142910.627557:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14432 00000100:00100000:3.0:1746142910.627565:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32392:x1830962867363840:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.627583:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.627598:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cccee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a706 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.627672:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.627684:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.627696:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142910.627705:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142910.627776:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a0a00/0x2fa243e067cccee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 61 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.627791:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 60 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.627798:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.627800:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142910.627803:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0a1000, rc 0) 00000100:00100000:3.0:1746142910.627944:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+60:32392:x1830962867363840:12345-192.168.204.50@tcp:101:cat.0 Request processed in 378us (532us total) trans 8589936595 rc 0/0 00000100:00100000:3.0:1746142910.627950:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14432 00000100:00100000:1.0:1746142910.633008:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.633036:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.633058:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.633154:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867363968 00000100:00100000:3.0:1746142910.633161:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867363968 00000100:00100000:3.0:1746142910.633189:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867364096 00000100:00100000:3.0:1746142910.633191:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867364096 00000100:00100000:3.0:1746142910.633198:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867364224 00000100:00100000:3.0:1746142910.633200:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867364224 00000100:00100000:3.0:1746142910.633297:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14189 00000100:00100000:3.0:1746142910.633303:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867363968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.633318:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.633330:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cccefb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a70d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.633385:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867808512:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142910.633441:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069600 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.633477:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14190 00000100:00100000:1.0:1746142910.633483:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867364096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.633490:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.633497:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a714 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.633508:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.633510:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.633516:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 39 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.633528:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 39 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.633537:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbb400, rc 0) 00000100:00100000:1.0:1746142910.633555:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867364096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.633561:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14190 00000100:00100000:1.0:1746142910.633573:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14191 00000100:00100000:1.0:1746142910.633577:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867364224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.633582:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.633587:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a71b expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.633595:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.633596:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.633600:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.633608:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.633615:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbbe00, rc 0) 00000100:00100000:1.0:1746142910.633627:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867364224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 49us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.633631:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14191 00000100:00100000:3.0:1746142910.636883:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867808512:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.636931:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cccefb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a70d expref: 39 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.636944:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cccefb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a70d expref: 39 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.636956:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07200, rc 0) 00000100:00100000:3.0:1746142910.636999:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867363968:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3694us (3996us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.637006:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14189 00000100:00100000:0.0:1746142910.641057:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.641144:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867364352 00000100:00100000:3.0:1746142910.641152:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867364352 00000100:00100000:3.0:1746142910.641187:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14192 00000100:00100000:3.0:1746142910.641194:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32392:x1830962867364352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.641209:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.641223:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a722 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.641246:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.641253:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.641255:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.641258:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.641282:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.641293:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 15 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.641303:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867808640:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.641388:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069600 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.644408:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867808640:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.644462:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.644476:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06200, rc 0) 00000100:00100000:3.0:1746142910.644992:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32392:x1830962867364352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3796us (3940us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.645001:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14192 00000100:00100000:0.0:1746142910.645188:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.645246:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867364480 00000100:00100000:2.0:1746142910.645252:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867364480 00002000:00100000:2.0:1746142910.645283:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (499712->921599) req@ffff880092d0aa00 x1830962867364480/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 504/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.645291:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0aa00 with x1830962867364480 ext(499712->921599) 00010000:00010000:2.0:1746142910.645298:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 16 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.645309:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 16 pid: 1397 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.645315:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092d0aa00 00000100:00100000:2.0:1746142910.645330:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1354 00000100:00100000:2.0:1746142910.645336:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867364480:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142910.657706:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867364480:12345-192.168.204.50@tcp:4:cat.0 Request processed in 12362us (12511us total) trans 21474841186 rc 0/0 00000100:00100000:0.0:1746142910.657716:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1354 00002000:00100000:0.0:1746142910.657725:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (499712->921599) req@ffff880092d0aa00 x1830962867364480/t21474841186(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 504/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142910.657733:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0aa00 with x1830962867364480 ext(499712->921599) 00010000:00010000:0.0:1746142910.657742:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.657754:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00002000:00010000:0.0:1746142910.657759:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092d0aa00 00000100:00100000:0.0:1746142910.662401:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.664134:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867364608 00000100:00100000:2.0:1746142910.664143:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867364608 00010000:00010000:2.0:1746142910.664173:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.664211:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6386 00000100:00100000:2.0:1746142910.664217:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867364608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.664229:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.664245:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.664257:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.664276:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccce1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 499712->598015) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a68f expref: 18 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.664301:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.664303:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.664309:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.664316:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.664341:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.664351:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867808768:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.664442:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.674040:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.674068:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867808768:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.674085:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.674120:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867364608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9903us (11727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.674128:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6386 00000100:00100000:0.0:1746142910.676335:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.676378:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.676405:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867364864 00000100:00100000:2.0:1746142910.676412:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867364864 00000100:00100000:0.0:1746142910.676422:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:2.0:1746142910.676445:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092d0bb80 x1830962867364864/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746142910.676448:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867365504 00000100:00100000:0.0:1746142910.676451:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867365504 00002000:00100000:2.0:1746142910.676460:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0bb80 with x1830962867364864 ext(0->1048575) 00002000:00010000:2.0:1746142910.676464:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0bb80 00000100:00100000:0.0:1746142910.676474:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14193 00000100:00100000:2.0:1746142910.676475:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867365120 00000100:00100000:2.0:1746142910.676477:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867365120 00000100:00100000:0.0:1746142910.676480:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32390:x1830962867365504:12345-192.168.204.50@tcp:101:multiop.0 00002000:00100000:2.0:1746142910.676486:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880092d08380 x1830962867365120/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.676492:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08380 with x1830962867365120 ext(1048576->2097151) 00010000:00010000:0.0:1746142910.676494:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746142910.676495:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d08380 00000100:00100000:2.0:1746142910.676504:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867365376 00000100:00100000:2.0:1746142910.676506:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867365376 00010000:00010000:0.0:1746142910.676507:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a729 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746142910.676513:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880092d0a300 x1830962867365376/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.676519:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0a300 with x1830962867365376 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.676521:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0a300 00010000:00010000:0.0:1746142910.676529:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 41 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.676547:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142910.676554:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 20 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142910.676560:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142910.676565:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142910.676568:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.676598:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 20 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142910.676610:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 20 pid: 9580 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746142910.676622:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867808896:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142910.676699:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142910.676715:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 10 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746142910.676725:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867809024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142910.676757:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 41 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.676960:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 41 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746142910.677131:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867809152:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.677281:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4364 00000100:00100000:2.0:1746142910.677288:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867364864:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.677312:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4365 00000100:00100000:3.0:1746142910.677321:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867365120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.677809:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4366 00000100:00100000:2.0:1746142910.677815:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867365376:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142910.678424:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.684287:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.684381:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867365632 00000100:00100000:2.0:1746142910.684388:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867365632 00010000:00010000:2.0:1746142910.684420:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 11 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.684450:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6387 00000100:00100000:2.0:1746142910.684457:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867365632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.684472:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.684490:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 11 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.684500:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 11 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.684521:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.684556:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867365632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.684562:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6387 00010000:00010000:1.0:1746142910.684667:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968cda00/0x2fa243e067ccce7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6dc expref: 10 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.684684:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867809024:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.684694:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867808896:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142910.686003:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.686102:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867809152:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.686130:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.686143:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3e400, rc 0) 00000100:00100000:1.0:1746142910.686187:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32390:x1830962867365504:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9706us (9763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.686193:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14193 00000100:00100000:2.0:1746142910.686196:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867365760 00000100:00100000:2.0:1746142910.686201:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867365760 00010000:00010000:2.0:1746142910.686217:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 21 pid: 9580 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.686239:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6388 00000100:00100000:2.0:1746142910.686245:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867365760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.686254:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.686266:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 21 pid: 9580 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.686274:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 21 pid: 9580 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.686288:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009337b000/0x2fa243e067cccda4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a650 expref: 21 pid: 9580 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.686311:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.686327:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867365760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.686333:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6388 00000100:00100000:0.0:1746142910.688315:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.688413:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867365888 00000100:00100000:2.0:1746142910.688419:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867365888 00010000:00010000:2.0:1746142910.688437:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 42 pid: 9578 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.688470:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6389 00000100:00100000:2.0:1746142910.688476:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867365888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.688485:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.688497:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 42 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.688506:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 42 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.688521:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106400/0x2fa243e067cccd57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a611 expref: 42 pid: 9578 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.688532:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.688534:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.688539:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.688551:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.688577:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.688588:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867809280:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142910.688698:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.690261:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867364864:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12969us (16223us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.690269:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4364 00002000:00100000:2.0:1746142910.690278:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880092d0bb80 x1830962867364864/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.690287:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0bb80 with x1830962867364864 ext(0->1048575) 00002000:00010000:2.0:1746142910.690291:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0bb80 00000100:00100000:0.0:1746142910.693861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.693977:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867366144 00000100:00100000:3.0:1746142910.693985:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867366144 00002000:00100000:3.0:1746142910.694021:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4141055) req@ffff88009809d500 x1830962867366144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.694037:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d500 with x1830962867366144 ext(4136960->4141055) 00002000:00010000:3.0:1746142910.694041:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809d500 00000100:00100000:3.0:1746142910.694072:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4367 00000100:00100000:3.0:1746142910.694079:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867366144:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142910.694158:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867809280:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142910.694175:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.694197:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867366144:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 118us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142910.694203:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4367 00002000:00100000:3.0:1746142910.694209:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4141055) req@ffff88009809d500 x1830962867366144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.694215:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d500 with x1830962867366144 ext(4136960->4141055) 00002000:00010000:3.0:1746142910.694218:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809d500 00000100:00100000:2.0:1746142910.694745:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867365888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6267us (6433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.694752:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6389 00000100:00100000:3.0:1746142910.695241:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867365120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17920us (18910us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142910.695247:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4365 00002000:00100000:3.0:1746142910.695252:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880092d08380 x1830962867365120/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.695259:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08380 with x1830962867365120 ext(1048576->2097151) 00002000:00010000:3.0:1746142910.695262:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d08380 00000100:00100000:2.0:1746142910.697040:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867365376:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19219us (20656us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.697047:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4366 00002000:00100000:2.0:1746142910.697053:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880092d0a300 x1830962867365376/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.697061:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0a300 with x1830962867365376 ext(1048576->2097151) 00002000:00010000:2.0:1746142910.697065:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0a300 00000100:00100000:0.0:1746142910.699545:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.699660:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867366272 00000100:00100000:1.0:1746142910.699668:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867366272 00000100:00100000:1.0:1746142910.699710:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14194 00000100:00100000:1.0:1746142910.699717:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32390:x1830962867366272:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142910.699731:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.699746:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a730 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.699769:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.699777:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 6 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.699783:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 16 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.699789:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.699791:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.699794:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->4591615] (req 4194304->4591615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.699816:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 16 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.699825:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 16 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.699836:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867809408:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.699933:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 6 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.699945:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 6 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:1.0:1746142910.699953:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867809536:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.699989:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.699997:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 40 pid: 1397 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.700003:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867809664:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.700019:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.701842:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867809408:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.701850:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867809536:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142910.702318:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867809664:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142910.702339:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->4591615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.702351:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba600, rc 0) 00000100:00100000:1.0:1746142910.702389:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32390:x1830962867366272:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2673us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.702396:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14194 00000100:00100000:0.0:1746142910.707654:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.707719:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867366400 00000100:00100000:2.0:1746142910.707727:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867366400 00010000:00010000:2.0:1746142910.707760:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 7 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:0.0:1746142910.708478:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.708750:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867366656 00000100:00100000:2.0:1746142910.708754:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867366656 00010000:00010000:2.0:1746142910.708769:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 17 pid: 9578 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746142910.708830:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6390 00000100:00100000:3.0:1746142910.708839:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867366400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.708850:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.708868:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 7 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.708878:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 7 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.708896:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccce76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6d5 expref: 7 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.708940:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.708977:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+6:2006:x1830962867366400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.708983:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6390 00000100:00100000:3.0:1746142910.708996:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6391 00000100:00100000:3.0:1746142910.709000:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867366656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.709008:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142910.709014:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 17 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.709021:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 17 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.709031:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009337a000/0x2fa243e067cccd9d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a649 expref: 17 pid: 9578 timeout: 784 lvb_type: 1 00010000:00010000:3.0:1746142910.709039:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.709051:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867366656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.709059:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6391 00000100:00100000:0.0:1746142910.710053:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.710398:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.710443:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867366784 00000100:00100000:1.0:1746142910.710449:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867366784 00000100:00100000:1.0:1746142910.710482:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14195 00000100:00100000:3.0:1746142910.710484:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867366528 00000100:00100000:1.0:1746142910.710487:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32392:x1830962867366784:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142910.710488:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867366528 00010000:00010000:1.0:1746142910.710498:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.710503:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 41 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.710508:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a737 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.710521:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6392 00010000:00010000:1.0:1746142910.710522:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.710524:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142910.710526:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867366528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142910.710529:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.710534:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142910.710539:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.710545:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 42 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.710547:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbba00, rc 0) 00010000:00010000:3.0:1746142910.710554:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 42 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.710566:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067cccd73 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a62d expref: 42 pid: 1397 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.710575:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.710577:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.710581:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142910.710586:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32392:x1830962867366784:12345-192.168.204.50@tcp:101:cat.0 Request processed in 98us (188us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142910.710588:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142910.710591:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14195 00010000:00010000:3.0:1746142910.710611:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.710622:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867809792:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142910.710675:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.716457:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867809792:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.716476:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142910.716482:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.716770:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a72850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867366528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6240us (6717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.716779:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6392 00000100:00100000:2.0:1746142910.717031:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867367040 00000100:00100000:2.0:1746142910.717036:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867367040 00002000:00100000:2.0:1746142910.717070:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009809ce00 x1830962867367040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.717077:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ce00 with x1830962867367040 ext(2097152->4194303) 00002000:00010000:2.0:1746142910.717081:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809ce00 00000100:00100000:2.0:1746142910.717104:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4368 00000100:00100000:2.0:1746142910.717112:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867367040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142910.718133:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.718195:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867367296 00000100:00100000:3.0:1746142910.718200:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867367296 00002000:00100000:3.0:1746142910.718216:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4587520->4591615) req@ffff88009809f800 x1830962867367296/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.718223:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f800 with x1830962867367296 ext(4587520->4591615) 00002000:00010000:3.0:1746142910.718227:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809f800 00000100:00100000:3.0:1746142910.718251:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4369 00000100:00100000:3.0:1746142910.718257:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867367296:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.718324:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867367296:12345-192.168.204.50@tcp:3:cat.0 Request processed in 67us (193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142910.718330:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4369 00002000:00100000:3.0:1746142910.718334:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4587520->4591615) req@ffff88009809f800 x1830962867367296/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.718341:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f800 with x1830962867367296 ext(4587520->4591615) 00002000:00010000:3.0:1746142910.718344:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809f800 00000100:00100000:0.0:1746142910.727392:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.727450:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867367552 00000100:00100000:3.0:1746142910.727458:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867367552 00000100:00100000:3.0:1746142910.727509:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5260 00000100:00100000:3.0:1746142910.727517:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+60:32390:x1830962867367552:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142910.727687:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+61:32390:x1830962867367552:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 171us (302us total) trans 8589936596 rc 0/0 00000100:00100000:3.0:1746142910.727693:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5260 00000100:00100000:0.0:1746142910.728748:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867367040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11636us (12265us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142910.728757:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4368 00002000:00100000:0.0:1746142910.728764:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009809ce00 x1830962867367040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142910.728773:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ce00 with x1830962867367040 ext(2097152->4194303) 00002000:00010000:0.0:1746142910.728778:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809ce00 00000100:00100000:0.0:1746142910.739170:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.739290:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867367680 00000100:00100000:2.0:1746142910.739298:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867367680 00000100:00100000:2.0:1746142910.739347:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14196 00000100:00100000:2.0:1746142910.739355:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32392:x1830962867367680:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.739381:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.739395:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a73e expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.739418:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.739425:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142910.739426:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142910.739429:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.739453:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.739464:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 40 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.739474:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867809920:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.739554:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142910.745423:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867809920:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.745451:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.745465:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2a00, rc 0) 00000100:00100000:2.0:1746142910.745499:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32392:x1830962867367680:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6145us (6337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.745508:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14196 00000100:00100000:0.0:1746142910.746221:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.746636:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867367808 00000100:00100000:2.0:1746142910.746642:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867367808 00002000:00100000:2.0:1746142910.746671:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4194303) req@ffff88009809c380 x1830962867367808/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.746680:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c380 with x1830962867367808 ext(4136960->4194303) 00010000:00010000:2.0:1746142910.746686:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 40 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.746697:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 40 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.746703:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009809c380 00000100:00100000:2.0:1746142910.746732:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1355 00000100:00100000:2.0:1746142910.746739:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867367808:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142910.749728:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867367808:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2981us (3500us total) trans 17179873926 rc 0/0 00000100:00100000:2.0:1746142910.749737:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1355 00002000:00100000:2.0:1746142910.749746:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4136960->4194303) req@ffff88009809c380 x1830962867367808/t17179873926(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.749753:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c380 with x1830962867367808 ext(4136960->4194303) 00010000:00010000:2.0:1746142910.749762:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.749779:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:2.0:1746142910.749785:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009809c380 00000100:00100000:0.0:1746142910.753070:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.753132:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867367936 00000100:00100000:3.0:1746142910.753140:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867367936 00010000:00010000:3.0:1746142910.753167:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.753202:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6393 00000100:00100000:3.0:1746142910.753208:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867367936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142910.753221:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142910.753235:0:7217:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142910 -> 1746142911 00002000:00010000:3.0:1746142910.753237:0:7217:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142910 -> 1746142911 00002000:00010000:3.0:1746142910.753239:0:7217:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142910 -> 1746142911 00010000:00010000:3.0:1746142910.753244:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.753254:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.753273:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067cccf17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4136960->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a729 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.753303:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.753305:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.753310:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 41 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.753318:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 41 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.753342:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 41 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.753353:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867810048:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142910.753420:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.756034:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867810048:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142910.756050:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.756079:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867367936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2870us (3014us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.756087:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6393 00000100:00100000:0.0:1746142910.757037:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.757260:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867368192 00000100:00100000:2.0:1746142910.757268:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867368192 00002000:00100000:2.0:1746142910.757299:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009809e300 x1830962867368192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.757308:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809e300 with x1830962867368192 ext(3145728->4194303) 00002000:00010000:2.0:1746142910.757312:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809e300 00000100:00100000:2.0:1746142910.757339:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4370 00000100:00100000:2.0:1746142910.757345:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867368192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142910.763770:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867368192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6417us (6727us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142910.763780:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4370 00002000:00100000:2.0:1746142910.763790:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88009809e300 x1830962867368192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.763797:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809e300 with x1830962867368192 ext(3145728->4194303) 00002000:00010000:2.0:1746142910.763802:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809e300 00000100:00100000:0.0:1746142910.769286:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.769558:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867368320 00000100:00100000:2.0:1746142910.769566:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867368320 00000100:00100000:2.0:1746142910.769611:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14197 00000100:00100000:2.0:1746142910.769617:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867368320:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.769634:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.769647:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf33 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a745 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.769689:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867810176:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.769769:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00002000:00010000:2.0:1746142910.773547:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142910 -> 1746142911 00002000:00010000:2.0:1746142910.773555:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142910 -> 1746142911 00002000:00010000:2.0:1746142910.773557:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142910 -> 1746142911 00000100:00100000:2.0:1746142910.773575:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867810176:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142910.773602:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf33 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a745 expref: 41 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.773614:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf33 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a745 expref: 41 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.773638:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3800, rc 0) 00000100:00100000:2.0:1746142910.773678:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867368320:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4059us (4398us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142910.773685:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14197 00000100:00100000:0.0:1746142910.781486:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.781588:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867368576 00000100:00100000:2.0:1746142910.781596:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867368576 00002000:00100000:2.0:1746142910.781633:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4591616->5033983) req@ffff88009809f480 x1830962867368576/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142910.781641:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f480 with x1830962867368576 ext(4591616->5033983) 00002000:00010000:2.0:1746142910.781645:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809f480 00000100:00100000:2.0:1746142910.781677:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4371 00000100:00100000:2.0:1746142910.781683:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867368576:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142910.786091:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.786358:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867368832 00000100:00100000:3.0:1746142910.786391:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867368832 00000100:00100000:3.0:1746142910.786433:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14433 00000100:00100000:3.0:1746142910.786439:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:32396:x1830962867368832:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142910.786460:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.786476:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130601000/0x2fa243e067cccf3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a74c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.786557:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.786569:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 60 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.786576:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.786600:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 60 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.786611:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 60 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.786621:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867810304:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.786682:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.786751:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867368576:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5067us (5273us total) trans 0 rc 442368/442368 00000100:00100000:3.0:1746142910.786758:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4371 00002000:00100000:3.0:1746142910.786765:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4591616->5033983) req@ffff88009809f480 x1830962867368576/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 442368/442368 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.786773:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f480 with x1830962867368576 ext(4591616->5033983) 00002000:00010000:3.0:1746142910.786777:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809f480 00000100:00100000:0.0:1746142910.791303:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.791345:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.791516:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867368960 00000100:00100000:2.0:1746142910.791524:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867368960 00010000:00010000:2.0:1746142910.791554:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 61 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:2.0:1746142910.791588:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6394 00000100:00100000:2.0:1746142910.791595:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+61:2005:x1830962867368960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.791608:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.791613:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 61 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.791623:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 61 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.791642:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.791645:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.791655:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.791660:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.791673:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.791714:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+61:2005:x1830962867368960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 120us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.791723:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6394 00000100:00100000:2.0:1746142910.791740:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369088 00000100:00100000:2.0:1746142910.791742:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369088 00000100:00100000:2.0:1746142910.791768:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14198 00000100:00100000:2.0:1746142910.791773:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867369088:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142910.791786:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.791796:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3200/0x2fa243e067cccf48 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a753 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.791947:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337be00/0x2fa243e067ccced8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6ff expref: 60 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.791964:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867810304:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.791978:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.791984:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.791988:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142910.792001:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142910.792085:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130601000/0x2fa243e067cccf3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 31 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.792094:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 30 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.792099:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.792101:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142910.792103:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600e00, rc 0) 00000100:00100000:3.0:1746142910.792121:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:32396:x1830962867368832:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5683us (6040us total) trans 8589936597 rc 0/0 00000100:00100000:3.0:1746142910.792126:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14433 00000100:00100000:2.0:1746142910.792957:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867810432:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.793022:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.796230:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867810432:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.796258:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3200/0x2fa243e067cccf48 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a753 expref: 41 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.796276:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3200/0x2fa243e067cccf48 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a753 expref: 41 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.796286:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3200, rc 0) 00000100:00100000:3.0:1746142910.796327:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867369088:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4552us (4981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.796334:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14198 00000100:00100000:0.0:1746142910.804081:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.804515:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369216 00000100:00100000:3.0:1746142910.804525:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369216 00000100:00100000:0.0:1746142910.805409:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.805531:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369344 00000100:00100000:0.0:1746142910.805534:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369344 00000100:00100000:3.0:1746142910.805540:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14199 00000100:00100000:3.0:1746142910.805548:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867369216:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142910.805564:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14200 00000100:00100000:0.0:1746142910.805569:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867369344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142910.805580:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142910.805593:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3921200/0x2fa243e067cccf56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a761 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.805625:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.805633:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a75a expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142910.805633:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867810560:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.805643:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.805645:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.805652:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.805664:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 17 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.805671:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601000, rc 0) 00000100:00100000:3.0:1746142910.805688:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867369216:12345-192.168.204.50@tcp:101:cat.0 Request processed in 141us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142910.805697:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.805723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.805736:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369472 00000100:00100000:2.0:1746142910.805739:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369472 00000100:00100000:2.0:1746142910.805759:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14201 00000100:00100000:2.0:1746142910.805764:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867369472:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142910.805767:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142910.805770:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.805776:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a768 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.805796:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867810688:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.805818:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.806071:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369600 00000100:00100000:1.0:1746142910.806075:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369600 00000100:00100000:1.0:1746142910.806097:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14202 00000100:00100000:1.0:1746142910.806101:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867369600:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142910.806108:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142910.806116:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a76f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.806129:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.806131:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.806135:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 21 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.806144:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 21 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.806149:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714400, rc 0) 00000100:00100000:1.0:1746142910.806166:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867369600:12345-192.168.204.50@tcp:101:cat.0 Request processed in 64us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.806170:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14202 00000100:00100000:3.0:1746142910.806231:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14199 00000100:00100000:3.0:1746142910.807335:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867810688:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.807335:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867810560:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142910.807353:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3921200/0x2fa243e067cccf56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a761 expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.807356:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf64 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a768 expref: 18 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.807376:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a768 expref: 18 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.807376:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3921200/0x2fa243e067cccf56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a761 expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.807396:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3921200, rc 0) 00010000:00010000:3.0:1746142910.807462:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3800, rc 0) 00000100:00100000:2.0:1746142910.807466:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867369344:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1896us (2060us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142910.807471:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14200 00000100:00100000:3.0:1746142910.807477:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867369472:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1714us (1755us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.807481:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14201 00000100:00100000:0.0:1746142910.816885:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.817479:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369856 00000100:00100000:3.0:1746142910.817490:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369856 00002000:00100000:3.0:1746142910.817534:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880099e89f80 x1830962867369856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.817543:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89f80 with x1830962867369856 ext(0->1048575) 00002000:00010000:3.0:1746142910.817547:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89f80 00000100:00100000:3.0:1746142910.818280:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4372 00000100:00100000:3.0:1746142910.818289:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867369856:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.837644:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867369856:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19348us (20761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142910.837653:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4372 00002000:00100000:3.0:1746142910.837662:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880099e89f80 x1830962867369856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.837671:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89f80 with x1830962867369856 ext(0->1048575) 00002000:00010000:3.0:1746142910.837675:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89f80 00000100:00100000:0.0:1746142910.854483:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.854945:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867370240 00000100:00100000:3.0:1746142910.854954:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867370240 00000100:00100000:3.0:1746142910.854995:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14434 00000100:00100000:3.0:1746142910.855001:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+60:32402:x1830962867370240:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142910.855020:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.855036:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130601200/0x2fa243e067cccf72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a77d expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.855113:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.855126:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.855135:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142910.855144:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142910.855594:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130601200/0x2fa243e067cccf72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 63 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.855622:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 62 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.855628:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142910.855631:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142910.855634:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130000, rc 0) 00000100:00100000:3.0:1746142910.856528:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+62:32402:x1830962867370240:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1523us (2048us total) trans 8589936598 rc 0/0 00000100:00100000:3.0:1746142910.856535:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14434 00000100:00100000:0.0:1746142910.857654:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.858160:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867369984 00000100:00100000:3.0:1746142910.858167:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867369984 00000100:00100000:3.0:1746142910.858214:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14203 00000100:00100000:3.0:1746142910.858220:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:32399:x1830962867369984:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.858234:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.858498:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a776 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.858518:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.858520:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.858526:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.858539:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.858547:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130600, rc 0) 00000100:00100000:3.0:1746142910.858581:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:32399:x1830962867369984:12345-192.168.204.50@tcp:101:cat.0 Request processed in 360us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.858587:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14203 00000100:00100000:0.0:1746142910.869383:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.869647:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867370496 00000100:00100000:3.0:1746142910.869655:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867370496 00002000:00100000:3.0:1746142910.869690:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880099e88700 x1830962867370496/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.869704:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88700 with x1830962867370496 ext(2097152->4194303) 00002000:00010000:3.0:1746142910.869709:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e88700 00000100:00100000:3.0:1746142910.870226:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4373 00000100:00100000:3.0:1746142910.870233:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867370496:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142910.871288:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142910.871581:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867370752 00000100:00100000:0.0:1746142910.871586:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867370752 00002000:00100000:0.0:1746142910.871605:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880096af0380 x1830962867370752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142910.871612:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0380 with x1830962867370752 ext(3145728->4194303) 00002000:00010000:0.0:1746142910.871615:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af0380 00000100:00100000:0.0:1746142910.871636:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4374 00000100:00100000:0.0:1746142910.871640:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867370752:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142910.889288:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867370752:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17640us (17994us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142910.889298:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4374 00002000:00100000:1.0:1746142910.889308:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880096af0380 x1830962867370752/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.889316:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0380 with x1830962867370752 ext(3145728->4194303) 00002000:00010000:1.0:1746142910.889321:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af0380 00000100:00100000:3.0:1746142910.901574:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867370496:12345-192.168.204.50@tcp:3:cat.0 Request processed in 31334us (32193us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142910.901584:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4373 00002000:00100000:3.0:1746142910.901593:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880099e88700 x1830962867370496/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.901602:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e88700 with x1830962867370496 ext(2097152->4194303) 00002000:00010000:3.0:1746142910.901606:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e88700 00000100:00100000:0.0:1746142910.908465:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.910079:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867370880 00000100:00100000:3.0:1746142910.910087:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867370880 00000100:00100000:3.0:1746142910.910146:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14204 00000100:00100000:3.0:1746142910.910153:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867370880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.910169:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.910182:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067cccf8e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a784 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.910222:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867810816:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142910.910302:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.911438:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867810816:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142910.911460:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067cccf8e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a784 expref: 19 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.911471:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067cccf8e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a784 expref: 19 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.911484:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130c00, rc 0) 00000100:00100000:3.0:1746142910.912417:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867370880:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2263us (3957us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142910.912424:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14204 00000100:00100000:0.0:1746142910.913948:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.914001:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371008 00000100:00100000:3.0:1746142910.914007:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371008 00000100:00100000:3.0:1746142910.914039:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14205 00000100:00100000:3.0:1746142910.914045:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:32399:x1830962867371008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142910.914057:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.914069:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a78b expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.914090:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.914098:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.914099:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142910.914102:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.914123:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.914138:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 39 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.914147:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867810944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.915186:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.917303:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867810944:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.917329:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->5033983] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.917343:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131c00, rc 0) 00000100:00100000:3.0:1746142910.917384:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:32399:x1830962867371008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3339us (3439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.917391:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14205 00000100:00100000:0.0:1746142910.917831:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.918457:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371136 00000100:00100000:3.0:1746142910.918464:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371136 00002000:00100000:3.0:1746142910.918493:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4591615) req@ffff88009cd5c700 x1830962867371136/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.918502:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c700 with x1830962867371136 ext(4194304->4591615) 00010000:00010000:3.0:1746142910.918508:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 40 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.918520:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 40 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746142910.918531:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5c700 00000100:00100000:3.0:1746142910.919384:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1356 00000100:00100000:3.0:1746142910.919392:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867371136:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142910.923559:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867371136:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4161us (5721us total) trans 21474841187 rc 0/0 00000100:00100000:3.0:1746142910.923571:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1356 00002000:00100000:3.0:1746142910.923584:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->4591615) req@ffff88009cd5c700 x1830962867371136/t21474841187(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/448 e 0 to 0 dl 1746142921 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.923592:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c700 with x1830962867371136 ext(4194304->4591615) 00010000:00010000:3.0:1746142910.923601:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:3.0:1746142910.923618:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00002000:00010000:3.0:1746142910.923624:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5c700 00000100:00100000:0.0:1746142910.934349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.935026:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371264 00000100:00100000:1.0:1746142910.935034:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371264 00010000:00010000:1.0:1746142910.935258:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.935286:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6395 00000100:00100000:1.0:1746142910.935292:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867371264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142910.935303:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142910.935320:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.935329:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.935347:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fba600/0x2fa243e067cccf1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a730 expref: 42 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:1.0:1746142910.936647:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.936650:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.936657:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.936670:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.936699:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142910.936710:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867811072:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142910.937098:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142910.949709:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867811072:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142910.949730:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142910.949775:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867371264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 14481us (15431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.949784:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6395 00000100:00100000:0.0:1746142910.953388:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.953481:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371520 00000100:00100000:3.0:1746142910.953489:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371520 00002000:00100000:3.0:1746142910.953525:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cd5f100 x1830962867371520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142910.953534:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f100 with x1830962867371520 ext(4194304->5033983) 00002000:00010000:3.0:1746142910.953538:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5f100 00000100:00100000:3.0:1746142910.953568:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4375 00000100:00100000:3.0:1746142910.953575:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867371520:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142910.975956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.976018:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.976344:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867371520:12345-192.168.204.50@tcp:3:cat.0 Request processed in 22766us (22961us total) trans 0 rc 839680/839680 00000100:00100000:1.0:1746142910.976353:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4375 00002000:00100000:1.0:1746142910.976374:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cd5f100 x1830962867371520/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:61/0 lens 488/440 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.976383:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f100 with x1830962867371520 ext(4194304->5033983) 00002000:00010000:1.0:1746142910.976387:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5f100 00000100:00100000:3.0:1746142910.976558:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371648 00000100:00100000:3.0:1746142910.976564:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371648 00000100:00100000:3.0:1746142910.976590:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371776 00000100:00100000:3.0:1746142910.976593:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371776 00000100:00100000:2.0:1746142910.976606:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14206 00000100:00100000:2.0:1746142910.976615:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867371648:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142910.976616:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14207 00000100:00100000:3.0:1746142910.976622:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32402:x1830962867371776:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142910.976628:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.976629:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.976640:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a799 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.976640:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a792 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.976657:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142910.976658:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.976660:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.976664:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 44 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.976667:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 44 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.976672:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.976673:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.976676:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.976676:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 44 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142910.976684:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3800, rc 0) 00000100:00100000:2.0:1746142910.976705:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867371648:12345-192.168.204.50@tcp:101:cat.0 Request processed in 93us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.976710:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14206 00010000:00010000:3.0:1746142910.977117:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 43 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.977128:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 43 pid: 11943 timeout: 784 lvb_type: 1 00000100:00100000:3.0:1746142910.977143:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867811200:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.982704:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 18 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.982719:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 18 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.982731:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867811328:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142910.982779:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142910.984863:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.984947:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867371904 00000100:00100000:3.0:1746142910.984954:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867371904 00000100:00100000:3.0:1746142910.984993:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14435 00000100:00100000:3.0:1746142910.985000:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+19:32406:x1830962867371904:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142910.985020:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.985034:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067cccfaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7a0 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.985078:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985088:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985097:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985108:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985114:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985119:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985173:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985183:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.985189:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 61 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.985195:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 5/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.985217:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 61 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.985227:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 61 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.985236:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867811456:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142910.988711:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.988727:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 29 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:3.0:1746142910.988743:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867811584:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.989014:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867811200:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.989024:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867811328:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142910.989027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142910.989048:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 43 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142910.989060:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142910.989061:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601200, rc 0) 00000100:00100000:0.0:1746142910.989082:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372032 00000100:00100000:2.0:1746142910.989087:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32402:x1830962867371776:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 12465us (13068us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142910.989087:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372032 00000100:00100000:2.0:1746142910.989094:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14207 00010000:00010000:0.0:1746142910.989108:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 43 pid: 11943 timeout: 784 lvb_type: 1 00000100:00100000:2.0:1746142910.989116:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372160 00000100:00100000:2.0:1746142910.989119:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372160 00000100:00100000:0.0:1746142910.989129:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6396 00010000:00010000:2.0:1746142910.989131:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 19 pid: 1853 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746142910.989136:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867372032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142910.989145:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142910.989149:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6397 00000100:00100000:2.0:1746142910.989153:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867372160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142910.989159:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142910.989165:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 43 pid: 11943 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.989166:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 19 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.989174:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 43 pid: 11943 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.989183:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 19 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.989235:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbbe00/0x2fa243e067cccf09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a71b expref: 43 pid: 11943 timeout: 784 lvb_type: 1 00010000:00010000:2.0:1746142910.989240:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0a0000/0x2fa243e067cccebc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6f8 expref: 19 pid: 1853 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.989248:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142910.989250:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142910.989256:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.989263:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142910.989270:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142910.989281:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.989283:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867372160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.989287:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6397 00000100:00100000:0.0:1746142910.989289:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867811712:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142910.989312:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.989886:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142910.990422:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867811456:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142910.992195:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.992264:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.992279:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372288 00000100:00100000:2.0:1746142910.992284:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372288 00010000:00010000:2.0:1746142910.992305:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 62 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746142910.992318:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372416 00000100:00100000:0.0:1746142910.992322:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372416 00000100:00100000:2.0:1746142910.992327:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6398 00000100:00100000:2.0:1746142910.992333:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+62:2005:x1830962867372288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142910.992338:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 30 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.992341:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.992346:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 62 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:2.0:1746142910.992355:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 62 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:0.0:1746142910.992366:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6399 00000100:00100000:0.0:1746142910.992372:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867372416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142910.992378:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142910.992382:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cccf79 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a77d expref: 62 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.992382:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 30 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.992390:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 30 pid: 10924 timeout: 784 lvb_type: 0 00000100:00100000:1.0:1746142910.992448:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867811712:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142910.992460:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142910.992490:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867372032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3354us (3463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.992501:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6396 00000100:00100000:3.0:1746142910.992534:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867811584:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142910.992942:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142910.992947:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.992958:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.992962:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142910.992966:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142910.992988:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+61:2005:x1830962867372288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 656us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142910.992994:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6398 00010000:00010000:0.0:1746142910.993058:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130600e00/0x2fa243e067cccf41 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a74c expref: 30 pid: 10924 timeout: 784 lvb_type: 0 00010000:00010000:0.0:1746142910.993071:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142910.993075:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993081:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993088:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.993119:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142910.993148:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142910.993177:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867372416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 804us (911us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142910.993177:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142910.993183:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6399 00010000:00010000:0.0:1746142910.993183:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142910.993219:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00000004:00200000:0.0:1746142910.993222:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142910.993235:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993243:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993251:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993256:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993261:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993267:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993271:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982c6e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142910.993275:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993280:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993286:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142910.993288:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142910.993291:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993295:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067cccfb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993304:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993308:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993312:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993316:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800982c7c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142910.993318:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993322:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993326:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4200) 00010000:00010000:0.0:1746142910.993328:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142910.993330:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993334:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7c00/0x2fa243e067cccfb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142910.993367:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6000/0x2fa243e067cccfaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.993377:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 20 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142910.993383:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142910.993386:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142910.993388:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009236a200, rc 0) 00000100:00100000:0.0:1746142910.993410:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:32406:x1830962867371904:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 8410us (8553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142910.993416:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14435 00000100:00100000:1.0:1746142910.997944:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.997977:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.997996:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142910.998021:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142910.998034:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372544 00000100:00100000:1.0:1746142910.998036:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867373056 00000100:00100000:2.0:1746142910.998042:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372544 00000100:00100000:1.0:1746142910.998042:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867373056 00000100:00100000:2.0:1746142910.998072:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372672 00000100:00100000:2.0:1746142910.998074:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372672 00002000:00100000:1.0:1746142910.998079:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1855488->1859583) req@ffff880096af3800 x1830962867373056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/0 e 0 to 0 dl 1746142921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142910.998084:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867372800 00000100:00100000:2.0:1746142910.998086:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867372800 00002000:00100000:1.0:1746142910.998089:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3800 with x1830962867373056 ext(1855488->1859583) 00002000:00010000:1.0:1746142910.998094:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af3800 00000100:00100000:1.0:1746142910.998113:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4376 00000100:00100000:1.0:1746142910.998119:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867373056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142910.998225:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14208 00000100:00100000:3.0:1746142910.998233:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+7:2003:x1830962867372544:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:1.0:1746142910.998234:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867373056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 115us (212us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142910.998239:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4376 00010000:00010000:3.0:1746142910.998242:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746142910.998244:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1855488->1859583) req@ffff880096af3800 x1830962867373056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:61/0 lens 488/4536 e 0 to 0 dl 1746142921 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142910.998250:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3800 with x1830962867373056 ext(1855488->1859583) 00002000:00010000:1.0:1746142910.998253:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af3800 00010000:00010000:3.0:1746142910.998254:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7a7 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.998271:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.998273:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.998280:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142910.998280:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142910.998293:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142910.998293:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867373184 00000100:00100000:1.0:1746142910.998296:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867373184 00010000:00010000:3.0:1746142910.998307:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82a00, rc 0) 00000100:00100000:1.0:1746142910.998310:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14209 00000100:00100000:1.0:1746142910.998314:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867372672:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142910.998321:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142910.998330:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867372544:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 98us (394us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142910.998330:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7ae expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142910.998335:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14208 00010000:00010000:1.0:1746142910.998340:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142910.998341:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142910.998346:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14210 00010000:00010000:1.0:1746142910.998346:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142910.998350:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867373184:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142910.998355:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.998371:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7bc expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142910.998371:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142910.998379:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714c00, rc 0) 00010000:00010000:3.0:1746142910.998380:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.998382:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.998386:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.998394:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142910.998394:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867372672:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 79us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142910.998399:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14209 00010000:00010000:3.0:1746142910.998401:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83600, rc 0) 00000100:00100000:3.0:1746142910.998415:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867373184:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.998420:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14210 00000100:00100000:3.0:1746142910.998472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142910.998485:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867373312 00000100:00100000:3.0:1746142910.998487:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867373312 00000100:00100000:3.0:1746142910.998509:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14211 00000100:00100000:3.0:1746142910.998514:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867373312:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142910.998520:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142910.998526:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7c3 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142910.998536:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.998538:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142910.998542:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.998550:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142910.998556:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82c00, rc 0) 00000100:00100000:3.0:1746142910.998570:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867373312:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 56us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142910.998575:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14211 00000100:00100000:2.0:1746142910.999070:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14212 00000100:00100000:2.0:1746142910.999080:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867372800:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142910.999087:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142910.999094:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cccfe2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7b5 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142910.999123:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867811840:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142910.999186:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.000092:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.000207:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867373568 00000100:00100000:1.0:1746142911.000211:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867373568 00002000:00100000:1.0:1746142911.000231:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009cd5f800 x1830962867373568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 504/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.000239:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f800 with x1830962867373568 ext(1048576->2097151) 00002000:00010000:1.0:1746142911.000242:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5f800 00000100:00100000:1.0:1746142911.000262:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4377 00000100:00100000:1.0:1746142911.000266:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867373568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142911.009000:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867811840:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142911.009035:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cccfe2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7b5 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.009053:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cccfe2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7b5 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.009068:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3e00, rc 0) 00000100:00100000:2.0:1746142911.009129:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867372800:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10047us (11129us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.009136:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14212 00000100:00100000:1.0:1746142911.010606:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867373568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10335us (10511us total) trans 0 rc 1044480/1044480 00000100:00100000:1.0:1746142911.010614:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4377 00002000:00100000:1.0:1746142911.010622:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009cd5f800 x1830962867373568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 504/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.010630:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f800 with x1830962867373568 ext(1048576->2097151) 00002000:00010000:1.0:1746142911.010634:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5f800 00000100:00100000:0.0:1746142911.012706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.013184:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867373824 00000100:00100000:2.0:1746142911.013190:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867373824 00000100:00100000:2.0:1746142911.013450:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14436 00000100:00100000:2.0:1746142911.013457:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:32406:x1830962867373824:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142911.013472:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.013486:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2200/0x2fa243e067cccfe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7ca expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.013564:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.013576:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.013584:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.013608:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.013622:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 21 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.013632:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867811968:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.014087:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.018054:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.019438:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.019632:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867373952 00000100:00100000:3.0:1746142911.019639:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867373952 00000100:00100000:2.0:1746142911.019704:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374080 00000100:00100000:2.0:1746142911.019706:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374080 00000100:00100000:3.0:1746142911.019880:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14213 00000100:00100000:3.0:1746142911.019886:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32402:x1830962867373952:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142911.019913:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.019926:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7d1 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.019950:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.019957:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.019963:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 7 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.019968:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.019973:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.019978:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142911.019979:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142911.019982:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 8/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.020003:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.020012:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 17 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.020022:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812096:192.168.204.50@tcp:104: 00000100:00080000:2.0:1746142911.020313:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746142911.020316:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746142911.020344:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867811968:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.020371:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142911.020402:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14214 00000100:00100000:2.0:1746142911.020407:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:32396:x1830962867374080:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.020414:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.020424:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7d8 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.020437:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.020446:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 11 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.020453:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 22 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.020461:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.020462:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.020464:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [4071424->4194303] (req 4071424->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.020476:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 22 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.020486:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 22 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746142911.020494:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867812224:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.020524:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 11 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.020535:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 11 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746142911.020545:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867812352:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.020564:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.020575:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 40 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.020587:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867812480:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.020603:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746142911.020829:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.020837:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 43 pid: 1854 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.020845:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812608:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.021084:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 7 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.021093:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 7 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.021101:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812736:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.021419:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.021426:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.021434:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812864:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.022253:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.022260:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 43 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.022272:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812992:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.022287:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.022588:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.022638:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.022804:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374208 00000100:00100000:3.0:1746142911.022809:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374208 00010000:00010000:3.0:1746142911.022827:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 22 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.023156:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374464 00000100:00100000:1.0:1746142911.023160:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374464 00002000:00100000:1.0:1746142911.023180:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cfec000 x1830962867374464/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.023188:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec000 with x1830962867374464 ext(4194304->5033983) 00010000:00010000:1.0:1746142911.023193:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 44 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.023201:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 44 pid: 1854 timeout: 785 lvb_type: 1 00002000:00010000:1.0:1746142911.023207:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cfec000 00000100:00100000:3.0:1746142911.023239:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6400 00000100:00100000:3.0:1746142911.023245:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+22:2005:x1830962867374208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.023253:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.023258:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 22 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.023265:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 22 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.023280:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009236a200/0x2fa243e067cccfbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a0 expref: 22 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.023293:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.023297:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.023304:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.023309:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00000100:00100000:1.0:1746142911.023528:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1357 00000100:00100000:1.0:1746142911.023534:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2003:x1830962867374464:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142911.024097:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.024119:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+21:2005:x1830962867374208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 874us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.024126:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6400 00010000:00010000:3.0:1746142911.024150:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.024156:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142911.024170:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142911.024261:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc2200/0x2fa243e067cccfe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ca expref: 22 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.024273:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ca expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.024279:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.024282:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142911.024283:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3200, rc 0) 00000100:00100000:3.0:1746142911.024300:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+21:32406:x1830962867373824:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10845us (11600us total) trans 8589936599 rc 0/0 00000100:00100000:3.0:1746142911.024306:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14436 00000100:00100000:0.0:1746142911.025276:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.025368:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812096:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.025382:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374592 00000100:00100000:3.0:1746142911.025386:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374592 00000100:00100000:2.0:1746142911.027076:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867812224:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.027182:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 18 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.027213:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6401 00000100:00100000:3.0:1746142911.027220:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867374592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.027230:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.027245:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 18 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.027254:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 18 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.027272:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130600/0x2fa243e067cccf87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a776 expref: 18 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.027284:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.027310:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867374592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.027314:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6401 00000100:00080000:2.0:1746142911.027545:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142911.028852:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.028878:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.028896:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374720 00000100:00100000:0.0:1746142911.028896:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.028920:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374720 00010000:00010000:1.0:1746142911.028941:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 23 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.028957:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867375232 00000100:00100000:1.0:1746142911.028959:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867375232 00000100:00100000:2.0:1746142911.028978:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374848 00000100:00100000:2.0:1746142911.028982:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374848 00000100:00080000:1.0:1746142911.028983:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746142911.028994:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 41 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.029006:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00000100:00080000:1.0:1746142911.029006:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746142911.029015:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6402 00000100:00100000:1.0:1746142911.029021:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867374720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.029032:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.029044:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 23 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.029052:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 23 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.029058:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812608:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.029065:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812736:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142911.029067:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094714400/0x2fa243e067cccf6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a76f expref: 23 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.029071:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812864:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.029076:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867812992:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142911.029080:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.029104:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867374720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (255us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142911.029105:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->2445311] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 45 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.029123:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82e00, rc 0) 00000100:00100000:2.0:1746142911.029169:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6403 00000100:00100000:2.0:1746142911.029176:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867375232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142911.029314:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6402 00000100:00100000:1.0:1746142911.029335:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6404 00000100:00100000:1.0:1746142911.029340:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867374848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.029506:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.029507:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.029515:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746142911.029517:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 41 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.029524:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.029552:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32402:x1830962867373952:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9666us (11505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.029558:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14213 00010000:00010000:2.0:1746142911.029833:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 41 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.029880:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.029882:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.029887:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.029915:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.029923:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.029939:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867375232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 765us (1061us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142911.029939:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.029945:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6403 00000100:00100000:1.0:1746142911.029950:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867813120:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.029973:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82c00/0x2fa243e067cccfdb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7c3 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746142911.029988:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867812352:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142911.029994:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746142911.030009:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2a00/0x2fa243e067cccf2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a73e expref: 40 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.030016:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867812480:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.030034:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 21 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.030040:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600800, rc 0) 00000100:00100000:2.0:1746142911.030053:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:32396:x1830962867374080:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9647us (10616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.030058:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14214 00000100:00100000:3.0:1746142911.030154:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.030168:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.030195:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.030366:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867375104 00000100:00100000:1.0:1746142911.030370:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867375104 00010000:00010000:1.0:1746142911.030382:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 45 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.030404:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867374976 00000100:00100000:1.0:1746142911.030406:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867374976 00000100:00080000:1.0:1746142911.030420:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746142911.030431:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 8 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.030439:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867375360 00000100:00100000:1.0:1746142911.030440:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867375360 00010000:00010000:1.0:1746142911.030446:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.030454:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6405 00000100:00100000:1.0:1746142911.030458:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867375104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.030466:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.030474:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 45 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.030481:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 45 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.030493:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbba00/0x2fa243e067cccf25 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a737 expref: 45 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.030501:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.030514:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867375104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.030519:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6405 00000100:00100000:1.0:1746142911.030527:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6406 00000100:00100000:1.0:1746142911.030531:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867374976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.030536:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.030542:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 8 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.030548:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 8 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.030558:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cccfd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7bc expref: 8 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.030568:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.030580:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867374976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 48us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.030585:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6406 00000100:00100000:1.0:1746142911.030593:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6407 00000100:00100000:1.0:1746142911.030597:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867375360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.030603:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.030607:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.030615:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.030624:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cccf95 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5033983) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a78b expref: 17 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.030631:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.030642:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867375360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 44us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.030647:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6407 00000100:00100000:0.0:1746142911.031199:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.031257:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867375616 00000100:00100000:3.0:1746142911.031260:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867375616 00000100:00100000:3.0:1746142911.031282:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14437 00000100:00100000:3.0:1746142911.031287:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+21:32406:x1830962867375616:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142911.031300:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.031302:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746142911.031314:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3200/0x2fa243e067cccff0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ca expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.031323:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.031326:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142911.031334:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3e400/0x2fa243e067ccd00c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7df expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.031413:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031424:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031434:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031444:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031450:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031454:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031458:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bd3fe00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142911.031462:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031467:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031473:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.031476:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142911.031478:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031482:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3fe00/0x2fa243e067ccd013 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.031500:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3e400/0x2fa243e067ccd00c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7df expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.031506:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd3e400/0x2fa243e067ccd00c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7df expref: 21 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.031516:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e400, rc 0) 00000100:00100000:3.0:1746142911.031533:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+20:32406:x1830962867375616:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 246us (335us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.031538:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14437 00000100:00100000:0.0:1746142911.031784:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867374464:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8250us (9145us total) trans 0 rc 839680/839680 00000100:00100000:0.0:1746142911.031790:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1357 00002000:00100000:0.0:1746142911.031797:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5033983) req@ffff88009cfec000 x1830962867374464/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.031805:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec000 with x1830962867374464 ext(4194304->5033983) 00010000:00010000:0.0:1746142911.031810:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 42 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746142911.031819:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 42 pid: 1854 timeout: 785 lvb_type: 1 00002000:00010000:0.0:1746142911.031830:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cfec000 00000100:00100000:1.0:1746142911.032417:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867813120:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.032430:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.032448:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867374848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3107us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.032456:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6404 00000100:00100000:0.0:1746142911.032618:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.032647:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867375872 00000100:00100000:0.0:1746142911.032650:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867375872 00002000:00100000:0.0:1746142911.032668:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4071424->4075519) req@ffff88009cfec700 x1830962867375872/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.032674:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec700 with x1830962867375872 ext(4071424->4075519) 00002000:00010000:0.0:1746142911.032677:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfec700 00000100:00100000:0.0:1746142911.032699:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4378 00000100:00100000:0.0:1746142911.032704:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867375872:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142911.032772:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867375872:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 69us (154us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142911.032777:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4378 00002000:00100000:0.0:1746142911.032781:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (4071424->4075519) req@ffff88009cfec700 x1830962867375872/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.032787:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec700 with x1830962867375872 ext(4071424->4075519) 00002000:00010000:0.0:1746142911.032790:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfec700 00000100:00100000:0.0:1746142911.034585:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.036227:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867376128 00000100:00100000:3.0:1746142911.036235:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867376128 00000100:00100000:0.0:1746142911.036562:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.036600:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867376256 00000100:00100000:2.0:1746142911.036604:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867376256 00000100:00100000:2.0:1746142911.036628:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14215 00000100:00100000:2.0:1746142911.036633:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867376256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.036647:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.036660:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067ccd01a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7e6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.036679:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.036688:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067ccd01a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7e6 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.036702:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067ccd01a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7e6 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.036711:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6800, rc 0) 00000100:00100000:3.0:1746142911.036728:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5261 00000100:00100000:3.0:1746142911.036734:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+20:32406:x1830962867376128:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:0.0:1746142911.037087:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.037507:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867376256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 872us (945us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.037508:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+21:32406:x1830962867376128:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 772us (2925us total) trans 8589936600 rc 0/0 00000100:00100000:3.0:1746142911.037513:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5261 00000100:00100000:2.0:1746142911.037513:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14215 00000100:00100000:2.0:1746142911.037633:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867376384 00000100:00100000:2.0:1746142911.037636:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867376384 00000100:00100000:2.0:1746142911.037653:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14216 00000100:00100000:2.0:1746142911.037657:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867376384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.037663:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142911.037666:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142911.037671:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067ccd021 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7ed expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142911.037678:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867376512 00000100:00100000:0.0:1746142911.037681:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867376512 00000100:00100000:0.0:1746142911.037695:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14217 00000100:00100000:0.0:1746142911.037700:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:32396:x1830962867376512:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:2.0:1746142911.037701:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867813248:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142911.037706:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142911.037711:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7f4 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.037720:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.037722:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.037725:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->5066751] (req 4194304->5066751) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 17 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.037733:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->5066751] (req 4194304->5066751) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 17 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.037735:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746142911.037740:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba000, rc 0) 00000100:00100000:0.0:1746142911.037752:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:32396:x1830962867376512:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 52us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.037757:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14217 00000100:00100000:2.0:1746142911.038938:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867813248:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142911.038956:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067ccd021 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ed expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.038964:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067ccd021 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ed expref: 41 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.038974:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7c00, rc 0) 00000100:00100000:2.0:1746142911.039488:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867376384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1830us (2400us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.039494:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14216 00000100:00100000:0.0:1746142911.040455:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.040529:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867376640 00000100:00100000:1.0:1746142911.040534:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867376640 00010000:00010000:1.0:1746142911.040556:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 42 pid: 1854 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.040574:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6408 00000100:00100000:1.0:1746142911.040579:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867376640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.040589:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.040600:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 42 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.040610:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 42 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.040626:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3800/0x2fa243e067cccf9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a792 expref: 42 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.040743:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.040745:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.040751:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.040759:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.040767:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.040768:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.040772:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.040778:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.040799:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.040807:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867813376:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.040870:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 41 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.040877:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867813504:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142911.040891:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.041265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.041428:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867376768 00000100:00100000:3.0:1746142911.041432:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867376768 00000100:00100000:3.0:1746142911.041451:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14218 00000100:00100000:3.0:1746142911.041456:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32405:x1830962867376768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.041466:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.041475:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a7fb expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.041488:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.041494:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142911.041496:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142911.041499:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 43 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.041513:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.041523:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 16 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.041531:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867813632:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.041557:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069600 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.043850:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867813376:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142911.043860:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867813504:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.043875:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.043922:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867376640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3342us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.043930:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6408 00000100:00100000:3.0:1746142911.044455:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867813632:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.044472:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->5242879] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 42 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.044484:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3ea00, rc 0) 00000100:00100000:3.0:1746142911.044516:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32405:x1830962867376768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3059us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.044522:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14218 00000100:00100000:0.0:1746142911.048600:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.048686:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867377024 00000100:00100000:2.0:1746142911.048693:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867377024 00002000:00100000:2.0:1746142911.048731:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2441216->2445311) req@ffff8800949d1500 x1830962867377024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.048740:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1500 with x1830962867377024 ext(2441216->2445311) 00002000:00010000:2.0:1746142911.048744:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d1500 00000100:00100000:2.0:1746142911.048761:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4379 00000100:00100000:2.0:1746142911.048767:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867377024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142911.049050:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867377024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 282us (456us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142911.049056:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4379 00002000:00100000:2.0:1746142911.049062:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2441216->2445311) req@ffff8800949d1500 x1830962867377024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.049068:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1500 with x1830962867377024 ext(2441216->2445311) 00002000:00010000:2.0:1746142911.049071:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d1500 00000100:00100000:0.0:1746142911.049483:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.049610:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.049654:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867377280 00000100:00100000:2.0:1746142911.049658:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867377280 00002000:00100000:2.0:1746142911.049672:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066591) req@ffff8800949d1880 x1830962867377280/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.049683:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1880 with x1830962867377280 ext(4194304->5066591) 00010000:00010000:2.0:1746142911.049689:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 17 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.049701:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 17 pid: 1397 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.049706:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949d1880 00000100:00100000:2.0:1746142911.049717:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1358 00000100:00100000:2.0:1746142911.049722:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867377280:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142911.049973:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867377536 00000100:00100000:3.0:1746142911.049977:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867377536 00000100:00080000:0.0:1746142911.050015:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142911.050462:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5262 00000100:00100000:3.0:1746142911.050467:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4850c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:32396:x1830962867377536:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142911.051094:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4850c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:32396:x1830962867377536:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 625us (1482us total) trans 8589936601 rc 0/0 00000100:00100000:3.0:1746142911.051100:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5262 00000100:00100000:1.0:1746142911.055437:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.056141:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867377792 00000100:00100000:3.0:1746142911.056147:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867377792 00000100:00100000:3.0:1746142911.056217:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5263 00000100:00100000:3.0:1746142911.056224:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+61:32402:x1830962867377792:12345-192.168.204.50@tcp:35:multiop.0 00000100:00080000:0.0:1746142911.056386:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142911.057343:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+62:32402:x1830962867377792:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 1117us (1911us total) trans 8589936602 rc 0/0 00000100:00100000:3.0:1746142911.057351:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5263 00000100:00100000:2.0:1746142911.059525:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867377280:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 9797us (10036us total) trans 21474841189 rc 0/0 00000100:00100000:2.0:1746142911.059534:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1358 00002000:00100000:2.0:1746142911.059543:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066591) req@ffff8800949d1880 x1830962867377280/t21474841189(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.059552:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1880 with x1830962867377280 ext(4194304->5066591) 00010000:00010000:2.0:1746142911.059560:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 20 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.059573:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 20 pid: 1397 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.059580:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800949d1880 00000100:00100000:0.0:1746142911.064234:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.064529:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867377920 00000100:00100000:1.0:1746142911.064537:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867377920 00010000:00010000:1.0:1746142911.064564:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 20 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.064594:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6409 00000100:00100000:1.0:1746142911.064600:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867377920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.064611:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746142911.064625:0:13297:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5032768 -> 5066592 00002000:00010000:1.0:1746142911.064628:0:13297:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5744 -> 5808 00010000:00010000:1.0:1746142911.064633:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 20 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.064643:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 20 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.064662:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fba000/0x2fa243e067ccd028 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7f4 expref: 20 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.064723:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.064724:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.064731:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.064737:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.064765:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 41 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.064780:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867813760:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142911.065178:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.068282:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.068463:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.068494:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867813760:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.068513:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.068556:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867377920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3954us (4327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.068565:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6409 00000100:00100000:1.0:1746142911.068598:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867378048 00000100:00100000:1.0:1746142911.068603:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867378048 00000100:00100000:3.0:1746142911.068607:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867378176 00000100:00100000:3.0:1746142911.068609:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867378176 00000100:00100000:1.0:1746142911.068632:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14219 00000100:00100000:3.0:1746142911.068638:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14220 00000100:00100000:1.0:1746142911.068638:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867378048:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142911.068642:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867378176:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.068651:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.068651:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.068663:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e200/0x2fa243e067ccd03d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a809 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.068663:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094715e00/0x2fa243e067ccd036 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a802 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.068683:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094715e00/0x2fa243e067ccd036 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a802 expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.068691:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094715e00/0x2fa243e067ccd036 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a802 expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142911.068697:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867813888:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142911.068699:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715e00, rc 0) 00000100:00100000:1.0:1746142911.068712:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867378048:12345-192.168.204.50@tcp:101:cat.0 Request processed in 75us (439us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142911.068720:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14219 00000100:00100000:3.0:1746142911.068736:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.070624:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867813888:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.070644:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e200/0x2fa243e067ccd03d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a809 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.070655:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e200/0x2fa243e067ccd03d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a809 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.070786:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e200, rc 0) 00000100:00100000:3.0:1746142911.072352:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867378176:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3702us (3883us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.072370:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14220 00000100:00100000:0.0:1746142911.074449:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.074534:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867378432 00000100:00100000:2.0:1746142911.074542:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867378432 00002000:00100000:2.0:1746142911.074577:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5066751) req@ffff8800949d0380 x1830962867378432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.074587:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0380 with x1830962867378432 ext(5029888->5066751) 00002000:00010000:2.0:1746142911.074591:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0380 00000100:00100000:2.0:1746142911.074616:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4380 00000100:00100000:2.0:1746142911.074622:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867378432:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142911.076249:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867378432:12345-192.168.204.50@tcp:3:cat.0 Request processed in 1622us (1802us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1746142911.076257:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4380 00002000:00100000:2.0:1746142911.076263:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (5029888->5066751) req@ffff8800949d0380 x1830962867378432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 36864/36864 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.076271:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0380 with x1830962867378432 ext(5029888->5066751) 00002000:00010000:2.0:1746142911.076275:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0380 00010000:00010000:2.0:1746142911.110380:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142911.175101:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.175182:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867378688 00000100:00100000:2.0:1746142911.175193:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867378688 00000100:00100000:2.0:1746142911.175244:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14438 00000100:00100000:2.0:1746142911.175251:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+30:32413:x1830962867378688:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.175275:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.175291:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067ccd044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a810 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.175378:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142911.175395:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142911.175404:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142911.175413:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:2.0:1746142911.175489:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c6e00/0x2fa243e067ccd044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 33 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.175520:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 32 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.175527:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142911.175530:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142911.175532:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7400, rc 0) 00000100:00100000:2.0:1746142911.175586:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:32413:x1830962867378688:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 332us (488us total) trans 8589936603 rc 0/0 00000100:00100000:2.0:1746142911.175596:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14438 00000100:00100000:0.0:1746142911.180235:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.180407:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867378816 00000100:00100000:3.0:1746142911.180414:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867378816 00000100:00100000:3.0:1746142911.180463:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14221 00000100:00100000:3.0:1746142911.180470:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:32413:x1830962867378816:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142911.180486:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.180500:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a817 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.180526:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.180534:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 39 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.180540:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142911.180541:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142911.180545:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->2748415] (req 2695168->2748415) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.180569:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 39 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.180579:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 39 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.180590:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867814016:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.181125:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 22 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.181134:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 22 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.181142:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867814144:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.181211:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.183247:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867814144:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142911.184008:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.184217:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867378944 00000100:00100000:1.0:1746142911.184222:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867378944 00010000:00010000:1.0:1746142911.184248:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 23 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.184268:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6410 00000100:00100000:1.0:1746142911.184274:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867378944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.184283:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.184299:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 23 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.184307:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 23 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.184325:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097107000/0x2fa243e067cccc38 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a55b expref: 23 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.184366:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.184405:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867378944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 123us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.184412:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6410 00000100:00100000:3.0:1746142911.184500:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867814016:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.184523:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->2748415] (req 2695168->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.184534:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e800, rc 0) 00000100:00100000:3.0:1746142911.184572:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:32413:x1830962867378816:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4102us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.184578:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14221 00000100:00100000:0.0:1746142911.188837:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.188880:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379072 00000100:00100000:2.0:1746142911.188887:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379072 00010000:00010000:2.0:1746142911.188932:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 40 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.188958:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6411 00000100:00100000:2.0:1746142911.188963:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867379072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.188971:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.188984:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 40 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.188993:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 40 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.189007:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067cccd49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a603 expref: 40 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.189021:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.189022:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.189028:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.189034:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.189058:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.189069:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867814272:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.189137:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.191265:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.191269:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867814272:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.191285:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.191321:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867379072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2357us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.191330:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6411 00000100:00100000:3.0:1746142911.191439:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379328 00000100:00100000:3.0:1746142911.191446:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379328 00002000:00100000:3.0:1746142911.191474:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2744320->2748415) req@ffff880096af3100 x1830962867379328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.191483:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3100 with x1830962867379328 ext(2744320->2748415) 00002000:00010000:3.0:1746142911.191487:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af3100 00000100:00100000:3.0:1746142911.191514:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4381 00000100:00100000:3.0:1746142911.191520:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867379328:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142911.191630:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867379328:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 110us (369us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142911.191636:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4381 00002000:00100000:3.0:1746142911.191640:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2744320->2748415) req@ffff880096af3100 x1830962867379328/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.191647:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3100 with x1830962867379328 ext(2744320->2748415) 00002000:00010000:3.0:1746142911.191649:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af3100 00000100:00100000:0.0:1746142911.217712:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.217803:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379456 00000100:00100000:3.0:1746142911.217811:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379456 00000100:00100000:3.0:1746142911.217848:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14222 00000100:00100000:3.0:1746142911.217855:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867379456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.217875:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.217890:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccd060 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a81e expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.217963:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867814400:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142911.218460:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.219175:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.219222:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379584 00000100:00100000:2.0:1746142911.219227:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379584 00000100:00100000:0.0:1746142911.219228:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.220401:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379712 00000100:00100000:2.0:1746142911.220406:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379712 00000100:00100000:2.0:1746142911.220430:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14223 00000100:00100000:2.0:1746142911.220442:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867379584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.220453:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.220464:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c6e00/0x2fa243e067ccd067 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a825 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.220488:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c6e00/0x2fa243e067ccd067 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a825 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.220497:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982c6e00/0x2fa243e067ccd067 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a825 expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.220509:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6e00, rc 0) 00000100:00100000:3.0:1746142911.220557:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14224 00000100:00100000:3.0:1746142911.220565:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867379712:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.220574:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.220582:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccd06e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a82c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.220613:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867814528:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142911.220650:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.220689:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867814400:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.220704:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccd060 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a81e expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.220712:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccd060 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a81e expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142911.220712:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867379584:12345-192.168.204.50@tcp:101:cat.0 Request processed in 105us (1368us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.220720:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14223 00010000:00010000:3.0:1746142911.220728:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:3.0:1746142911.220745:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867379456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2891us (3043us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.220750:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14222 00000100:00100000:3.0:1746142911.223483:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867814528:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.223506:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccd06e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a82c expref: 22 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.223517:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccd06e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a82c expref: 22 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.223524:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82000, rc 0) 00000100:00100000:3.0:1746142911.223568:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867379712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3003us (4338us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.223574:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14224 00000100:00100000:0.0:1746142911.230067:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.230549:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379840 00000100:00100000:3.0:1746142911.230557:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379840 00000100:00100000:3.0:1746142911.230768:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14225 00000100:00100000:3.0:1746142911.230776:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+19:32417:x1830962867379840:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.230792:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.230806:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a833 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.230833:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.230839:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142911.230841:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142911.230843:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.230867:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.230877:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.230888:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867814656:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.234118:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.238446:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867814656:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.238472:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.238485:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83600, rc 0) 00000100:00100000:3.0:1746142911.238521:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+20:32417:x1830962867379840:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7745us (8461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.238530:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14225 00000100:00100000:0.0:1746142911.239153:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.239446:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867379968 00000100:00100000:1.0:1746142911.239453:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867379968 00002000:00100000:1.0:1746142911.239483:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1855488->2097151) req@ffff880088fd8a80 x1830962867379968/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.239498:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8a80 with x1830962867379968 ext(1855488->2097151) 00010000:00010000:1.0:1746142911.239504:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 42 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.239514:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 42 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.239519:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8a80 00000100:00100000:1.0:1746142911.239542:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1359 00000100:00100000:1.0:1746142911.239549:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867379968:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142911.244806:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867379968:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5248us (5644us total) trans 21474841190 rc 0/0 00000100:00100000:1.0:1746142911.244817:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1359 00002000:00100000:1.0:1746142911.244828:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1855488->2097151) req@ffff880088fd8a80 x1830962867379968/t21474841190(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.244835:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8a80 with x1830962867379968 ext(1855488->2097151) 00010000:00010000:1.0:1746142911.244844:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.244857:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.244863:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8a80 00000100:00100000:0.0:1746142911.248083:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.248183:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867380096 00000100:00100000:2.0:1746142911.248191:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867380096 00010000:00010000:2.0:1746142911.248222:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.248290:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6412 00000100:00100000:2.0:1746142911.248298:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867380096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.248310:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.248330:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.248340:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.248365:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067cccfa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a799 expref: 44 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.248390:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.248391:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.248397:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.248405:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.248431:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 19 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.248441:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867814784:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.248506:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.253780:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.253946:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867814784:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142911.253967:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.254002:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867380096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5705us (5925us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.254011:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6412 00000100:00100000:1.0:1746142911.254382:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867380352 00000100:00100000:1.0:1746142911.254388:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867380352 00002000:00100000:1.0:1746142911.254415:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800979b0380 x1830962867380352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.254424:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0380 with x1830962867380352 ext(1048576->2097151) 00002000:00010000:1.0:1746142911.254427:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b0380 00000100:00100000:1.0:1746142911.254450:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4382 00000100:00100000:1.0:1746142911.254456:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867380352:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.270561:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867380352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16096us (16780us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142911.270573:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4382 00002000:00100000:1.0:1746142911.270584:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800979b0380 x1830962867380352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.270593:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0380 with x1830962867380352 ext(1048576->2097151) 00002000:00010000:1.0:1746142911.270599:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b0380 00000100:00100000:2.0:1746142911.294050:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.294122:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867380736 00000100:00100000:3.0:1746142911.294130:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867380736 00000100:00100000:3.0:1746142911.294177:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14439 00000100:00100000:3.0:1746142911.294184:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+62:32419:x1830962867380736:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142911.294204:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.294219:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd07c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a841 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.294301:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.294314:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.294323:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142911.294332:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9227072 00010000:00010000:3.0:1746142911.294418:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd07c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 65 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.297035:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.297083:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867380480 00000100:00100000:2.0:1746142911.297089:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867380480 00000100:00100000:2.0:1746142911.297129:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14226 00000100:00100000:2.0:1746142911.297136:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+20:32417:x1830962867380480:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.297151:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.297164:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a83a expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.297186:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.297192:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.297194:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.297197:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.297219:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 42 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.297228:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 42 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.297238:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867814912:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.297315:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746142911.298553:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 64 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.298565:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.298568:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142911.298571:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83400, rc 0) 00000100:00100000:3.0:1746142911.298909:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+64:32419:x1830962867380736:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4713us (4854us total) trans 8589936604 rc 0/0 00000100:00100000:3.0:1746142911.298917:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14439 00000100:00100000:0.0:1746142911.303560:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.304131:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867380864 00000100:00100000:1.0:1746142911.304139:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867380864 00002000:00100000:1.0:1746142911.304177:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2445311) req@ffff880088fd8000 x1830962867380864/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.304186:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8000 with x1830962867380864 ext(2097152->2445311) 00010000:00010000:1.0:1746142911.304194:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 43 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.304205:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 43 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.304215:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8000 00000100:00100000:1.0:1746142911.304245:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1360 00000100:00100000:1.0:1746142911.304252:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867380864:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142911.305218:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867814912:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.305243:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.305256:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130c00, rc 0) 00000100:00100000:2.0:1746142911.305282:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+21:32417:x1830962867380480:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8145us (8253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.305289:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14226 00000100:00100000:1.0:1746142911.310038:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867380864:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5779us (6477us total) trans 21474841191 rc 0/0 00000100:00100000:1.0:1746142911.310048:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1360 00002000:00100000:1.0:1746142911.310059:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2445311) req@ffff880088fd8000 x1830962867380864/t21474841191(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.310067:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8000 with x1830962867380864 ext(2097152->2445311) 00010000:00010000:1.0:1746142911.310075:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 45 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.310089:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 45 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.310096:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fd8000 00000100:00100000:0.0:1746142911.313024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.313848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.314509:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.314868:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867381120 00000100:00100000:2.0:1746142911.314877:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867381120 00000100:00100000:1.0:1746142911.314991:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867380992 00000100:00100000:1.0:1746142911.314995:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867380992 00000100:00100000:1.0:1746142911.315013:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867381248 00000100:00100000:1.0:1746142911.315015:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867381248 00000100:00100000:1.0:1746142911.315034:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14227 00000100:00100000:1.0:1746142911.315041:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867381120:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142911.315056:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.315071:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccd098 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a84f expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.315097:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccd098 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a84f expref: 47 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.315107:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714a00/0x2fa243e067ccd098 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a84f expref: 47 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.315118:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714a00, rc 0) 00000100:00100000:1.0:1746142911.315156:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867381120:12345-192.168.204.50@tcp:101:cat.0 Request processed in 114us (2139us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142911.315161:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14227 00000100:00100000:1.0:1746142911.315173:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14228 00000100:00100000:1.0:1746142911.315178:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867380992:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142911.315183:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.315189:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a848 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.315199:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.315201:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.315207:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 46 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.315219:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 46 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.315227:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714000, rc 0) 00000100:00100000:1.0:1746142911.315240:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867380992:12345-192.168.204.50@tcp:101:cat.0 Request processed in 62us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.315245:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14228 00000100:00100000:1.0:1746142911.315255:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14229 00000100:00100000:1.0:1746142911.315259:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867381248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142911.315265:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.315274:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccd0a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a856 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.315306:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867815040:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142911.315362:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.317502:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.317564:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867381376 00000100:00100000:2.0:1746142911.317570:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867381376 00010000:00010000:2.0:1746142911.317593:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 46 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.317623:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6413 00000100:00100000:2.0:1746142911.317629:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867381376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.317638:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.317653:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 46 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.317663:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 46 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.317678:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067cccff7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 2097152->2445311) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d1 expref: 46 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.317700:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.317701:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.317706:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.317714:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.317741:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.317750:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867815168:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.317807:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.319547:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867815040:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142911.319573:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccd0a6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a856 expref: 40 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142911.319585:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715a00/0x2fa243e067ccd0a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a856 expref: 40 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142911.319614:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715a00, rc 0) 00000100:00100000:0.0:1746142911.319644:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867381248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4383us (5135us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142911.319652:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14229 00000100:00100000:0.0:1746142911.323202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.323281:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867815168:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.323300:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.323334:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a02450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867381376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5705us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.323342:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6413 00000100:00100000:1.0:1746142911.323428:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867381632 00000100:00100000:1.0:1746142911.323434:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867381632 00002000:00100000:1.0:1746142911.323461:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880097432300 x1830962867381632/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.323470:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432300 with x1830962867381632 ext(2097152->3145727) 00002000:00010000:1.0:1746142911.323474:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097432300 00000100:00100000:1.0:1746142911.323496:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4383 00000100:00100000:1.0:1746142911.323501:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867381632:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.337058:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867381632:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13547us (13853us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142911.337070:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4383 00002000:00100000:1.0:1746142911.337079:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880097432300 x1830962867381632/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.337089:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432300 with x1830962867381632 ext(2097152->3145727) 00002000:00010000:1.0:1746142911.337095:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097432300 00000100:00100000:0.0:1746142911.338970:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.339118:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867381888 00000100:00100000:1.0:1746142911.339126:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867381888 00002000:00100000:1.0:1746142911.339157:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880097430a80 x1830962867381888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.339166:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430a80 with x1830962867381888 ext(1048576->2097151) 00002000:00010000:1.0:1746142911.339170:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430a80 00000100:00100000:1.0:1746142911.339184:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4384 00000100:00100000:1.0:1746142911.339190:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867381888:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.348866:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867381888:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9667us (9892us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142911.348876:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4384 00002000:00100000:1.0:1746142911.348884:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880097430a80 x1830962867381888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.348893:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430a80 with x1830962867381888 ext(1048576->2097151) 00002000:00010000:1.0:1746142911.348919:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430a80 00000100:00100000:0.0:1746142911.349671:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.349730:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867382016 00000100:00100000:2.0:1746142911.349737:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867382016 00000100:00100000:2.0:1746142911.349782:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14230 00000100:00100000:2.0:1746142911.349789:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:32417:x1830962867382016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.349802:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.349816:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a85d expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.349839:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.349846:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.349848:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.349851:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 22 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.349879:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.349890:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.349931:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867815296:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.350006:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.350761:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867815296:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.350781:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 22 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.350791:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130600, rc 0) 00000100:00100000:2.0:1746142911.350825:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:32417:x1830962867382016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1037us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.350831:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14230 00000100:00100000:0.0:1746142911.351408:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.351781:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867382144 00000100:00100000:1.0:1746142911.351788:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867382144 00002000:00100000:1.0:1746142911.351820:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2695168->4194303) req@ffff880097430700 x1830962867382144/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 504/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.351829:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430700 with x1830962867382144 ext(2695168->4194303) 00010000:00010000:1.0:1746142911.351839:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.351850:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.351857:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097430700 00000100:00100000:1.0:1746142911.352399:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1361 00000100:00100000:1.0:1746142911.352408:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867382144:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142911.352839:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.352918:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867382272 00000100:00100000:3.0:1746142911.352922:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867382272 00000100:00100000:3.0:1746142911.352942:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14231 00000100:00100000:3.0:1746142911.352947:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32422:x1830962867382272:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.352955:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.352966:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a864 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.352981:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.352983:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.352989:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 46 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.353001:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 46 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.353009:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82e00, rc 0) 00000100:00100000:3.0:1746142911.353041:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32422:x1830962867382272:12345-192.168.204.50@tcp:101:cat.0 Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.353047:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14231 00000100:00100000:1.0:1746142911.357374:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867382144:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4942us (5941us total) trans 17179873927 rc 0/0 00000100:00100000:1.0:1746142911.357385:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1361 00002000:00100000:1.0:1746142911.357398:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2695168->4194303) req@ffff880097430700 x1830962867382144/t17179873927(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 504/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.357407:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430700 with x1830962867382144 ext(2695168->4194303) 00010000:00010000:1.0:1746142911.357423:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.357439:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.357445:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097430700 00000100:00100000:0.0:1746142911.358813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.358951:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867382400 00000100:00100000:2.0:1746142911.358959:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867382400 00010000:00010000:2.0:1746142911.358988:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.359034:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6414 00000100:00100000:2.0:1746142911.359043:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867382400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.359055:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.359069:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.359079:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.359095:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd059 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2695168->4071423] (req 2695168->2748415) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a817 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.359110:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.359111:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.359117:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.359123:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.359148:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.359158:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867815424:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.359401:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.361543:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867815424:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.361562:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.361624:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867382400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2582us (2815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.361632:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6414 00000100:00100000:0.0:1746142911.364145:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.364247:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.364310:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.364818:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867382656 00000100:00100000:3.0:1746142911.364828:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867382656 00002000:00100000:3.0:1746142911.364870:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880097433480 x1830962867382656/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.364879:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433480 with x1830962867382656 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.364885:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097433480 00000100:00100000:3.0:1746142911.365167:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867383040 00000100:00100000:3.0:1746142911.365173:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867383040 00002000:00100000:3.0:1746142911.365193:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880096141880 x1830962867383040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.365200:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141880 with x1830962867383040 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.365203:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141880 00000100:00100000:1.0:1746142911.365384:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867383168 00000100:00100000:1.0:1746142911.365389:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867383168 00002000:00100000:1.0:1746142911.365411:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096141180 x1830962867383168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.365419:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141180 with x1830962867383168 ext(3145728->4194303) 00002000:00010000:1.0:1746142911.365423:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096141180 00000100:00100000:1.0:1746142911.365444:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4385 00000100:00100000:1.0:1746142911.365452:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867382656:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.366331:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4386 00000100:00100000:3.0:1746142911.366339:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867383040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.367099:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4387 00000100:00100000:3.0:1746142911.367107:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867383168:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.376696:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867383040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10347us (12439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142911.376707:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4386 00002000:00100000:3.0:1746142911.376719:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880096141880 x1830962867383040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.376728:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141880 with x1830962867383040 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.376734:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141880 00000100:00100000:3.0:1746142911.381085:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867383168:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13970us (16767us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142911.381094:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4387 00002000:00100000:3.0:1746142911.381103:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096141180 x1830962867383168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.381115:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141180 with x1830962867383168 ext(3145728->4194303) 00002000:00010000:3.0:1746142911.381120:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096141180 00000100:00100000:1.0:1746142911.382882:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867382656:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17423us (18736us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142911.382891:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4385 00002000:00100000:1.0:1746142911.382927:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880097433480 x1830962867382656/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.383119:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433480 with x1830962867382656 ext(2097152->3145727) 00002000:00010000:1.0:1746142911.383123:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097433480 00000100:00100000:0.0:1746142911.389625:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.389696:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867383296 00000100:00100000:2.0:1746142911.389707:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867383296 00000100:00100000:2.0:1746142911.389775:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14232 00000100:00100000:2.0:1746142911.389785:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+23:32417:x1830962867383296:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.389803:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.389819:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a86b expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.389847:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.389856:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.389857:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.389861:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.389957:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.389970:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.389981:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867815552:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.390099:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.395150:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.396169:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867383424 00000100:00100000:3.0:1746142911.396176:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867383424 00000100:00100000:3.0:1746142911.396211:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14233 00000100:00100000:3.0:1746142911.396217:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32422:x1830962867383424:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.396233:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.396246:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a872 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.396267:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.396269:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.396276:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 40 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.396288:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 40 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.396297:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712b600, rc 0) 00000100:00100000:3.0:1746142911.396338:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32422:x1830962867383424:12345-192.168.204.50@tcp:101:cat.0 Request processed in 121us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.396343:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14233 00000100:00100000:2.0:1746142911.397218:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867815552:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.397240:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.397255:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600e00, rc 0) 00000100:00100000:2.0:1746142911.397283:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:32417:x1830962867383296:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7500us (7663us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.397290:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14232 00000100:00100000:0.0:1746142911.398376:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.398556:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867383552 00000100:00100000:2.0:1746142911.398562:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867383552 00010000:00010000:2.0:1746142911.398586:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.398611:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6415 00000100:00100000:2.0:1746142911.398619:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867383552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.398629:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.398648:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.398658:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.398677:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130600800/0x2fa243e067cccffe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [4071424->18446744073709551615] (req 4071424->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7d8 expref: 24 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.398704:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.398707:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.398714:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.398725:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.398752:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.398765:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867815680:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.398829:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.404890:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867815680:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.405164:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.405232:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867383552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6610us (6853us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.405242:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6415 00000100:00100000:0.0:1746142911.407536:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.407830:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867383808 00000100:00100000:1.0:1746142911.407837:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867383808 00002000:00100000:1.0:1746142911.407874:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff8800981cf100 x1830962867383808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.407883:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cf100 with x1830962867383808 ext(3145728->4194303) 00002000:00010000:1.0:1746142911.407887:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cf100 00000100:00100000:1.0:1746142911.407939:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4388 00000100:00100000:1.0:1746142911.407945:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867383808:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142911.409076:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.410229:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867384192 00000100:00100000:3.0:1746142911.410235:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867384192 00002000:00100000:3.0:1746142911.410260:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff8800981cc700 x1830962867384192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.410275:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc700 with x1830962867384192 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.410279:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cc700 00000100:00100000:3.0:1746142911.410295:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4389 00000100:00100000:3.0:1746142911.410301:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867384192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.411688:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.411721:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867384320 00000100:00100000:2.0:1746142911.411726:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867384320 00002000:00100000:2.0:1746142911.411750:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096af3480 x1830962867384320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.411758:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3480 with x1830962867384320 ext(3145728->4194303) 00002000:00010000:2.0:1746142911.411762:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af3480 00000100:00100000:2.0:1746142911.411796:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4390 00000100:00100000:2.0:1746142911.411803:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962867384320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.421368:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867383808:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13415us (13828us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142911.421378:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4388 00002000:00100000:1.0:1746142911.421388:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff8800981cf100 x1830962867383808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.421396:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cf100 with x1830962867383808 ext(3145728->4194303) 00002000:00010000:1.0:1746142911.421401:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cf100 00000100:00100000:0.0:1746142911.425975:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.426192:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867384448 00000100:00100000:2.0:1746142911.426200:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867384448 00000100:00100000:2.0:1746142911.426231:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14234 00000100:00100000:2.0:1746142911.426238:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32419:x1830962867384448:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.426252:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.426265:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a879 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.426289:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.426296:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 49 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.426301:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.426302:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.426305:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->3145727] (req 2670592->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.426325:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 49 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.426333:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.426342:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867815808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.426412:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 20 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.426419:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 20 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.426426:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867815936:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.426440:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.426556:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867384192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16254us (17483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142911.426564:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4389 00002000:00100000:3.0:1746142911.426571:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff8800981cc700 x1830962867384192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.426578:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc700 with x1830962867384192 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.426581:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800981cc700 00000100:00100000:1.0:1746142911.432585:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.432940:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867815808:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.432950:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867815936:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.432974:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->3145727] (req 2670592->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.432988:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097794400, rc 0) 00000100:00100000:2.0:1746142911.433109:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32419:x1830962867384448:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6869us (7140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.433109:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867384320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21306us (21422us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142911.433117:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14234 00000100:00100000:1.0:1746142911.433117:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4390 00002000:00100000:1.0:1746142911.433125:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096af3480 x1830962867384320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.433133:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3480 with x1830962867384320 ext(3145728->4194303) 00010000:00010000:1.0:1746142911.433139:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 47 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.433148:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 47 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.433154:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096af3480 00000100:00100000:1.0:1746142911.433164:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867384704 00000100:00100000:1.0:1746142911.433169:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867384704 00002000:00100000:1.0:1746142911.433190:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880096af1880 x1830962867384704/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.433195:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af1880 with x1830962867384704 ext(4194304->5066751) 00010000:00010000:1.0:1746142911.433198:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.433203:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.433207:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096af1880 00000100:00100000:1.0:1746142911.433224:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1362 00000100:00100000:1.0:1746142911.433229:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867384704:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142911.437197:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.437313:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867384832 00000100:00100000:2.0:1746142911.437321:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867384832 00000100:00100000:2.0:1746142911.437366:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14235 00000100:00100000:2.0:1746142911.437373:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+23:32424:x1830962867384832:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.437388:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.437402:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a880 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.437427:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.437433:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.437443:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 39 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.437447:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142911.437448:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142911.437451:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2260992->2973695] (req 2260992->2973695) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.437472:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 39 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.437480:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 39 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.437489:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816064:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.439578:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.439590:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.439600:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816192:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.439664:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.439676:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.439683:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816320:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.439699:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.440200:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867384704:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6968us (7621us total) trans 0 rc 872448/872448 00000100:00100000:1.0:1746142911.440209:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1362 00002000:00100000:1.0:1746142911.440217:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880096af1880 x1830962867384704/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.440226:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af1880 with x1830962867384704 ext(4194304->5066751) 00010000:00010000:1.0:1746142911.440233:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.440243:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.440248:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096af1880 00000100:00100000:0.0:1746142911.446744:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.446991:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816064:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.447002:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816192:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.447008:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816320:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.447038:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2260992->2973695] (req 2260992->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.447053:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795e00, rc 0) 00000100:00100000:2.0:1746142911.447090:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:32424:x1830962867384832:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9717us (9900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.447097:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14235 00000100:00100000:3.0:1746142911.447294:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867384960 00000100:00100000:3.0:1746142911.447301:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867384960 00010000:00010000:3.0:1746142911.447323:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.447344:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6416 00000100:00100000:3.0:1746142911.447359:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867384960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.447369:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.447385:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.447393:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.447410:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130600/0x2fa243e067ccd0ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a85d expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.447422:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.447439:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867384960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.447444:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6416 00000100:00100000:0.0:1746142911.447639:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.447681:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.448130:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.448171:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385088 00000100:00100000:2.0:1746142911.448174:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385088 00010000:00010000:2.0:1746142911.448188:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 47 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.448201:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385216 00000100:00100000:2.0:1746142911.448203:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385216 00010000:00010000:2.0:1746142911.448208:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.448223:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6417 00000100:00100000:2.0:1746142911.448228:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867385088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.448234:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.448244:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 47 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.448251:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 47 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.448261:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd0b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a864 expref: 47 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.448342:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6418 00000100:00100000:0.0:1746142911.448356:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867385216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.448362:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.448370:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.448377:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.448385:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130600e00/0x2fa243e067ccd0bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a86b expref: 23 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.448397:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.448418:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867385216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.448423:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6418 00000100:00100000:3.0:1746142911.449037:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385344 00000100:00100000:3.0:1746142911.449040:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385344 00010000:00010000:2.0:1746142911.449216:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.449477:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14236 00000100:00100000:3.0:1746142911.449483:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867385344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.449494:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.449504:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccd0d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a887 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.449516:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.449523:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccd0d7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a887 expref: 22 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.449531:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccd0d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a887 expref: 22 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.449538:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1e00, rc 0) 00000100:00100000:2.0:1746142911.449618:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867385088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1389us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.449624:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6417 00000100:00100000:3.0:1746142911.450671:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867385344:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1184us (2538us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.450676:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14236 00000100:00100000:1.0:1746142911.450967:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.450991:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.451011:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.451028:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385472 00000100:00100000:1.0:1746142911.451032:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385472 00010000:00010000:1.0:1746142911.451047:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.451199:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385600 00000100:00100000:3.0:1746142911.451202:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385600 00010000:00010000:3.0:1746142911.451213:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.451227:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6419 00000100:00100000:3.0:1746142911.451231:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867385472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.451239:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.451253:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.451262:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.451277:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130c00/0x2fa243e067ccd091 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a83a expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.451287:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.451289:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.451295:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.451975:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6420 00000100:00100000:2.0:1746142911.451983:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a02050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867385600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.451989:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.452000:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.452008:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.452023:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009712b600/0x2fa243e067ccd0c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a872 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.452030:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.452032:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.452035:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.452041:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.452067:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.452077:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867816448:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142911.452209:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.452227:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.452237:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867816576:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142911.452481:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385728 00000100:00100000:0.0:1746142911.452485:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385728 00000100:00100000:2.0:1746142911.452841:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.453217:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.453285:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14237 00000100:00100000:1.0:1746142911.453292:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32422:x1830962867385728:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142911.453303:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.453312:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a88e expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.453326:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 47 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.453331:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142911.453332:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142911.453335:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 47 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.453355:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 47 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.453366:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 47 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.453374:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867816704:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142911.453694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.453728:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.454135:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385856 00000100:00100000:0.0:1746142911.454140:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385856 00000100:00100000:3.0:1746142911.454560:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14238 00000100:00100000:3.0:1746142911.454567:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867385856:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.454576:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.454586:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0a00/0x2fa243e067ccd0e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a895 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.454614:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867816832:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142911.454846:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.455010:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867816448:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.455023:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.455044:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a02050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867385600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3063us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.455051:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6420 00000100:00100000:3.0:1746142911.455435:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867816576:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142911.455444:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.455460:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867385472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4229us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.455466:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6419 00000100:00100000:1.0:1746142911.455770:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867816704:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142911.455782:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 47 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.455792:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097420e00, rc 0) 00000100:00100000:1.0:1746142911.456079:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32422:x1830962867385728:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2788us (5066us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.456085:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14237 00002000:00010000:3.0:1746142911.458381:0:9579:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142911 -> 1746142912 00000100:00100000:3.0:1746142911.458400:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867816832:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.458422:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0a00/0x2fa243e067ccd0e5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a895 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.458432:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0a00/0x2fa243e067ccd0e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a895 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.458441:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a0a00, rc 0) 00000100:00100000:3.0:1746142911.458469:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867385856:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3902us (4774us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.458474:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14238 00000100:00100000:0.0:1746142911.460788:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.460879:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867385984 00000100:00100000:3.0:1746142911.460886:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867385984 00000100:00100000:3.0:1746142911.461389:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14239 00000100:00100000:3.0:1746142911.461398:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:32417:x1830962867385984:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.461411:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.461425:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a89c expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.461446:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.461448:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.461454:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.461467:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.461476:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1000, rc 0) 00000100:00100000:3.0:1746142911.461507:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:32417:x1830962867385984:12345-192.168.204.50@tcp:101:cat.0 Request processed in 111us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.461512:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14239 00000100:00100000:0.0:1746142911.461727:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.462028:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.462052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.462099:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867386240 00000100:00100000:1.0:1746142911.462104:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867386240 00002000:00100000:1.0:1746142911.462129:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2670592->3145727) req@ffff8800938dd180 x1830962867386240/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.462137:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dd180 with x1830962867386240 ext(2670592->3145727) 00010000:00010000:1.0:1746142911.462142:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 47 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.462153:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 47 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.462159:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938dd180 00000100:00100000:1.0:1746142911.462170:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867386624 00000100:00100000:1.0:1746142911.462172:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867386624 00002000:00100000:1.0:1746142911.462182:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2260992->2265087) req@ffff8800938df480 x1830962867386624/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.462188:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938df480 with x1830962867386624 ext(2260992->2265087) 00002000:00010000:1.0:1746142911.462190:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938df480 00000100:00100000:1.0:1746142911.462199:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1363 00000100:00100000:1.0:1746142911.462203:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867386240:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142911.462369:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867386368 00000100:00100000:2.0:1746142911.462373:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867386368 00000100:00100000:2.0:1746142911.462392:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14240 00000100:00100000:2.0:1746142911.462396:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32419:x1830962867386368:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.462403:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.462412:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8a3 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.462426:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.462432:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.462433:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142911.462435:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2437119] (req 2097152->2437119) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.462459:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.462467:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.462477:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816960:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.462523:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.462604:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1364 00000100:00100000:3.0:1746142911.462610:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867386624:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.462691:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867386624:12345-192.168.204.50@tcp:3:cat.0 Request processed in 80us (637us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142911.462699:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1364 00002000:00100000:3.0:1746142911.462704:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2260992->2265087) req@ffff8800938df480 x1830962867386624/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.462710:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938df480 with x1830962867386624 ext(2260992->2265087) 00010000:00010000:3.0:1746142911.462714:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.462721:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746142911.462726:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938df480 00000100:00100000:2.0:1746142911.466310:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867816960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.466335:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2437119] (req 2097152->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.466358:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795600, rc 0) 00000100:00100000:2.0:1746142911.466399:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32419:x1830962867386368:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4001us (4370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.466406:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14240 00000100:00100000:0.0:1746142911.466559:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.466881:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867386752 00000100:00100000:3.0:1746142911.466887:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867386752 00000100:00100000:3.0:1746142911.466935:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14241 00000100:00100000:3.0:1746142911.466941:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867386752:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.466951:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.466962:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0400/0x2fa243e067ccd0fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8aa expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.466980:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0400/0x2fa243e067ccd0fa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8aa expref: 22 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.466987:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0400/0x2fa243e067ccd0fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8aa expref: 22 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.466995:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a0400, rc 0) 00000100:00100000:3.0:1746142911.467025:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867386752:12345-192.168.204.50@tcp:101:cat.0 Request processed in 85us (467us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.467030:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14241 00000100:00100000:0.0:1746142911.469043:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867386240:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6833us (7310us total) trans 21474841192 rc 0/0 00000100:00100000:0.0:1746142911.469052:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1363 00002000:00100000:0.0:1746142911.469060:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2670592->3145727) req@ffff8800938dd180 x1830962867386240/t21474841192(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.469069:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dd180 with x1830962867386240 ext(2670592->3145727) 00010000:00010000:0.0:1746142911.469076:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.469086:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746142911.469092:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938dd180 00000100:00100000:1.0:1746142911.472621:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.472643:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.473196:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867387264 00000100:00100000:2.0:1746142911.473204:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867387264 00010000:00010000:2.0:1746142911.473232:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.473269:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6421 00000100:00100000:2.0:1746142911.473276:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867387264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.473287:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142911.473300:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142911 -> 1746142912 00002000:00010000:2.0:1746142911.473302:0:13297:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142911 -> 1746142912 00010000:00010000:2.0:1746142911.473307:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.473316:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.473333:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097794400/0x2fa243e067ccd0c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2670592->5029887] (req 2670592->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a879 expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.473346:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.473356:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.473362:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.473369:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.473393:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.473406:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867817088:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.473456:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.473547:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867387008 00000100:00100000:0.0:1746142911.473551:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867387008 00002000:00100000:0.0:1746142911.473573:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2969600->2973695) req@ffff880098191500 x1830962867387008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.473581:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191500 with x1830962867387008 ext(2969600->2973695) 00010000:00010000:0.0:1746142911.473586:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.473595:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746142911.473600:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098191500 00000100:00100000:0.0:1746142911.473609:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1365 00000100:00100000:0.0:1746142911.473613:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867387008:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.474159:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.474287:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867387008:12345-192.168.204.50@tcp:3:cat.0 Request processed in 672us (1673us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142911.474292:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1365 00002000:00100000:0.0:1746142911.474298:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2969600->2973695) req@ffff880098191500 x1830962867387008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.474303:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191500 with x1830962867387008 ext(2969600->2973695) 00010000:00010000:0.0:1746142911.474307:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.474314:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746142911.474319:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098191500 00000100:00100000:0.0:1746142911.474327:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867387392 00000100:00100000:0.0:1746142911.474329:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867387392 00002000:00100000:0.0:1746142911.474339:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff880098192300 x1830962867387392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.474344:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098192300 with x1830962867387392 ext(5062656->5066751) 00002000:00010000:0.0:1746142911.474346:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098192300 00000100:00100000:0.0:1746142911.474370:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4392 00000100:00100000:0.0:1746142911.474375:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867387392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142911.474417:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867387392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 42us (259us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142911.474421:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4392 00002000:00100000:0.0:1746142911.474425:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff880098192300 x1830962867387392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.474430:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098192300 with x1830962867387392 ext(5062656->5066751) 00002000:00010000:0.0:1746142911.474432:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098192300 00000100:00100000:0.0:1746142911.482105:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.482475:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867817088:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.482495:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.482625:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867387904 00000100:00100000:3.0:1746142911.482632:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867387904 00002000:00100000:3.0:1746142911.482668:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800938dca80 x1830962867387904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.482677:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dca80 with x1830962867387904 ext(3145728->4194303) 00002000:00010000:3.0:1746142911.482681:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dca80 00000100:00100000:3.0:1746142911.482698:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4393 00000100:00100000:3.0:1746142911.482704:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867387904:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142911.482973:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867387264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9696us (10327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.482984:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6421 00000100:00100000:0.0:1746142911.483704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.483753:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867387648 00000100:00100000:1.0:1746142911.483757:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867387648 00002000:00100000:1.0:1746142911.483773:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2260992->2973695) req@ffff8800938dc000 x1830962867387648/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.483978:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc000 with x1830962867387648 ext(2260992->2973695) 00010000:00010000:1.0:1746142911.483986:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.483997:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 22 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:1.0:1746142911.484003:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938dc000 00000100:00100000:1.0:1746142911.484017:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1366 00000100:00100000:1.0:1746142911.484022:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867387648:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142911.500073:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867387904:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 17361us (17968us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142911.500082:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4393 00002000:00100000:3.0:1746142911.500091:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800938dca80 x1830962867387904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.500100:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dca80 with x1830962867387904 ext(3145728->4194303) 00002000:00010000:3.0:1746142911.500105:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dca80 00000100:00100000:2.0:1746142911.503176:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867387648:12345-192.168.204.50@tcp:4:cat.0 Request processed in 19146us (19465us total) trans 17179873928 rc 0/0 00000100:00100000:2.0:1746142911.503188:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1366 00002000:00100000:2.0:1746142911.503196:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2260992->2973695) req@ffff8800938dc000 x1830962867387648/t17179873928(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.503203:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc000 with x1830962867387648 ext(2260992->2973695) 00010000:00010000:2.0:1746142911.503210:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.503222:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.503227:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938dc000 00000100:00100000:0.0:1746142911.505468:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.505565:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867388032 00000100:00100000:2.0:1746142911.505571:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867388032 00010000:00010000:2.0:1746142911.505597:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.507054:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6422 00000100:00100000:1.0:1746142911.507065:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867388032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.507079:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746142911.507098:0:7219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142911 -> 1746142912 00002000:00010000:1.0:1746142911.507101:0:7219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142911 -> 1746142912 00010000:00010000:1.0:1746142911.507106:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.507122:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.507141:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccd0d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2260992->2973695) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a880 expref: 24 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.507267:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.507288:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867388160 00000100:00100000:0.0:1746142911.507292:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867388160 00010000:00010000:1.0:1746142911.507592:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.507595:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.507602:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.507610:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.507641:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.507651:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867817216:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142911.507892:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14242 00000100:00100000:0.0:1746142911.507918:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32422:x1830962867388160:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142911.507930:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142911.507941:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8b1 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.507957:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.507963:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142911.507964:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142911.507967:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 41 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.508004:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.508045:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746142911.508139:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.508149:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817344:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.508197:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.509724:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817344:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.509743:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 41 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.509754:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670200, rc 0) 00000100:00100000:3.0:1746142911.509792:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32422:x1830962867388160:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1893us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.509799:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14242 00000100:00100000:1.0:1746142911.510080:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867817216:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.510092:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.510113:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867388032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3051us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.510119:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6422 00000100:00100000:1.0:1746142911.515024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.515338:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867388416 00000100:00100000:2.0:1746142911.515345:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867388416 00002000:00100000:2.0:1746142911.515389:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2433024->2437119) req@ffff880088d62680 x1830962867388416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.515397:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62680 with x1830962867388416 ext(2433024->2437119) 00010000:00010000:2.0:1746142911.515404:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.515416:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.515423:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088d62680 00000100:00100000:2.0:1746142911.515744:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1367 00000100:00100000:2.0:1746142911.515752:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867388416:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142911.515875:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867388416:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 123us (862us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142911.515881:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1367 00002000:00100000:2.0:1746142911.515886:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2433024->2437119) req@ffff880088d62680 x1830962867388416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.515893:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62680 with x1830962867388416 ext(2433024->2437119) 00010000:00010000:2.0:1746142911.515897:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.515924:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.515930:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088d62680 00000100:00100000:0.0:1746142911.518086:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.518136:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867388672 00000100:00100000:2.0:1746142911.518143:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867388672 00002000:00100000:2.0:1746142911.518208:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2437119) req@ffff880091c05500 x1830962867388672/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.518216:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05500 with x1830962867388672 ext(2097152->2437119) 00010000:00010000:2.0:1746142911.518222:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.518232:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 41 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.518238:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c05500 00000100:00100000:2.0:1746142911.518267:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1368 00000100:00100000:2.0:1746142911.518274:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867388672:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142911.523398:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867388672:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 5114us (5305us total) trans 17179873929 rc 0/0 00000100:00100000:2.0:1746142911.523408:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1368 00002000:00100000:2.0:1746142911.523421:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2437119) req@ffff880091c05500 x1830962867388672/t17179873929(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.523430:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05500 with x1830962867388672 ext(2097152->2437119) 00010000:00010000:2.0:1746142911.523439:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 43 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.523457:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 43 pid: 1852 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.523463:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c05500 00000100:00100000:0.0:1746142911.524934:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.528024:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867388800 00000100:00100000:1.0:1746142911.528035:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867388800 00010000:00010000:1.0:1746142911.528071:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 43 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.528103:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6423 00000100:00100000:1.0:1746142911.528111:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867388800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.528123:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.528139:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 43 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.528150:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 43 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.528168:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd0f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2437119) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8a3 expref: 43 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.528190:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.528192:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.528197:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 42 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.528204:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 42 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.528232:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 42 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.528247:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867817472:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142911.528318:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.531843:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.531868:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867817472:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.531892:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.531959:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867388800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3848us (7027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.531968:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6423 00000100:00100000:2.0:1746142911.532041:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867389056 00000100:00100000:2.0:1746142911.532046:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867389056 00002000:00100000:2.0:1746142911.532087:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880091c07800 x1830962867389056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.532096:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07800 with x1830962867389056 ext(3145728->4194303) 00002000:00010000:2.0:1746142911.532103:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c07800 00000100:00100000:2.0:1746142911.532130:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4394 00000100:00100000:2.0:1746142911.532139:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867389056:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142911.539092:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867389056:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 6948us (7246us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142911.539102:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4394 00002000:00100000:2.0:1746142911.539112:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880091c07800 x1830962867389056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.539120:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07800 with x1830962867389056 ext(3145728->4194303) 00002000:00010000:2.0:1746142911.539125:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c07800 00000100:00100000:0.0:1746142911.550123:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.550827:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867389312 00000100:00100000:2.0:1746142911.550836:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867389312 00002000:00100000:2.0:1746142911.550874:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff880091c07b80 x1830962867389312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.550889:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07b80 with x1830962867389312 ext(4194304->5029887) 00002000:00010000:2.0:1746142911.550893:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c07b80 00000100:00100000:3.0:1746142911.554007:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4395 00000100:00100000:3.0:1746142911.554021:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2003:x1830962867389312:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.559861:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2003:x1830962867389312:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5837us (9736us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746142911.559873:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4395 00002000:00100000:3.0:1746142911.559883:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff880091c07b80 x1830962867389312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.559892:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07b80 with x1830962867389312 ext(4194304->5029887) 00002000:00010000:3.0:1746142911.559898:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c07b80 00000100:00100000:0.0:1746142911.697511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.697556:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.698439:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867389568 00000100:00100000:3.0:1746142911.698447:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867389568 00002000:00100000:3.0:1746142911.698483:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880091c06680 x1830962867389568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.698492:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06680 with x1830962867389568 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.698498:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c06680 00000100:00100000:3.0:1746142911.698514:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867389824 00000100:00100000:3.0:1746142911.698516:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867389824 00002000:00100000:3.0:1746142911.698527:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880091c05880 x1830962867389824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.698533:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05880 with x1830962867389824 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.698536:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c05880 00000100:00100000:3.0:1746142911.698547:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4396 00000100:00100000:3.0:1746142911.698553:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867389568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142911.699329:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4397 00000100:00100000:0.0:1746142911.699337:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867389824:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.718941:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867389568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20340us (21389us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142911.718952:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4396 00002000:00100000:3.0:1746142911.718962:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880091c06680 x1830962867389568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.718970:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06680 with x1830962867389568 ext(2097152->3145727) 00002000:00010000:3.0:1746142911.718975:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c06680 00000100:00100000:0.0:1746142911.722083:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.722120:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.722234:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867389952 00000100:00100000:2.0:1746142911.722241:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867389952 00000100:00100000:2.0:1746142911.722270:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390080 00000100:00100000:2.0:1746142911.722272:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390080 00000100:00100000:2.0:1746142911.722286:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14243 00000100:00100000:2.0:1746142911.722292:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867389952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.722306:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.722320:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8b8 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.722338:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.722340:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.722363:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.722376:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.722385:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097794800, rc 0) 00000100:00100000:2.0:1746142911.722417:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867389952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.722422:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14243 00000100:00100000:2.0:1746142911.722433:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14244 00000100:00100000:2.0:1746142911.722438:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867390080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.722444:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.722451:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8bf expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.722460:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.722461:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.722464:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 24 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.722472:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 24 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.722477:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097794400, rc 0) 00000100:00100000:2.0:1746142911.722489:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867390080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 51us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.722493:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14244 00000100:00100000:1.0:1746142911.722762:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867389824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23426us (25205us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142911.722770:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4397 00002000:00100000:1.0:1746142911.722776:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880091c05880 x1830962867389824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.722783:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05880 with x1830962867389824 ext(2097152->3145727) 00002000:00010000:1.0:1746142911.722786:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c05880 00000100:00100000:0.0:1746142911.724217:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.724267:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390208 00000100:00100000:3.0:1746142911.724274:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390208 00000100:00100000:3.0:1746142911.724307:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14245 00000100:00100000:3.0:1746142911.724312:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:32435:x1830962867390208:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142911.724319:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.724326:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8c6 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.724354:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.724367:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.724373:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 41 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.724378:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.724380:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.724382:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 25 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.724402:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 41 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.724411:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 41 pid: 9578 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.724420:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817600:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.724636:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 10 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.724644:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 10 pid: 1854 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.724652:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817728:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.724680:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.724688:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.724694:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817856:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.724710:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.735994:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817600:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.736254:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817728:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.736432:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867817856:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.736462:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1916928->2097151] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 25 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.736477:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd88c00, rc 0) 00000100:00100000:3.0:1746142911.736859:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+25:32435:x1830962867390208:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 12545us (12643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.736867:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14245 00000100:00100000:0.0:1746142911.747748:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.747809:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390592 00000100:00100000:3.0:1746142911.747817:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390592 00000100:00100000:3.0:1746142911.747867:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14246 00000100:00100000:3.0:1746142911.747873:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32440:x1830962867390592:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142911.747889:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.747923:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8d4 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.747949:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.747958:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.747964:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.747965:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.747968:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.747990:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.747999:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 21 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.748008:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867817984:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.748101:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.748109:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.748116:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867818112:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.748136:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.750506:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.750540:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.750726:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390464 00000100:00100000:2.0:1746142911.750732:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390464 00000100:00100000:2.0:1746142911.750767:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14247 00000100:00100000:2.0:1746142911.750772:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867390464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.750783:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.750795:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd124 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8cd expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.750810:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.750817:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd124 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8cd expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.750830:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097795600/0x2fa243e067ccd124 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8cd expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.750841:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795600, rc 0) 00000100:00100000:2.0:1746142911.750869:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867390464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 96us (368us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.750873:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14247 00000100:00100000:0.0:1746142911.751232:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.751267:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.751752:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390848 00000100:00100000:1.0:1746142911.751756:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390848 00010000:00010000:1.0:1746142911.751773:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.751800:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390336 00000100:00100000:1.0:1746142911.751802:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390336 00010000:00010000:1.0:1746142911.751811:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 42 pid: 9578 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.751826:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867390720 00000100:00100000:1.0:1746142911.751828:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867390720 00010000:00010000:1.0:1746142911.751835:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 11 pid: 1854 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.751846:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6424 00000100:00100000:1.0:1746142911.751850:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867390848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.751858:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.751871:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.751879:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.751894:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a89d400/0x2fa243e067ccc83a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2de expref: 25 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.751920:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.751940:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867390848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.751945:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6424 00000100:00100000:1.0:1746142911.751956:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6425 00000100:00100000:1.0:1746142911.751961:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867390336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.751967:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.751974:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 42 pid: 9578 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.751980:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 42 pid: 9578 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.751989:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1000/0x2fa243e067ccc879 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a30f expref: 42 pid: 9578 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.751996:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.752009:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867390336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 48us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.752014:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6425 00000100:00100000:1.0:1746142911.752024:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6426 00000100:00100000:1.0:1746142911.752028:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867390720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.752033:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.752039:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 11 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.752046:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 11 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.752057:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1600/0x2fa243e067ccc913 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a35c expref: 11 pid: 1854 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.752064:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.752065:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.752072:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.752077:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.752099:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.752109:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867818240:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142911.752149:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.756071:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.756113:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.756323:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867391104 00000100:00100000:3.0:1746142911.756331:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867391104 00002000:00100000:3.0:1746142911.756375:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800924a3100 x1830962867391104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.756383:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a3100 with x1830962867391104 ext(2097152->4194303) 00010000:00010000:3.0:1746142911.756390:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.756405:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00002000:00010000:3.0:1746142911.756411:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924a3100 00000100:00100000:3.0:1746142911.756434:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867391360 00000100:00100000:3.0:1746142911.756436:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867391360 00002000:00100000:3.0:1746142911.756448:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800924a1880 x1830962867391360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.756453:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1880 with x1830962867391360 ext(2097152->4194303) 00002000:00010000:3.0:1746142911.756456:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1880 00000100:00100000:3.0:1746142911.756468:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1369 00000100:00100000:3.0:1746142911.756474:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867391104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142911.756736:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4398 00000100:00100000:2.0:1746142911.756744:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867391360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142911.757205:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.757221:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867818240:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142911.757235:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.757268:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867390720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5239us (6000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.757274:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6426 00000100:00100000:1.0:1746142911.757295:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867391616 00000100:00100000:1.0:1746142911.757299:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867391616 00002000:00100000:1.0:1746142911.757310:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1916928->1921023) req@ffff8800924a1f80 x1830962867391616/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.757316:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1f80 with x1830962867391616 ext(1916928->1921023) 00002000:00010000:1.0:1746142911.757319:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1f80 00000100:00100000:1.0:1746142911.757328:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4399 00000100:00100000:1.0:1746142911.757332:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867391616:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.757402:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867391616:12345-192.168.204.50@tcp:3:cat.0 Request processed in 69us (197us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142911.757410:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4399 00002000:00100000:1.0:1746142911.757414:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1916928->1921023) req@ffff8800924a1f80 x1830962867391616/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.757420:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1f80 with x1830962867391616 ext(1916928->1921023) 00002000:00010000:1.0:1746142911.757422:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1f80 00000100:00100000:1.0:1746142911.757498:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867817984:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142911.757505:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867818112:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142911.757521:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.757534:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2000, rc 0) 00000100:00100000:1.0:1746142911.757550:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32440:x1830962867390592:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9678us (9811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.757555:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14246 00000100:00100000:1.0:1746142911.759878:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.759897:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867391744 00000100:00100000:1.0:1746142911.759914:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867391744 00010000:00010000:1.0:1746142911.759935:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.759963:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6427 00000100:00100000:1.0:1746142911.759969:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867391744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.759978:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.759990:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.760000:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.760018:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097420e00/0x2fa243e067ccd0de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a88e expref: 49 pid: 1852 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.760038:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.760055:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a01c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867391744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.760060:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6427 00000100:00100000:0.0:1746142911.766047:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.766355:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867391872 00000100:00100000:1.0:1746142911.766363:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867391872 00000100:00100000:1.0:1746142911.766409:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14248 00000100:00100000:1.0:1746142911.766416:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867391872:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142911.766435:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.766452:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800923f0000/0x2fa243e067ccd12b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8db expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.766469:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.766476:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800923f0000/0x2fa243e067ccd12b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8db expref: 49 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.766485:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800923f0000/0x2fa243e067ccd12b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8db expref: 49 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.766494:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f0000, rc 0) 00000100:00100000:1.0:1746142911.766535:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867391872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 119us (495us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142911.766540:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14248 00000100:00100000:0.0:1746142911.767723:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.767796:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867392000 00000100:00100000:3.0:1746142911.767801:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867392000 00000100:00100000:3.0:1746142911.767883:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14249 00000100:00100000:3.0:1746142911.767889:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+26:32435:x1830962867392000:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142911.767918:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.767929:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8e2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.767946:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.767954:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 9 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.767961:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.767966:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.767967:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.767970:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.767993:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 40 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.768002:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 40 pid: 11943 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.768012:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867818368:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.768077:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 9 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.768085:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 9 pid: 11943 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.768093:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867818496:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.768114:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.768121:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.768128:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867818624:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.768140:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.779574:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867818368:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142911.779576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.779586:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867818496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.779594:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867818624:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142911.779594:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.779611:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867392256 00000100:00100000:1.0:1746142911.779616:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867392256 00010000:00010000:3.0:1746142911.779622:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1257471] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 27 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.779636:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2600, rc 0) 00010000:00010000:1.0:1746142911.779643:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 10 pid: 11943 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.779664:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6428 00000100:00100000:1.0:1746142911.779669:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867392256:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.779680:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142911.779688:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+27:32435:x1830962867392000:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 11798us (11966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.779694:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14249 00010000:00010000:1.0:1746142911.779695:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 10 pid: 11943 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.779703:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 10 pid: 11943 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.779709:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867392128 00000100:00100000:3.0:1746142911.779711:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867392128 00010000:00010000:1.0:1746142911.779719:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094714c00/0x2fa243e067cccfcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7ae expref: 10 pid: 11943 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.779726:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14250 00010000:00010000:1.0:1746142911.779730:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.779731:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32433:x1830962867392128:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.779742:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142911.779745:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867392256:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.779750:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6428 00010000:00010000:3.0:1746142911.779754:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8e9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.779767:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.779769:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142911.779773:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142911.779776:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.779785:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867392384 00010000:00010000:3.0:1746142911.779786:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.779788:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867392384 00010000:00010000:3.0:1746142911.779793:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd89800, rc 0) 00010000:00010000:1.0:1746142911.779797:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 41 pid: 11943 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.779808:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32433:x1830962867392128:12345-192.168.204.50@tcp:101:cat.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.779810:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6429 00000100:00100000:3.0:1746142911.779813:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14250 00000100:00100000:1.0:1746142911.779815:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867392384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.779820:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.779827:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 41 pid: 11943 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.779834:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 41 pid: 11943 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.779843:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fbb400/0x2fa243e067cccf02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a714 expref: 41 pid: 11943 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.779851:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.779865:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867392384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.779870:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6429 00000100:00100000:2.0:1746142911.783586:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.783884:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867391104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27407us (27820us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142911.783884:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867392512 00000100:00100000:1.0:1746142911.783891:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867392512 00000100:00100000:3.0:1746142911.783892:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1369 00002000:00100000:3.0:1746142911.783913:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800924a3100 x1830962867391104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.783920:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a3100 with x1830962867391104 ext(2097152->4194303) 00010000:00010000:1.0:1746142911.783925:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.783927:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.783936:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00002000:00010000:3.0:1746142911.783942:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924a3100 00000100:00100000:1.0:1746142911.783956:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6430 00000100:00100000:1.0:1746142911.783962:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867392512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142911.784390:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142911.784497:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.784512:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.784521:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.784537:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3600/0x2fa243e067ccce3e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a6b9 expref: 27 pid: 1397 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.784547:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867392768 00010000:00010000:1.0:1746142911.784547:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.784549:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142911.784550:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867392768 00010000:00010000:1.0:1746142911.784555:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.784561:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746142911.784579:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff8800924a2300 x1830962867392768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746142911.784585:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746142911.784586:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a2300 with x1830962867392768 ext(4194304->5029887) 00002000:00010000:3.0:1746142911.784590:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a2300 00000100:00100000:1.0:1746142911.784596:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867818752:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142911.784603:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4400 00000100:00100000:3.0:1746142911.784608:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867392768:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.784638:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.790454:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867818752:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142911.790472:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.790520:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867392512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6557us (6938us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.790530:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6430 00000100:00100000:2.0:1746142911.790676:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867391360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 33933us (34561us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142911.790683:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4398 00002000:00100000:2.0:1746142911.790692:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800924a1880 x1830962867391360/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.790700:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1880 with x1830962867391360 ext(2097152->4194303) 00002000:00010000:2.0:1746142911.790705:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1880 00000100:00100000:0.0:1746142911.791139:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.791168:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.791259:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393024 00000100:00100000:2.0:1746142911.791264:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393024 00002000:00100000:2.0:1746142911.791289:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5062655) req@ffff8800924a0a80 x1830962867393024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.791296:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a0a80 with x1830962867393024 ext(4194304->5062655) 00010000:00010000:2.0:1746142911.791303:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746142911.791314:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00002000:00010000:2.0:1746142911.791320:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924a0a80 00000100:00100000:2.0:1746142911.791330:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393280 00000100:00100000:2.0:1746142911.791332:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393280 00002000:00100000:2.0:1746142911.791351:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1253376->1257471) req@ffff8800924a3800 x1830962867393280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.791358:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a3800 with x1830962867393280 ext(1253376->1257471) 00002000:00010000:2.0:1746142911.791360:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a3800 00000100:00100000:2.0:1746142911.791371:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1370 00000100:00100000:2.0:1746142911.791381:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867393024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.791578:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4401 00000100:00100000:1.0:1746142911.791583:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867393280:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142911.791632:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867393280:12345-192.168.204.50@tcp:3:cat.0 Request processed in 49us (464us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142911.791636:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4401 00002000:00100000:1.0:1746142911.791639:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1253376->1257471) req@ffff8800924a3800 x1830962867393280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.791644:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a3800 with x1830962867393280 ext(1253376->1257471) 00002000:00010000:1.0:1746142911.791646:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a3800 00000100:00100000:3.0:1746142911.791743:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867392768:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7134us (7353us total) trans 0 rc 835584/835584 00000100:00100000:3.0:1746142911.791749:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4400 00002000:00100000:3.0:1746142911.791754:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5029887) req@ffff8800924a2300 x1830962867392768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 835584/835584 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.791760:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a2300 with x1830962867392768 ext(4194304->5029887) 00002000:00010000:3.0:1746142911.791763:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a2300 00000100:00100000:0.0:1746142911.797059:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.797242:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867393024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5859us (6101us total) trans 0 rc 868352/868352 00000100:00100000:3.0:1746142911.797252:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1370 00002000:00100000:3.0:1746142911.797261:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5062655) req@ffff8800924a0a80 x1830962867393024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.797269:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a0a80 with x1830962867393024 ext(4194304->5062655) 00010000:00010000:3.0:1746142911.797278:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.797290:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 22 pid: 1852 timeout: 785 lvb_type: 1 00002000:00010000:3.0:1746142911.797296:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924a0a80 00000100:00100000:0.0:1746142911.797382:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.797487:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393408 00000100:00100000:3.0:1746142911.797493:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393408 00000100:00100000:3.0:1746142911.797517:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393536 00000100:00100000:3.0:1746142911.797519:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393536 00000100:00100000:3.0:1746142911.797532:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14251 00000100:00100000:3.0:1746142911.797580:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867393408:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.797596:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.797610:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccd140 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8f0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142911.797616:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14252 00000100:00100000:0.0:1746142911.797621:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+22:32438:x1830962867393536:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142911.797627:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142911.797634:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8f7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.797645:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142911.797647:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867818880:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142911.797650:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 48 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.797654:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142911.797657:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.797676:0:1853:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 48 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.797677:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142911.797686:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.797694:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.797694:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393664 00010000:00010000:0.0:1746142911.797694:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800987ff600, rc 0) 00000100:00100000:1.0:1746142911.797697:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393664 00000100:00100000:0.0:1746142911.797708:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:32438:x1830962867393536:12345-192.168.204.50@tcp:101:cat.0 Request processed in 88us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.797713:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14252 00000100:00100000:1.0:1746142911.797874:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14253 00000100:00100000:1.0:1746142911.797882:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867393664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142911.797889:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.797896:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067ccd14e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a8fe expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142911.797922:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.797946:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867819136:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142911.797947:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393792 00000100:00100000:2.0:1746142911.797951:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393792 00000100:00100000:2.0:1746142911.797982:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14254 00000100:00100000:2.0:1746142911.797988:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867393792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.797995:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.798001:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097794e00/0x2fa243e067ccd155 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a905 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.798011:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.798018:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097794e00/0x2fa243e067ccd155 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a905 expref: 50 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.798026:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097794e00/0x2fa243e067ccd155 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a905 expref: 50 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.798044:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097794e00, rc 0) 00000100:00100000:2.0:1746142911.798061:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867393792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 74us (139us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.798067:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14254 00000100:00100000:1.0:1746142911.798220:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00002000:00010000:3.0:1746142911.799580:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142908 -> 1746142912 00002000:00010000:3.0:1746142911.799585:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142908 -> 1746142912 00002000:00010000:3.0:1746142911.799587:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142908 -> 1746142912 00000100:00100000:3.0:1746142911.799600:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867818880:192.168.204.50@tcp:106: 00002000:00010000:1.0:1746142911.799610:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142911 -> 1746142912 00002000:00010000:1.0:1746142911.799613:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142911 -> 1746142912 00002000:00010000:1.0:1746142911.799614:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142911 -> 1746142912 00010000:00010000:3.0:1746142911.799616:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccd140 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f0 expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142911.799621:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867819136:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.799625:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd89400/0x2fa243e067ccd140 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f0 expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.799635:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067ccd14e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8fe expref: 42 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.799636:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd89400, rc 0) 00010000:00010000:1.0:1746142911.799643:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092131600/0x2fa243e067ccd14e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8fe expref: 42 pid: 1854 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142911.799657:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867393408:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2119us (2606us total) trans 0 rc 301/301 00010000:00010000:1.0:1746142911.799661:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092131600, rc 0) 00000100:00100000:3.0:1746142911.799663:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14251 00000100:00100000:1.0:1746142911.799677:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867393664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1797us (2001us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142911.799685:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14253 00000100:00100000:0.0:1746142911.799817:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.799834:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867393920 00000100:00100000:0.0:1746142911.799838:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867393920 00010000:00010000:0.0:1746142911.799854:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 23 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:0.0:1746142911.799870:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6431 00000100:00100000:0.0:1746142911.799876:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867393920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.799883:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.799893:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 23 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746142911.799920:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 23 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746142911.799934:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097794800/0x2fa243e067ccd108 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b8 expref: 23 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746142911.799945:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.799946:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.799951:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 48 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.799957:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 48 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.799974:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 48 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.799982:0:7219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 48 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.799990:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867819264:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142911.800044:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.800879:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867819264:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.800890:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.801575:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867393920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1697us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.801582:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6431 00000100:00100000:0.0:1746142911.801890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.801994:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.802026:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.802119:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867394176 00000100:00100000:3.0:1746142911.802124:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867394176 00000100:00100000:3.0:1746142911.802141:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867394304 00000100:00100000:3.0:1746142911.802143:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867394304 00000100:00100000:3.0:1746142911.802151:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867394432 00000100:00100000:3.0:1746142911.802152:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867394432 00000100:00100000:3.0:1746142911.802163:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14255 00000100:00100000:3.0:1746142911.802169:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867394176:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.802177:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.802188:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd15c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a90c expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.802217:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867819392:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142911.802255:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.802269:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14256 00000100:00100000:3.0:1746142911.802274:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867394304:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142911.802280:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142911.802281:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14257 00010000:00010000:3.0:1746142911.802286:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccd163 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a913 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.802289:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867394432:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142911.802296:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.802303:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd16a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a91a expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.802304:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867819520:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142911.802319:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd16a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a91a expref: 50 pid: 1397 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142911.802321:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746142911.802327:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd16a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a91a expref: 50 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.802337:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795e00, rc 0) 00000100:00100000:2.0:1746142911.802369:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867394432:12345-192.168.204.50@tcp:101:cat.0 Request processed in 82us (343us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.802377:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14257 00000100:00100000:0.0:1746142911.803295:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.803404:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867394560 00000100:00100000:3.0:1746142911.803409:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867394560 00002000:00100000:3.0:1746142911.803433:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3166208->3170303) req@ffff880091de1180 x1830962867394560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.803440:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1180 with x1830962867394560 ext(3166208->3170303) 00010000:00010000:3.0:1746142911.803446:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.803456:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746142911.803462:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de1180 00000100:00100000:3.0:1746142911.803475:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1371 00000100:00100000:3.0:1746142911.803480:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867394560:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.804893:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867394560:12345-192.168.204.50@tcp:3:cat.0 Request processed in 1408us (1596us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142911.804910:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1371 00002000:00100000:3.0:1746142911.804916:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3166208->3170303) req@ffff880091de1180 x1830962867394560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.804924:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1180 with x1830962867394560 ext(3166208->3170303) 00010000:00010000:3.0:1746142911.804930:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.804940:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746142911.804946:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de1180 00000100:00100000:2.0:1746142911.804968:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867819392:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142911.805057:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd15c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a90c expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.805069:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd15c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a90c expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.805078:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:3.0:1746142911.805079:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867819520:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.805092:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccd163 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a913 expref: 42 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.805101:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccd163 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a913 expref: 42 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.805108:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3e00, rc 0) 00000100:00100000:3.0:1746142911.805386:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867394304:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3110us (3391us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142911.805387:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867394176:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3216us (3496us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.805392:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14256 00000100:00100000:2.0:1746142911.805399:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14255 00000100:00100000:0.0:1746142911.806960:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.807247:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867394816 00000100:00100000:3.0:1746142911.807253:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867394816 00002000:00100000:3.0:1746142911.807276:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3190784->3194879) req@ffff880091de0700 x1830962867394816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.807284:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0700 with x1830962867394816 ext(3190784->3194879) 00010000:00010000:3.0:1746142911.807290:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.807301:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746142911.807307:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de0700 00000100:00100000:3.0:1746142911.807330:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1372 00000100:00100000:3.0:1746142911.807337:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867394816:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.807444:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867394816:12345-192.168.204.50@tcp:3:cat.0 Request processed in 107us (487us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142911.807450:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1372 00002000:00100000:3.0:1746142911.807454:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3190784->3194879) req@ffff880091de0700 x1830962867394816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.807461:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de0700 with x1830962867394816 ext(3190784->3194879) 00010000:00010000:3.0:1746142911.807466:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.807474:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:3.0:1746142911.807480:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de0700 00000100:00100000:0.0:1746142911.810363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.813112:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867395072 00000100:00100000:2.0:1746142911.813123:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867395072 00002000:00100000:2.0:1746142911.813164:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3166208->3194879) req@ffff880091de1f80 x1830962867395072/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.813174:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1f80 with x1830962867395072 ext(3166208->3194879) 00010000:00010000:2.0:1746142911.813183:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.813196:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 49 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.813202:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de1f80 00000100:00100000:2.0:1746142911.813235:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1373 00000100:00100000:2.0:1746142911.813243:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867395072:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142911.816172:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2005:x1830962867395072:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2924us (5810us total) trans 21474841193 rc 0/0 00000100:00100000:2.0:1746142911.816181:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1373 00002000:00100000:2.0:1746142911.816189:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3166208->3194879) req@ffff880091de1f80 x1830962867395072/t21474841193(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142911.816198:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1f80 with x1830962867395072 ext(3166208->3194879) 00010000:00010000:2.0:1746142911.816464:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 51 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.816479:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 51 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:2.0:1746142911.816485:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de1f80 00000100:00100000:0.0:1746142911.817520:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.817595:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867395200 00000100:00100000:2.0:1746142911.817602:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867395200 00010000:00010000:2.0:1746142911.817624:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 51 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.818250:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6432 00000100:00100000:2.0:1746142911.818258:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2004:x1830962867395200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.818270:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142911.818282:0:7219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142911 -> 1746142912 00010000:00010000:2.0:1746142911.818287:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 51 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.818302:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 51 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.818320:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd11d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3166208->3194879] (req 3166208->3194879) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8d4 expref: 51 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.818332:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.818333:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.818339:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.818359:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.818385:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.818395:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867819648:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142911.818451:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.820276:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867819648:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142911.820289:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.820322:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2004:x1830962867395200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2066us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.820328:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6432 00000100:00100000:2.0:1746142911.822292:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.822363:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867395456 00000100:00100000:3.0:1746142911.822370:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867395456 00002000:00100000:3.0:1746142911.822483:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800979b3480 x1830962867395456/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.822492:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3480 with x1830962867395456 ext(3145728->4194303) 00002000:00010000:3.0:1746142911.822497:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b3480 00000100:00100000:3.0:1746142911.822518:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4402 00000100:00100000:3.0:1746142911.822525:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867395456:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.833402:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867395456:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10869us (11105us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142911.833411:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4402 00002000:00100000:3.0:1746142911.833421:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800979b3480 x1830962867395456/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.833429:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3480 with x1830962867395456 ext(3145728->4194303) 00002000:00010000:3.0:1746142911.833434:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b3480 00000100:00100000:0.0:1746142911.841164:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.841374:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867395712 00000100:00100000:3.0:1746142911.841381:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867395712 00002000:00100000:3.0:1746142911.841416:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5062655) req@ffff880091de1500 x1830962867395712/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.841425:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1500 with x1830962867395712 ext(4194304->5062655) 00002000:00010000:3.0:1746142911.841429:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de1500 00000100:00100000:3.0:1746142911.841486:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4403 00000100:00100000:3.0:1746142911.841494:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867395712:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142911.849475:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867395712:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7975us (8310us total) trans 0 rc 868352/868352 00000100:00100000:3.0:1746142911.849485:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4403 00002000:00100000:3.0:1746142911.849509:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5062655) req@ffff880091de1500 x1830962867395712/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/440 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142911.849517:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1500 with x1830962867395712 ext(4194304->5062655) 00002000:00010000:3.0:1746142911.849521:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de1500 00000100:00100000:0.0:1746142911.850602:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.850756:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867395840 00000100:00100000:3.0:1746142911.850763:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867395840 00000100:00100000:3.0:1746142911.850804:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14440 00000100:00100000:3.0:1746142911.850811:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+21:32444:x1830962867395840:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142911.850828:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.850842:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495de00/0x2fa243e067ccd171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a921 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.850886:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.850896:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.850921:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.850933:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.850939:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.850944:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.850999:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.851009:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 31 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.851016:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 63 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.851021:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.851045:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 63 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.851055:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 63 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.851064:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867819776:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.851136:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 31 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.851143:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 31 pid: 7232 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.851151:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867819904:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.853253:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.856946:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867819776:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142911.857994:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.858093:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867819904:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.858116:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142911.858199:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396096 00000100:00100000:3.0:1746142911.858205:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396096 00000100:00100000:3.0:1746142911.858290:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5264 00000100:00100000:3.0:1746142911.858298:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+64:30465:x1830962867396096:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000001:00080000:3.0:1746142911.858461:0:7234:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589936605 00000100:00100000:3.0:1746142911.860061:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+66:30465:x1830962867396096:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 1759us (2064us total) trans 8589936606 rc 0/0 00000100:00100000:3.0:1746142911.860070:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5264 00000020:00080000:3.0:1746142911.860074:0:7234:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746142911.860568:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.861025:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396352 00000100:00100000:3.0:1746142911.861032:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396352 00000100:00100000:3.0:1746142911.861057:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5265 00000100:00100000:3.0:1746142911.861065:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+32:8515:x1830962867396352:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746142911.861185:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+33:8515:x1830962867396352:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 120us (616us total) trans 8589936607 rc 0/0 00000100:00100000:3.0:1746142911.861190:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5265 00000100:00100000:0.0:1746142911.861470:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.862355:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396480 00000100:00100000:2.0:1746142911.862360:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396480 00010000:00010000:2.0:1746142911.862381:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 66 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.862412:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6433 00000100:00100000:2.0:1746142911.862417:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+66:2005:x1830962867396480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.862427:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.862431:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 66 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.862441:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 66 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.862460:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd083 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a841 expref: 66 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.862482:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142911.862486:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.862493:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.862498:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.862503:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.862525:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+65:2005:x1830962867396480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.862531:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6433 00000100:00100000:0.0:1746142911.863379:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.863435:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396608 00000100:00100000:3.0:1746142911.863439:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396608 00010000:00010000:3.0:1746142911.863452:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 33 pid: 7232 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.863477:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6434 00000100:00100000:3.0:1746142911.863482:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a01850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+33:2006:x1830962867396608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.863489:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.863493:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 33 pid: 7232 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.863501:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 33 pid: 7232 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.863512:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800982c7400/0x2fa243e067ccd04b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a810 expref: 33 pid: 7232 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.863521:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.863524:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.863530:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.863538:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.863562:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142911.863580:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863587:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142911.863590:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a01850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867396608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.863595:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6434 00000004:00200000:2.0:1746142911.863619:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00000004:00200000:2.0:1746142911.863623:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142911.863634:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863642:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863655:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863661:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863668:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863673:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863678:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009495ca00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142911.863680:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863688:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863695:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142911.863698:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142911.863700:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863708:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495ca00/0x2fa243e067ccd178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863716:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863721:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863725:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863728:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009495c000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142911.863730:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863734:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863738:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4300) 00010000:00010000:2.0:1746142911.863740:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142911.863742:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863745:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c000/0x2fa243e067ccd17f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.863768:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495de00/0x2fa243e067ccd171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 23 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.863777:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 22 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.863782:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142911.863784:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142911.863785:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495d600, rc 0) 00000100:00100000:2.0:1746142911.863820:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+22:32444:x1830962867395840:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 13009us (13220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.863825:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14440 00000100:00100000:0.0:1746142911.866363:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.866395:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.866419:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.866803:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396736 00000100:00100000:0.0:1746142911.866807:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.866810:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396736 00000100:00100000:0.0:1746142911.866831:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.866837:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396992 00000100:00100000:3.0:1746142911.866839:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396992 00000100:00100000:3.0:1746142911.866849:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867397248 00000100:00100000:3.0:1746142911.866850:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867397248 00000100:00100000:0.0:1746142911.866853:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867396864 00000100:00100000:0.0:1746142911.866855:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867396864 00000100:00100000:3.0:1746142911.866857:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867397120 00000100:00100000:3.0:1746142911.866859:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867397120 00000100:00100000:3.0:1746142911.866897:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14258 00000100:00100000:3.0:1746142911.866924:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867396736:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142911.866937:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.866949:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1a00/0x2fa243e067ccd18d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a928 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.866994:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867820032:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142911.867044:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.867089:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14259 00000100:00100000:2.0:1746142911.867096:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867396992:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142911.867102:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.867110:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a936 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.867121:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.867123:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.867130:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 9 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142911.867134:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14260 00000100:00100000:1.0:1746142911.867140:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867397248:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142911.867141:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 9 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.867145:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.867149:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795e00, rc 0) 00010000:00010000:1.0:1746142911.867151:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a944 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.867159:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.867160:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142911.867165:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142911.867166:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867396992:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 72us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.867170:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14259 00010000:00010000:1.0:1746142911.867173:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.867178:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc29800, rc 0) 00000100:00100000:2.0:1746142911.867183:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14261 00000100:00100000:2.0:1746142911.867187:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867397120:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1746142911.867191:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867397248:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 52us (771us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142911.867192:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142911.867195:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14260 00010000:00010000:2.0:1746142911.867197:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a93d expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.867203:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14262 00010000:00010000:2.0:1746142911.867204:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.867205:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142911.867207:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867396864:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142911.867209:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 9 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.867213:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.867217:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 9 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.867218:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc29400/0x2fa243e067ccd1a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a92f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.867223:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097794c00, rc 0) 00000100:00100000:2.0:1746142911.867233:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867397120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 46us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.867235:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867820160:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142911.867238:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14261 00000100:00100000:1.0:1746142911.867254:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.870543:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867820032:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.870571:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1a00/0x2fa243e067ccd18d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a928 expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.870587:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1a00/0x2fa243e067ccd18d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a928 expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.870596:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1a00, rc 0) 00000100:00100000:3.0:1746142911.870633:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867396736:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3709us (4275us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.870640:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14258 00000100:00100000:1.0:1746142911.870682:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867820160:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142911.870697:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29400/0x2fa243e067ccd1a9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a92f expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.870705:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29400/0x2fa243e067ccd1a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a92f expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.870726:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc29400, rc 0) 00000100:00100000:1.0:1746142911.870742:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867396864:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3534us (3935us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142911.870748:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14262 00000100:00100000:0.0:1746142911.872781:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.872929:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867397504 00000100:00100000:2.0:1746142911.872936:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867397504 00000100:00100000:2.0:1746142911.872984:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14441 00000100:00100000:2.0:1746142911.872992:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+22:32444:x1830962867397504:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142911.873005:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.873020:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c800/0x2fa243e067ccd1b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a94b expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.873097:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.873114:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 23 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.873121:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.873144:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 23 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.873154:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 23 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.873163:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867820288:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.873413:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.875654:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867820288:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142911.875673:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142911.876394:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.876612:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867397632 00000100:00100000:3.0:1746142911.876617:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867397632 00010000:00010000:3.0:1746142911.876643:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.876664:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6435 00000100:00100000:3.0:1746142911.876670:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+24:2005:x1830962867397632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.876680:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.876685:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.876693:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.876709:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d600/0x2fa243e067ccd186 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a921 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.876719:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.876723:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.876731:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.876737:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.877039:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142911.877131:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.877137:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142911.877154:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00010000:00010000:0.0:1746142911.877245:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c800/0x2fa243e067ccd1b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 25 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.877276:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+24:2005:x1830962867397632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 605us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.877282:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6435 00010000:00010000:0.0:1746142911.877511:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 23 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.877518:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142911.877520:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142911.877522:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495c600, rc 0) 00000100:00100000:0.0:1746142911.877837:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867397504:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4845us (5063us total) trans 8589936608 rc 0/0 00000100:00100000:0.0:1746142911.877844:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14441 00000100:00100000:0.0:1746142911.879503:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.880216:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867397760 00000100:00100000:2.0:1746142911.880224:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867397760 00000100:00100000:2.0:1746142911.880268:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14442 00000100:00100000:2.0:1746142911.880274:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867397760:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142911.880294:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.880309:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd1c5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a952 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.880382:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.880398:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.880404:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.880427:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.880437:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.880447:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867820416:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.880510:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.882234:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.882307:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867820416:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.882324:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142911.882505:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867397888 00000100:00100000:3.0:1746142911.882510:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867397888 00010000:00010000:3.0:1746142911.882531:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 25 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.882550:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6436 00000100:00100000:3.0:1746142911.882556:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+25:2005:x1830962867397888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.882565:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.882570:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 25 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.882578:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 25 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.882594:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c600/0x2fa243e067ccd1b7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a94b expref: 25 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.882604:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142911.882608:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.882614:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.882621:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142911.882634:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.882673:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+24:2005:x1830962867397888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 117us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.882679:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6436 00010000:00010000:0.0:1746142911.882963:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.882970:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:0.0:1746142911.883005:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00000004:00200000:0.0:1746142911.883008:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142911.883020:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.883042:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2000/0x2fa243e067ccd1c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.883056:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 23 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.883061:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142911.883063:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142911.883065:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:0.0:1746142911.883087:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867397760:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2813us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.883093:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14442 00000100:00100000:0.0:1746142911.886826:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.886867:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.886934:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398016 00000100:00100000:1.0:1746142911.886941:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398016 00000100:00100000:1.0:1746142911.887196:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398144 00000100:00100000:1.0:1746142911.887200:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398144 00000100:00100000:3.0:1746142911.887260:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14263 00000100:00100000:3.0:1746142911.887268:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867398016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142911.887284:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142911.887297:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1600/0x2fa243e067ccd1d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a959 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.887351:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867820544:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142911.887438:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14264 00000100:00100000:1.0:1746142911.887443:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867398144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142911.887449:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142911.887455:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb400/0x2fa243e067ccd1da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a960 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.887478:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867820672:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142911.888127:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.888247:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142911.889362:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867820672:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142911.889386:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb400/0x2fa243e067ccd1da lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a960 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.889397:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb400/0x2fa243e067ccd1da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a960 expref: 13 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142911.889420:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fb400, rc 0) 00000100:00100000:1.0:1746142911.889447:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867398144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2004us (2579us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142911.889454:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14264 00000100:00100000:3.0:1746142911.889525:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867820544:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142911.889539:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1600/0x2fa243e067ccd1d3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a959 expref: 11 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.889547:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1600/0x2fa243e067ccd1d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a959 expref: 11 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.889559:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1600, rc 0) 00000100:00100000:3.0:1746142911.889574:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867398016:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2308us (2756us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142911.889580:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14263 00000100:00100000:0.0:1746142911.892146:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.892392:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398400 00000100:00100000:2.0:1746142911.892399:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398400 00000100:00100000:2.0:1746142911.892690:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14443 00000100:00100000:2.0:1746142911.892699:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867398400:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142911.892713:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.892727:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccd1e1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a967 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.892794:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.892807:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.892816:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142911.892824:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00010000:00010000:2.0:1746142911.892897:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067ccd1e1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 26 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.893280:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 25 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.893288:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142911.893290:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142911.893293:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3400, rc 0) 00000100:00100000:2.0:1746142911.893454:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+25:32444:x1830962867398400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 755us (1313us total) trans 8589936609 rc 0/0 00000100:00100000:2.0:1746142911.893460:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14443 00000100:00100000:0.0:1746142911.895502:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.895554:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.895702:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.895797:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.895813:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398656 00000100:00100000:3.0:1746142911.895820:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398656 00000100:00100000:1.0:1746142911.895895:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398912 00000100:00100000:1.0:1746142911.895919:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398912 00000100:00100000:3.0:1746142911.896124:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399168 00000100:00100000:3.0:1746142911.896127:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399168 00000100:00100000:3.0:1746142911.896142:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398528 00000100:00100000:3.0:1746142911.896144:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398528 00000100:00100000:3.0:1746142911.896157:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14265 00000100:00100000:3.0:1746142911.896163:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867398656:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142911.896194:0:1852:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896208:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896215:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142911.896216:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142911.896218:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896241:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896251:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 23 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.896263:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867820800:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.896314:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.896330:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14266 00000100:00100000:3.0:1746142911.896335:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867398912:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142911.896361:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896371:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896377:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896384:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 49 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896388:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.896389:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.896391:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896402:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 49 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896409:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 49 pid: 9579 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.896416:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867820928:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.896435:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 10 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896442:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 10 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.896448:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867821056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.896461:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896467:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.896473:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867821184:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.896482:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.896494:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14267 00000100:00100000:3.0:1746142911.896498:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867399168:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142911.896509:0:9578:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896517:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 39 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896527:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896533:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 23 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896537:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.896538:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.896540:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896550:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 23 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896556:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 23 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.896561:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867821312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.896576:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896582:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 11 pid: 1853 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.896588:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867821440:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.896602:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 39 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896608:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 39 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.896613:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867821568:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.896622:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142911.896643:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14268 00000100:00100000:3.0:1746142911.896647:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867398528:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142911.896659:0:9579:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896667:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896672:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896678:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896682:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.896682:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.896684:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896698:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896704:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.896710:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867821696:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.896725:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142911.896731:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 10 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.896737:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867821824:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.896749:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.896754:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 49 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.896760:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867821952:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.896767:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.897435:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.897479:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.897697:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867398784 00000100:00100000:0.0:1746142911.897701:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867398784 00000100:00100000:0.0:1746142911.897724:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399040 00000100:00100000:0.0:1746142911.897726:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399040 00000100:00100000:0.0:1746142911.897736:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14269 00000100:00100000:0.0:1746142911.897740:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867398784:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142911.897754:0:11943:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.897764:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.897769:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142911.897771:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142911.897772:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.897787:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.897795:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 23 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.897802:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867822080:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142911.897834:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142911.897919:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14270 00000100:00100000:2.0:1746142911.897925:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867399040:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142911.897939:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897947:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897958:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 11 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.897964:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897969:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 49 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897975:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897979:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746142911.897980:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746142911.897981:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 8/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897992:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.897998:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 21 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.898004:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822208:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.898029:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 49 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.898036:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 49 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.898041:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822336:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.898054:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.898060:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.898065:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822464:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.898078:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 11 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142911.898084:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 11 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746142911.898089:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822592:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.898103:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.898108:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.898118:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822720:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.898127:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.906834:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.906862:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.906882:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399936 00000100:00100000:0.0:1746142911.906888:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399936 00002000:00100000:0.0:1746142911.906938:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1916928->2097151) req@ffff880130122300 x1830962867399936/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.906946:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130122300 with x1830962867399936 ext(1916928->2097151) 00010000:00010000:0.0:1746142911.906953:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.906963:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 24 pid: 9579 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746142911.906972:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130122300 00000100:00100000:0.0:1746142911.906986:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1374 00000100:00100000:0.0:1746142911.906992:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867399936:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142911.907193:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800968eb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867822080:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142911.907211:0:11943:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.907271:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867821312:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.907278:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867821440:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.907283:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097431c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867821568:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.907295:0:9578:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.907308:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399680 00000100:00100000:2.0:1746142911.907311:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399680 00010000:00010000:2.0:1746142911.907324:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746142911.907347:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6437 00000100:00100000:2.0:1746142911.907352:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867399680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.907359:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.907370:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746142911.907378:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 12 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746142911.907394:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.907413:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867399680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 61us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.907418:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6437 00000100:00100000:2.0:1746142911.907437:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822208:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.907443:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822336:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.907448:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822464:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.907453:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822592:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.907458:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e89500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867822720:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.907475:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.909251:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867821696:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.909265:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82a00/0x2fa243e067cccfc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7a7 expref: 11 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.909292:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867821824:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.909302:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867821952:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.909318:0:9579:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.909353:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867820928:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.909360:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867821056:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142911.909366:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867821184:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.909381:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.909400:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867820800:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142911.909408:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142911.910650:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.910678:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.910708:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.910754:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400192 00000100:00100000:3.0:1746142911.910760:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400192 00010000:00010000:3.0:1746142911.910782:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 11 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.910798:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400576 00000100:00100000:3.0:1746142911.910800:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400576 00010000:00010000:3.0:1746142911.910807:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 50 pid: 1854 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.910817:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400320 00000100:00100000:3.0:1746142911.910819:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400320 00010000:00010000:3.0:1746142911.910825:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 22 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.910834:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6438 00000100:00100000:3.0:1746142911.910839:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867400192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.910849:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.910865:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 11 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.910874:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 11 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.910891:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccd194 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a936 expref: 11 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.910924:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.910955:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2003:x1830962867400192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.910961:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6438 00000100:00100000:3.0:1746142911.910974:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6439 00000100:00100000:3.0:1746142911.910978:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2003:x1830962867400576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.910993:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.911001:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 50 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.911009:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 50 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.911022:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3ea00/0x2fa243e067ccd02f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 8 type: EXT [5029888->18446744073709551615] (req 5029888->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a7fb expref: 50 pid: 1854 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.911030:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.911043:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867400576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.911048:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6439 00000100:00100000:3.0:1746142911.911058:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6440 00000100:00100000:3.0:1746142911.911062:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867400320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.911068:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.911074:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 22 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.911081:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 22 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.912075:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a1000/0x2fa243e067ccd0ec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [5062656->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a89c expref: 22 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.912084:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.912105:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867400320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1042us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.912111:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6440 00000100:00100000:3.0:1746142911.913961:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.913996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914024:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400832 00000100:00100000:3.0:1746142911.914031:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400832 00010000:00010000:3.0:1746142911.914054:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.914084:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399424 00000100:00100000:3.0:1746142911.914086:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399424 00010000:00010000:3.0:1746142911.914097:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 26 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.914109:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399808 00000100:00100000:3.0:1746142911.914111:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399808 00010000:00010000:3.0:1746142911.914120:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.914137:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6441 00000100:00100000:3.0:1746142911.914143:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a01450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867400832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142911.914150:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6442 00010000:00010000:3.0:1746142911.914154:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142911.914158:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867399424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.914167:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.914169:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.914178:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.914178:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 27 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:0.0:1746142911.914188:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 27 pid: 1852 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.914199:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd89800/0x2fa243e067ccd139 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3194880->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e9 expref: 49 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.914202:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097794400/0x2fa243e067ccd10f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8bf expref: 27 pid: 1852 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.914209:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6443 00010000:00010000:3.0:1746142911.914214:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142911.914215:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142911.914216:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867399808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.914223:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.914232:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.914245:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.914257:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067cccf5d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a75a expref: 21 pid: 1397 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.914270:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.914409:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a01450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867400832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 265us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.914409:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867399424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 251us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.914414:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6441 00000100:00100000:0.0:1746142911.914418:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6442 00000100:00100000:3.0:1746142911.914473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.914488:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400448 00000100:00100000:0.0:1746142911.914491:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400448 00000100:00100000:3.0:1746142911.914507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914516:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399296 00000100:00100000:3.0:1746142911.914519:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399296 00002000:00100000:0.0:1746142911.914519:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1257471) req@ffff880096141c00 x1830962867400448/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.914527:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141c00 with x1830962867400448 ext(1048576->1257471) 00010000:00010000:3.0:1746142911.914529:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.914538:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 27 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.914548:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 27 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.914549:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867399808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 322us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.914552:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6444 00000100:00100000:1.0:1746142911.914556:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6443 00000100:00100000:3.0:1746142911.914557:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867399296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1746142911.914558:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096141c00 00010000:00010000:3.0:1746142911.914562:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142911.914570:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 21 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.914577:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 20 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.914588:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067ccd075 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a833 expref: 20 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.914600:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.914614:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867399296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.914616:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1375 00000100:00100000:3.0:1746142911.914620:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6444 00000100:00100000:0.0:1746142911.914622:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867400448:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142911.914651:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914661:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867399552 00000100:00100000:3.0:1746142911.914664:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867399552 00010000:00010000:3.0:1746142911.914673:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 13 pid: 1853 timeout: 785 lvb_type: 1 00000100:00100000:1.0:1746142911.914675:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867399936:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7674us (7803us total) trans 17179873930 rc 0/0 00000100:00100000:1.0:1746142911.914681:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1374 00002000:00100000:1.0:1746142911.914685:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1916928->2097151) req@ffff880130122300 x1830962867399936/t17179873930(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142911.914686:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6445 00000100:00100000:3.0:1746142911.914690:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867399552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746142911.914692:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130122300 with x1830962867399936 ext(1916928->2097151) 00010000:00010000:3.0:1746142911.914696:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.914697:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 27 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.914703:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 13 pid: 1853 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.914710:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 13 pid: 1853 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.914718:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 27 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.914720:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29800/0x2fa243e067ccd19b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a944 expref: 13 pid: 1853 timeout: 785 lvb_type: 1 00002000:00010000:1.0:1746142911.914723:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130122300 00010000:00010000:3.0:1746142911.914728:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142911.914741:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867399552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.914748:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6445 00000100:00100000:3.0:1746142911.914777:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914813:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142911.914864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.914866:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400064 00000100:00100000:1.0:1746142911.914869:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400064 00000100:00100000:3.0:1746142911.914874:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400704 00000100:00100000:3.0:1746142911.914876:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400704 00010000:00010000:3.0:1746142911.914886:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 10 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.914889:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 48 pid: 9579 timeout: 785 lvb_type: 1 00000100:00100000:3.0:1746142911.916640:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867400960 00000100:00100000:2.0:1746142911.916647:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401088 00000100:00100000:3.0:1746142911.916648:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867400960 00000100:00100000:2.0:1746142911.916652:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401088 00000100:00100000:1.0:1746142911.916662:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6446 00010000:00010000:3.0:1746142911.916667:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 19 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:1.0:1746142911.916669:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867400704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.916670:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:1.0:1746142911.916679:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142911.916681:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6447 00000100:00100000:2.0:1746142911.916686:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6448 00000100:00100000:3.0:1746142911.916687:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867400064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142911.916690:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 10 pid: 9580 timeout: 785 lvb_type: 1 00000100:00100000:2.0:1746142911.916691:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867400960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142911.916694:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.916697:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142911.916699:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 10 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:3.0:1746142911.916702:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 48 pid: 9579 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746142911.916706:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 19 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.916711:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 48 pid: 9579 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.916711:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097794c00/0x2fa243e067ccd1a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a93d expref: 10 pid: 9580 timeout: 785 lvb_type: 1 00010000:00010000:2.0:1746142911.916715:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 19 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.916721:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccd09f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a848 expref: 48 pid: 9579 timeout: 785 lvb_type: 1 00010000:00010000:1.0:1746142911.916734:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142911.916735:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.916736:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.916740:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916740:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800987ff600/0x2fa243e067ccd147 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8f7 expref: 19 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:3.0:1746142911.916747:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142911.916748:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6449 00010000:00010000:2.0:1746142911.916754:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.916755:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746142911.916755:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867401088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142911.916758:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142911.916758:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867400704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (1945us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142911.916762:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142911.916763:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6446 00010000:00010000:2.0:1746142911.916764:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916765:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142911.916771:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:2.0:1746142911.916776:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142911.916780:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.916781:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867400064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (2003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.916787:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6447 00010000:00010000:0.0:1746142911.916792:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e670200/0x2fa243e067ccd101 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8b1 expref: 40 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.916794:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867400960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (1946us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142911.916799:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142911.916800:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6448 00010000:00010000:0.0:1746142911.916801:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142911.916804:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.916804:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.916810:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916811:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.916822:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142911.916824:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916828:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916829:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916835:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916835:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142911.916836:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867401088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.916840:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6449 00010000:00010000:3.0:1746142911.916845:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea40e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142911.916845:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916846:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916848:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916852:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916854:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916855:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916862:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916863:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916866:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.916868:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea40e00/0x2fa243e067ccd1fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916868:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916870:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea40400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142911.916873:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916878:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916879:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916882:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142911.916885:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916888:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916890:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142911.916893:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea40400/0x2fa243e067ccd204 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.916920:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867398912:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 20563us (21344us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142911.916920:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.916926:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3000/0x2fa243e067ccd219 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.916927:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14266 00000100:00100000:1.0:1746142911.916954:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867399168:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 20454us (21250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142911.916967:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14267 00000100:00100000:2.0:1746142911.917936:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867399040:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 20010us (20455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.917943:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14270 00000100:00100000:3.0:1746142911.917975:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.918039:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401216 00000100:00100000:0.0:1746142911.918043:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401216 00010000:00010000:0.0:1746142911.918056:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 47 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.918070:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6450 00000100:00100000:0.0:1746142911.918074:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2003:x1830962867401216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.918080:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.918087:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 47 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.918094:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 47 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.918104:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cccf10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a722 expref: 47 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.918116:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.918118:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.918120:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.918125:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.918148:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.918169:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2003:x1830962867401216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 95us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.918175:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6450 00010000:00010000:3.0:1746142911.918296:0:9579:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918303:0:9579:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918314:0:9579:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918323:0:9579:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918329:0:9579:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918333:0:9579:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa51600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142911.918336:0:9579:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918350:0:9579:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918358:0:9579:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.918363:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa51600/0x2fa243e067ccd20b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.918392:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962867398528:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 21744us (22594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.918398:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14268 00000100:00100000:1.0:1746142911.923939:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.925240:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401344 00000100:00100000:0.0:1746142911.925247:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401344 00010000:00010000:0.0:1746142911.925274:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 27 pid: 9579 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.925305:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6451 00000100:00100000:0.0:1746142911.925311:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867401344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.925322:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.925338:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 27 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.925357:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 27 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.925380:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd88c00/0x2fa243e067ccd116 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1916928->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8c6 expref: 27 pid: 9579 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.925392:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.925393:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.925397:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.925404:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.925434:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.925476:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867401344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 164us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.925482:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6451 00010000:00010000:3.0:1746142911.926076:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926085:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926099:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926105:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926110:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926115:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0a1400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142911.926117:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926123:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926132:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142911.926137:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1400/0x2fa243e067ccd1f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142911.926179:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867398656:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 30015us (30680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142911.926185:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14265 00000100:00100000:0.0:1746142911.928651:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867400448:12345-192.168.204.50@tcp:4:cat.0 Request processed in 14023us (14171us total) trans 17179873931 rc 0/0 00000100:00100000:0.0:1746142911.928661:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1375 00002000:00100000:0.0:1746142911.928671:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1257471) req@ffff880096141c00 x1830962867400448/t17179873931(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:62/0 lens 488/448 e 0 to 0 dl 1746142922 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.928680:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141c00 with x1830962867400448 ext(1048576->1257471) 00010000:00010000:0.0:1746142911.928687:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.928699:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 785 lvb_type: 0 00002000:00010000:0.0:1746142911.928705:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096141c00 00000100:00100000:2.0:1746142911.929161:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.929180:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401600 00000100:00100000:2.0:1746142911.929185:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401600 00000100:00100000:2.0:1746142911.929216:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14444 00000100:00100000:2.0:1746142911.929221:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+65:32447:x1830962867401600:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.929238:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.929252:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a96e expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.929326:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.929337:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.929355:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.929360:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.929382:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.929391:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.929400:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867822848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.929450:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 24 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.929456:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:2.0:1746142911.929463:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867822976:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.929474:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142911.931061:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.931088:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.932370:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.932447:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e89c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867822848:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142911.932455:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867822976:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142911.932472:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142911.932537:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401728 00000100:00100000:3.0:1746142911.932542:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401728 00010000:00010000:3.0:1746142911.932562:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 25 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.932578:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401856 00000100:00100000:3.0:1746142911.932579:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401856 00010000:00010000:3.0:1746142911.932587:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 785 lvb_type: 0 00000100:00100000:3.0:1746142911.933402:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867401984 00000100:00100000:3.0:1746142911.933406:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867401984 00010000:00010000:3.0:1746142911.933418:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 26 pid: 10924 timeout: 785 lvb_type: 0 00000100:00100000:0.0:1746142911.933488:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6452 00000100:00100000:0.0:1746142911.933496:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+26:2003:x1830962867401728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.933507:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.933512:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 26 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933520:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 26 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933538:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2c00/0x2fa243e067ccd1cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a952 expref: 26 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933549:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142911.933552:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.933559:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.933564:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.933594:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+25:2003:x1830962867401728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.933600:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6452 00000100:00100000:0.0:1746142911.933612:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6453 00000100:00100000:0.0:1746142911.933616:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867401856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.933622:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.933738:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933747:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933759:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2600/0x2fa243e067ccd132 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a8e2 expref: 26 pid: 1853 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933769:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.933771:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142911.933775:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.933783:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.933798:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142911.933811:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867401856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 194us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.933816:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6453 00000100:00100000:0.0:1746142911.933825:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6454 00000100:00100000:0.0:1746142911.933829:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+24:2003:x1830962867401984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142911.933834:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142911.933838:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933845:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933854:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067ccd1e8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a967 expref: 24 pid: 10924 timeout: 785 lvb_type: 0 00010000:00010000:0.0:1746142911.933861:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142911.933864:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.933869:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.933874:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142911.934907:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142911.935007:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142911.935015:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142911.935030:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00010000:00010000:2.0:1746142911.935119:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 68 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.935129:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 67 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.935135:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142911.935137:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142911.935139:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0400, rc 0) 00000100:00100000:0.0:1746142911.935438:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+23:2003:x1830962867401984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1605us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.935445:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6454 00010000:00010000:0.0:1746142911.935465:0:11943:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935472:0:11943:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935488:0:11943:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935495:0:11943:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935500:0:11943:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935506:0:11943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800987ffa00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142911.935509:0:11943:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935514:0:11943:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935525:0:11943:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142911.935530:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800987ffa00/0x2fa243e067ccd212 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142911.935679:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+67:32447:x1830962867401600:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6456us (6517us total) trans 8589936610 rc 0/0 00000100:00100000:2.0:1746142911.935686:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14444 00000100:00100000:0.0:1746142911.937121:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867398784:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 39376us (39683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142911.937129:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14269 00000100:00100000:0.0:1746142911.939176:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.939570:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867402240 00000100:00100000:2.0:1746142911.939578:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867402240 00000100:00100000:2.0:1746142911.939626:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14445 00000100:00100000:2.0:1746142911.939788:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867402240:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1746142911.939830:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142911.939855:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3f200/0x2fa243e067ccc73e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a24b expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.939868:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142911.939872:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142911.940506:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+22:32444:x1830962867402240:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 873us (1334us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746142911.940513:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14445 00000100:00100000:0.0:1746142911.946027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.946735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.946850:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867402624 00000100:00100000:1.0:1746142911.946858:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867402624 00000100:00100000:1.0:1746142911.946931:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5266 00000100:00100000:1.0:1746142911.946940:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+22:32444:x1830962867402624:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:1.0:1746142911.947090:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867402624:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 151us (355us total) trans 8589936611 rc 0/0 00000100:00100000:1.0:1746142911.947095:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5266 00000100:00100000:2.0:1746142911.947535:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867402368 00000100:00100000:2.0:1746142911.947540:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867402368 00000100:00100000:2.0:1746142911.947892:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14271 00000100:00100000:2.0:1746142911.953589:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32447:x1830962867402368:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142911.953608:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142911.953626:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a975 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142911.953645:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c0, atime: 0x681406bf, ctime: 0x681406c0, blocks: 0x800 00010000:00010000:2.0:1746142911.953662:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.953664:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142911.953669:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 40 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.953682:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 40 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142911.953691:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0a00, rc 0) 00000100:00100000:2.0:1746142911.953885:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32447:x1830962867402368:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5985us (7907us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142911.953895:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14271 00000100:00100000:0.0:1746142911.954017:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142911.954278:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867402880 00000100:00100000:2.0:1746142911.954284:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867402880 00000100:00100000:2.0:1746142911.954314:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5267 00000100:00100000:2.0:1746142911.954319:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+23:32444:x1830962867402880:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142911.954438:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+24:32444:x1830962867402880:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 119us (422us total) trans 8589936612 rc 0/0 00000100:00100000:2.0:1746142911.954444:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5267 00000100:00100000:1.0:1746142911.956693:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142911.956746:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867403136 00000100:00100000:0.0:1746142911.956752:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867403136 00002000:00100000:0.0:1746142911.956781:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->1175551) req@ffff880088d61f80 x1830962867403136/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.956789:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d61f80 with x1830962867403136 ext(1171456->1175551) 00002000:00010000:0.0:1746142911.956793:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d61f80 00000100:00100000:0.0:1746142911.956812:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4404 00000100:00100000:0.0:1746142911.956818:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867403136:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142911.956931:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867403136:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 113us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142911.956937:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4404 00002000:00100000:0.0:1746142911.956942:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->1175551) req@ffff880088d61f80 x1830962867403136/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142911.956950:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d61f80 with x1830962867403136 ext(1171456->1175551) 00002000:00010000:0.0:1746142911.956953:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d61f80 00000100:00100000:0.0:1746142911.963065:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142911.963305:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867403392 00000100:00100000:1.0:1746142911.963313:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867403392 00002000:00100000:1.0:1746142911.963355:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1310720->1314815) req@ffff8800924f4700 x1830962867403392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/0 e 0 to 0 dl 1746142922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.963364:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f4700 with x1830962867403392 ext(1310720->1314815) 00002000:00010000:1.0:1746142911.963369:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f4700 00000100:00100000:1.0:1746142911.963385:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4405 00000100:00100000:1.0:1746142911.963391:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867403392:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142911.963509:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867403392:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 117us (452us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142911.963516:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4405 00002000:00100000:1.0:1746142911.963521:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1310720->1314815) req@ffff8800924f4700 x1830962867403392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:62/0 lens 488/4536 e 0 to 0 dl 1746142922 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142911.963528:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f4700 with x1830962867403392 ext(1310720->1314815) 00002000:00010000:1.0:1746142911.963531:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f4700 00000100:00100000:0.0:1746142912.009485:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.009550:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867403648 00000100:00100000:2.0:1746142912.009558:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867403648 00000100:00100000:2.0:1746142912.009617:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14446 00000100:00100000:2.0:1746142912.009625:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:32451:x1830962867403648:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142912.009645:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.009660:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0800/0x2fa243e067ccd23c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a97c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.009746:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142912.009759:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142912.009769:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:2.0:1746142912.009778:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00010000:00010000:2.0:1746142912.009859:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0800/0x2fa243e067ccd23c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 35 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.009894:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 34 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.009924:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.009927:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142912.009930:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a1c00, rc 0) 00000100:00100000:2.0:1746142912.009968:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:32451:x1830962867403648:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 343us (490us total) trans 8589936613 rc 0/0 00000100:00100000:2.0:1746142912.009974:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14446 00000100:00100000:0.0:1746142912.015452:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.015539:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867403776 00000100:00100000:2.0:1746142912.015546:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867403776 00000100:00100000:2.0:1746142912.015599:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14272 00000100:00100000:2.0:1746142912.015606:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:32451:x1830962867403776:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142912.015622:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.015639:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a983 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142912.015657:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c0, atime: 0x681406bc, ctime: 0x681406c0, blocks: 0x808 00010000:00010000:2.0:1746142912.015675:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.015676:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.015682:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.015695:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.015707:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a1400, rc 0) 00000100:00100000:2.0:1746142912.015740:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:32451:x1830962867403776:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.015745:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14272 00000100:00100000:0.0:1746142912.017664:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.017776:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404032 00000100:00100000:2.0:1746142912.017782:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404032 00002000:00100000:2.0:1746142912.017816:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1060864->1064959) req@ffff8800924f7800 x1830962867404032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.017825:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7800 with x1830962867404032 ext(1060864->1064959) 00002000:00010000:2.0:1746142912.017829:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f7800 00000100:00100000:2.0:1746142912.018133:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4406 00000100:00100000:2.0:1746142912.018141:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867404032:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.018241:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867404032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 101us (581us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.018247:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4406 00002000:00100000:2.0:1746142912.018252:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1060864->1064959) req@ffff8800924f7800 x1830962867404032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.018258:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7800 with x1830962867404032 ext(1060864->1064959) 00002000:00010000:2.0:1746142912.018260:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f7800 00000100:00100000:0.0:1746142912.023750:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.023835:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404288 00000100:00100000:1.0:1746142912.023842:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404288 00002000:00100000:1.0:1746142912.023873:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1191936->1196031) req@ffff8800938d3800 x1830962867404288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.023888:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3800 with x1830962867404288 ext(1191936->1196031) 00002000:00010000:1.0:1746142912.023892:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938d3800 00000100:00100000:1.0:1746142912.023931:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4407 00000100:00100000:1.0:1746142912.023937:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867404288:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142912.024041:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867404288:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 104us (298us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142912.024046:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4407 00002000:00100000:1.0:1746142912.024051:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1191936->1196031) req@ffff8800938d3800 x1830962867404288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.024057:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d3800 with x1830962867404288 ext(1191936->1196031) 00002000:00010000:1.0:1746142912.024059:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938d3800 00000100:00100000:0.0:1746142912.032270:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.032307:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.033602:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.033800:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404416 00000100:00100000:2.0:1746142912.033808:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404416 00000100:00100000:0.0:1746142912.033813:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.033834:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.033977:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404544 00000100:00100000:2.0:1746142912.033977:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404672 00000100:00100000:3.0:1746142912.033980:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404544 00000100:00100000:2.0:1746142912.033980:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404672 00000100:00100000:1.0:1746142912.034015:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404800 00000100:00100000:1.0:1746142912.034018:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404800 00000100:00100000:3.0:1746142912.034045:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867404928 00000100:00100000:3.0:1746142912.034047:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867404928 00000100:00100000:2.0:1746142912.034050:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14273 00000100:00100000:2.0:1746142912.034056:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867404416:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142912.034058:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14274 00000100:00100000:3.0:1746142912.034062:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867404672:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142912.034073:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14275 00010000:00010000:2.0:1746142912.034074:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142912.034076:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867404544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.034081:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.034090:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067ccd25f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a991 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.034090:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a98a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142912.034109:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406bf, atime: 0x681406bf, ctime: 0x681406bf, blocks: 0x7f0 00010000:00010000:2.0:1746142912.034118:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.034120:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.034126:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 49 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142912.034132:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823104:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.034139:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 49 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.034147:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a1200, rc 0) 00000100:00100000:2.0:1746142912.034175:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867404416:12345-192.168.204.50@tcp:101:cat.0 Request processed in 119us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.034180:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14273 00000100:00100000:3.0:1746142912.034189:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.034193:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14276 00000100:00100000:2.0:1746142912.034197:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867404800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.034202:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142912.034204:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14277 00000100:00100000:3.0:1746142912.034209:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867404928:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.034209:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a99f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.034213:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.034218:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9a6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142912.034218:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c0, atime: 0x681406c0, ctime: 0x681406c0, blocks: 0x16b0 00010000:00010000:2.0:1746142912.034224:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.034226:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746142912.034229:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c0, atime: 0x681406c0, ctime: 0x681406c0, blocks: 0x1008 00010000:00010000:2.0:1746142912.034229:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 49 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.034236:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.034237:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.034241:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.034250:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 43 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.034257:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a400, rc 0) 00000100:00100000:3.0:1746142912.034271:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867404928:12345-192.168.204.50@tcp:101:cat.0 Request processed in 62us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.034275:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14277 00010000:00010000:3.0:1746142912.034289:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.034296:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a998 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142912.034305:0:1852:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406bf, atime: 0x681406bf, ctime: 0x681406bf, blocks: 0x808 00010000:00010000:3.0:1746142912.034312:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.034313:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.034317:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 50 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.034329:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 50 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.034329:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.034335:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a800, rc 0) 00010000:00010000:2.0:1746142912.034335:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a0e00, rc 0) 00000100:00100000:2.0:1746142912.034405:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2004:x1830962867404800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 206us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.034409:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14276 00000100:00100000:3.0:1746142912.034642:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867404672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 295us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.034648:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14274 00002000:00010000:3.0:1746142912.036933:0:9579:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142908 -> 1746142912 00000100:00100000:3.0:1746142912.036949:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823104:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.036970:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067ccd25f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a991 expref: 42 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.036979:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067ccd25f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a991 expref: 42 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.036998:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3ae00, rc 0) 00000100:00100000:3.0:1746142912.037028:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867404544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2949us (4720us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.037033:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14275 00000100:00100000:0.0:1746142912.039536:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.039704:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405184 00000100:00100000:2.0:1746142912.039711:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405184 00002000:00100000:2.0:1746142912.039742:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938d0000 x1830962867405184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.039751:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d0000 with x1830962867405184 ext(0->1048575) 00002000:00010000:2.0:1746142912.039755:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d0000 00000100:00100000:2.0:1746142912.039779:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4408 00000100:00100000:2.0:1746142912.039786:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867405184:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.050231:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867405184:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10435us (10692us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.050242:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4408 00002000:00100000:2.0:1746142912.050252:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938d0000 x1830962867405184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.050260:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d0000 with x1830962867405184 ext(0->1048575) 00002000:00010000:2.0:1746142912.050264:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d0000 00000100:00100000:0.0:1746142912.059124:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.059223:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405312 00000100:00100000:3.0:1746142912.059231:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405312 00000100:00100000:3.0:1746142912.059276:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14278 00000100:00100000:3.0:1746142912.059284:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32454:x1830962867405312:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.059301:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.059316:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9ad expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.059350:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.059357:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.059359:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.059362:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 42 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.059387:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.059398:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 25 pid: 11943 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.059409:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823232:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.059500:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.060842:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823232:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.060860:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 42 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.060871:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3b400, rc 0) 00000100:00100000:3.0:1746142912.061295:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32454:x1830962867405312:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2010us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.061303:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14278 00000100:00100000:0.0:1746142912.063697:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.063744:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405440 00000100:00100000:2.0:1746142912.063751:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405440 00002000:00100000:2.0:1746142912.063784:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1060864->1196031) req@ffff8800938d2d80 x1830962867405440/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.063793:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2d80 with x1830962867405440 ext(1060864->1196031) 00010000:00010000:2.0:1746142912.063801:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 26 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.063813:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 26 pid: 11943 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.063819:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d2d80 00000100:00100000:2.0:1746142912.063850:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1376 00000100:00100000:2.0:1746142912.063857:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867405440:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142912.068846:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867405440:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4983us (5149us total) trans 17179873932 rc 0/0 00000100:00100000:2.0:1746142912.068855:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1376 00002000:00100000:2.0:1746142912.068862:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1060864->1196031) req@ffff8800938d2d80 x1830962867405440/t17179873932(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.068868:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2d80 with x1830962867405440 ext(1060864->1196031) 00010000:00010000:2.0:1746142912.068876:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 28 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.068885:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 28 pid: 11943 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.068893:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800938d2d80 00000100:00100000:0.0:1746142912.070440:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.070736:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405568 00000100:00100000:2.0:1746142912.070744:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405568 00010000:00010000:2.0:1746142912.070770:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 28 pid: 11943 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.070836:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6455 00000100:00100000:1.0:1746142912.070844:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867405568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.070857:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.070872:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 28 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.070882:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 28 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.070924:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a1400/0x2fa243e067ccd251 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->1196031) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a983 expref: 28 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.070950:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.070952:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.070958:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 41 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.070964:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 41 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.070988:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 41 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.070998:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867823360:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142912.071061:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.073174:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867823360:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.073190:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.073225:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867405568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2381us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.073233:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6455 00000100:00100000:0.0:1746142912.077325:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.077736:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.077842:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.077966:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.077991:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405696 00000100:00100000:3.0:1746142912.077999:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405696 00000100:00100000:3.0:1746142912.078035:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405824 00000100:00100000:3.0:1746142912.078036:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405824 00000100:00100000:3.0:1746142912.078047:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867405952 00000100:00100000:3.0:1746142912.078048:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867405952 00000100:00100000:3.0:1746142912.078059:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14279 00000100:00100000:3.0:1746142912.078065:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867405696:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.078080:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.078094:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9b4 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.078112:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.078114:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.078121:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 19 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.078134:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 19 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.078143:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3ae00, rc 0) 00000100:00100000:3.0:1746142912.078184:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867405696:12345-192.168.204.50@tcp:101:cat.0 Request processed in 119us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.078189:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14279 00000100:00100000:3.0:1746142912.078202:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14280 00000100:00100000:3.0:1746142912.078206:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+28:2003:x1830962867405824:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.078213:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.078220:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9bb expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.078229:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.078230:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.078233:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 29 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.078242:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 29 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.078247:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a600, rc 0) 00000100:00100000:3.0:1746142912.078260:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867405824:12345-192.168.204.50@tcp:101:cat.0 Request processed in 54us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.078264:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14280 00000100:00100000:3.0:1746142912.078273:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14281 00000100:00100000:3.0:1746142912.078277:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+28:2003:x1830962867405952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.078282:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.078286:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067ccd290 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9c2 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.078315:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823488:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.078367:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.079563:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867406080 00000100:00100000:2.0:1746142912.079567:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867406080 00000100:00100000:2.0:1746142912.079585:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14282 00000100:00100000:2.0:1746142912.079589:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867406080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.079595:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.079602:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9c9 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.079611:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.079612:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.079616:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 20 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.079624:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 20 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.079630:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601200, rc 0) 00000100:00100000:2.0:1746142912.079645:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867406080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 56us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.079650:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14282 00000100:00100000:1.0:1746142912.080473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.080927:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.081004:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867406208 00000100:00100000:2.0:1746142912.081008:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867406208 00000100:00100000:2.0:1746142912.081022:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867406336 00000100:00100000:2.0:1746142912.081023:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867406336 00000100:00100000:2.0:1746142912.081034:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14283 00000100:00100000:2.0:1746142912.081039:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867406208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.081045:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.081053:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9d0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.081063:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.081065:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.081069:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 21 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.081078:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 21 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.081086:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601000, rc 0) 00000100:00100000:1.0:1746142912.081145:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14284 00000100:00100000:1.0:1746142912.081151:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867406336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142912.081157:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.081164:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9d7 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.081174:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.081176:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.081179:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 31 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.081188:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 31 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.081195:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fb600, rc 0) 00002000:00010000:3.0:1746142912.081251:0:9579:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142911 -> 1746142912 00000100:00100000:3.0:1746142912.081266:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823488:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.081283:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067ccd290 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c2 expref: 31 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.081296:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067ccd290 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c2 expref: 31 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.081307:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3b600, rc 0) 00000100:00100000:2.0:1746142912.081727:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867406208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 687us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.081733:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14283 00000100:00100000:1.0:1746142912.081784:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867406336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 633us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.081789:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14284 00000100:00100000:3.0:1746142912.081827:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867405952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3549us (3985us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.081832:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14281 00000100:00100000:3.0:1746142912.084630:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.084682:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.084712:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.084748:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867406720 00000100:00100000:0.0:1746142912.084755:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867406720 00000100:00100000:1.0:1746142912.084763:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867406848 00000100:00100000:1.0:1746142912.084767:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867406848 00002000:00100000:1.0:1746142912.084785:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009809fb80 x1830962867406848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142912.084785:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009809dc00 x1830962867406720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.084793:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809fb80 with x1830962867406848 ext(1048576->2097151) 00002000:00100000:0.0:1746142912.084793:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809dc00 with x1830962867406720 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.084797:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809fb80 00002000:00010000:0.0:1746142912.084797:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809dc00 00000100:00100000:1.0:1746142912.084807:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867406976 00000100:00100000:1.0:1746142912.084809:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867406976 00002000:00100000:1.0:1746142912.084818:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809c700 x1830962867406976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 504/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746142912.084823:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4409 00002000:00100000:1.0:1746142912.084824:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c700 with x1830962867406976 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.084827:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809c700 00000100:00100000:0.0:1746142912.084830:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867406848:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.084840:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4410 00000100:00100000:1.0:1746142912.084846:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867406720:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.085379:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4411 00000100:00100000:1.0:1746142912.085384:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867406976:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.091832:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867406720:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6976us (7199us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.091843:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4410 00002000:00100000:1.0:1746142912.091854:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009809dc00 x1830962867406720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.091863:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809dc00 with x1830962867406720 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.091867:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809dc00 00000100:00100000:0.0:1746142912.092979:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.093010:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.093686:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867407488 00000100:00100000:1.0:1746142912.093694:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867407488 00002000:00100000:1.0:1746142912.093722:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88011e13f800 x1830962867407488/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142912.093725:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867407616 00000100:00100000:2.0:1746142912.093729:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867407616 00002000:00100000:1.0:1746142912.093730:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f800 with x1830962867407488 ext(0->1048575) 00002000:00010000:1.0:1746142912.093733:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13f800 00002000:00100000:2.0:1746142912.093747:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88011e13d880 x1830962867407616/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.093755:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d880 with x1830962867407616 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.093758:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13d880 00000100:00100000:1.0:1746142912.093761:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4412 00000100:00100000:1.0:1746142912.093768:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867407488:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.094877:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4413 00000100:00100000:2.0:1746142912.094885:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867407616:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.096450:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867406848:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11614us (11760us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.096460:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4409 00002000:00100000:1.0:1746142912.096469:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009809fb80 x1830962867406848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.096484:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809fb80 with x1830962867406848 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.096490:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809fb80 00000100:00100000:1.0:1746142912.098542:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867406976:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13153us (13824us total) trans 0 rc 905216/905216 00000100:00100000:1.0:1746142912.098664:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4411 00002000:00100000:1.0:1746142912.098674:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009809c700 x1830962867406976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 504/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.098682:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c700 with x1830962867406976 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.098686:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809c700 00000100:00100000:1.0:1746142912.102742:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867407488:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8964us (9756us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.102753:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4412 00002000:00100000:1.0:1746142912.102762:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88011e13f800 x1830962867407488/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.102771:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f800 with x1830962867407488 ext(0->1048575) 00002000:00010000:1.0:1746142912.102777:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13f800 00000100:00100000:2.0:1746142912.105576:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867407616:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10686us (12559us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.105586:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4413 00002000:00100000:2.0:1746142912.105594:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88011e13d880 x1830962867407616/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.105602:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d880 with x1830962867407616 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.105607:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13d880 00000100:00100000:0.0:1746142912.111541:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.111614:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867407872 00000100:00100000:2.0:1746142912.111622:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867407872 00002000:00100000:2.0:1746142912.111663:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13d180 x1830962867407872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.111673:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d180 with x1830962867407872 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.111677:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13d180 00000100:00100000:2.0:1746142912.111710:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4414 00000100:00100000:2.0:1746142912.111718:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867407872:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.112223:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142912.112269:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746142912.112314:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867408128 00000100:00100000:1.0:1746142912.112321:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867408128 00002000:00100000:1.0:1746142912.112362:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088d61c00 x1830962867408128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.112370:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d61c00 with x1830962867408128 ext(2097152->4194303) 00002000:00010000:1.0:1746142912.112373:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d61c00 00000100:00100000:1.0:1746142912.112399:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4415 00000100:00100000:1.0:1746142912.112405:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867408128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142912.116759:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.116831:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867408256 00000100:00100000:3.0:1746142912.116838:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867408256 00000100:00100000:3.0:1746142912.116876:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14285 00000100:00100000:3.0:1746142912.116881:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+29:32458:x1830962867408256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.116894:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.117017:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9de expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.117044:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 43 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.117051:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.117052:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.117055:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 30 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.117085:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 43 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.117095:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 43 pid: 11943 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.117106:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823616:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.117187:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.119641:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867823616:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.119664:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 30 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.119679:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3de00, rc 0) 00000100:00100000:3.0:1746142912.119710:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+30:32458:x1830962867408256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2828us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.119717:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14285 00000100:00100000:2.0:1746142912.120310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.120923:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867408384 00000100:00100000:1.0:1746142912.120930:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867408384 00002000:00100000:1.0:1746142912.120959:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->1314815) req@ffff880099e8ad80 x1830962867408384/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.120967:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8ad80 with x1830962867408384 ext(1171456->1314815) 00010000:00010000:1.0:1746142912.120973:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 44 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.120983:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 44 pid: 11943 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.120989:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e8ad80 00000100:00100000:1.0:1746142912.121018:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1377 00000100:00100000:1.0:1746142912.121024:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867408384:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142912.125925:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867407872:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14179us (14362us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142912.125935:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4414 00002000:00100000:2.0:1746142912.125946:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13d180 x1830962867407872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.125954:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d180 with x1830962867407872 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.125961:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13d180 00000100:00100000:2.0:1746142912.127197:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867408384:12345-192.168.204.50@tcp:4:cat.0 Request processed in 6168us (6884us total) trans 17179873933 rc 0/0 00000100:00100000:2.0:1746142912.127204:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1377 00002000:00100000:2.0:1746142912.127211:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1171456->1314815) req@ffff880099e8ad80 x1830962867408384/t17179873933(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.127218:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8ad80 with x1830962867408384 ext(1171456->1314815) 00010000:00010000:2.0:1746142912.127226:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 46 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.127239:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 46 pid: 11943 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.127245:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e8ad80 00000100:00100000:1.0:1746142912.131929:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867408128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19515us (19697us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142912.131938:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4415 00002000:00100000:1.0:1746142912.131948:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088d61c00 x1830962867408128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.131956:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d61c00 with x1830962867408128 ext(2097152->4194303) 00002000:00010000:1.0:1746142912.131961:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d61c00 00000100:00100000:0.0:1746142912.135013:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.135127:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867408512 00000100:00100000:1.0:1746142912.135135:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867408512 00010000:00010000:1.0:1746142912.135165:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 44 pid: 11943 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.135313:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6456 00000100:00100000:1.0:1746142912.135322:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867408512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.135333:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.135361:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 44 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.135372:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 44 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.135391:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9a0a00/0x2fa243e067ccd235 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1171456->1314815) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a975 expref: 44 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.136969:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.136972:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.136981:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 29 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.136989:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 29 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.137021:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 29 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.137032:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867823744:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142912.137092:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.137726:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.138423:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867408640 00000100:00100000:3.0:1746142912.138430:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867408640 00000100:00100000:3.0:1746142912.138503:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14286 00000100:00100000:3.0:1746142912.138510:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867408640:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.138521:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.138531:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9e5 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.138549:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.138550:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.138555:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 45 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.138565:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 45 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.138571:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d000, rc 0) 00000100:00100000:3.0:1746142912.138603:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2004:x1830962867408640:12345-192.168.204.50@tcp:101:cat.0 Request processed in 94us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.138609:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14286 00000100:00100000:1.0:1746142912.142443:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867823744:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.142460:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.143193:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867408512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7870us (8186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.143202:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6456 00000100:00100000:2.0:1746142912.143407:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.143436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.143471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.143486:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867409280 00000100:00100000:3.0:1746142912.143487:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867409408 00000100:00100000:3.0:1746142912.143491:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867409408 00000100:00100000:2.0:1746142912.143491:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867409280 00002000:00100000:3.0:1746142912.143522:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880099e89880 x1830962867409408/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.143531:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89880 with x1830962867409408 ext(1048576->2097151) 00002000:00010000:3.0:1746142912.143535:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89880 00000100:00100000:3.0:1746142912.143552:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867409152 00000100:00100000:3.0:1746142912.143554:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867409152 00000100:00100000:1.0:1746142912.143597:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4416 00000100:00100000:1.0:1746142912.143604:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867409408:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:3.0:1746142912.143773:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880099e8b100 x1830962867409152/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.143773:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880099e89c00 x1830962867409280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.143780:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8b100 with x1830962867409152 ext(4194304->5066751) 00002000:00100000:2.0:1746142912.143780:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89c00 with x1830962867409280 ext(1048576->2097151) 00002000:00010000:3.0:1746142912.143783:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e8b100 00002000:00010000:2.0:1746142912.143783:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e89c00 00000100:00100000:2.0:1746142912.143864:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4417 00000100:00100000:2.0:1746142912.143870:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867409152:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142912.143952:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4418 00000100:00100000:0.0:1746142912.143959:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867409280:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.151856:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867409280:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7890us (8442us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.151866:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4418 00002000:00100000:2.0:1746142912.151876:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880099e89c00 x1830962867409280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.151884:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89c00 with x1830962867409280 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.151890:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e89c00 00000100:00100000:1.0:1746142912.154546:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867409408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10936us (11103us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.154555:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4416 00002000:00100000:1.0:1746142912.154563:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880099e89880 x1830962867409408/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.154572:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89880 with x1830962867409408 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.154577:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89880 00000100:00100000:2.0:1746142912.157002:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867409152:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13126us (13524us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142912.157011:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4417 00002000:00100000:2.0:1746142912.157018:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880099e8b100 x1830962867409152/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.157026:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8b100 with x1830962867409152 ext(4194304->5066751) 00002000:00010000:2.0:1746142912.157030:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e8b100 00000100:00100000:0.0:1746142912.166519:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.166612:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867409792 00000100:00100000:2.0:1746142912.166620:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867409792 00002000:00100000:2.0:1746142912.166658:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880092135880 x1830962867409792/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.166671:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135880 with x1830962867409792 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.166675:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092135880 00000100:00100000:3.0:1746142912.167164:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.167187:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867409920 00000100:00100000:3.0:1746142912.167190:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867409920 00002000:00100000:3.0:1746142912.167207:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096af0000 x1830962867409920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.167214:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0000 with x1830962867409920 ext(2097152->4194303) 00002000:00010000:3.0:1746142912.167217:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af0000 00000100:00100000:2.0:1746142912.167225:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4419 00000100:00100000:3.0:1746142912.167228:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4420 00000100:00100000:3.0:1746142912.167232:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867409920:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.167232:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867409792:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.189482:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867409792:12345-192.168.204.50@tcp:3:cat.0 Request processed in 22242us (22962us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142912.189493:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4419 00002000:00100000:2.0:1746142912.189504:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880092135880 x1830962867409792/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.189512:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135880 with x1830962867409792 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.189517:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092135880 00000100:00100000:3.0:1746142912.194985:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867409920:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27743us (27813us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142912.194996:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4420 00002000:00100000:3.0:1746142912.195006:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096af0000 x1830962867409920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.195014:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0000 with x1830962867409920 ext(2097152->4194303) 00002000:00010000:3.0:1746142912.195020:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af0000 00000100:00100000:0.0:1746142912.204468:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.204535:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867410176 00000100:00100000:3.0:1746142912.204544:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867410176 00002000:00100000:3.0:1746142912.204586:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092136d80 x1830962867410176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.204596:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136d80 with x1830962867410176 ext(4194304->5066751) 00002000:00010000:3.0:1746142912.204602:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092136d80 00000100:00100000:3.0:1746142912.204634:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4421 00000100:00100000:3.0:1746142912.204642:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867410176:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.211777:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867410176:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7128us (7311us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142912.211786:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4421 00002000:00100000:2.0:1746142912.211796:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092136d80 x1830962867410176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.211805:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092136d80 with x1830962867410176 ext(4194304->5066751) 00002000:00010000:2.0:1746142912.211809:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092136d80 00000100:00100000:0.0:1746142912.241893:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.242076:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867410304 00000100:00100000:1.0:1746142912.242084:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867410304 00000100:00100000:1.0:1746142912.242133:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14287 00000100:00100000:1.0:1746142912.242140:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32461:x1830962867410304:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142912.242155:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.242168:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9ec expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.242191:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.242203:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 20 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.242210:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.242211:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.242215:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2752512->3145727] (req 2752512->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 50 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.242240:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 20 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.242251:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 20 pid: 11421 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.242261:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867823872:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.242361:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.242369:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.242376:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867824000:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.242395:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.245430:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867823872:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.245443:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867824000:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.245465:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2752512->3145727] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 50 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.245476:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495da00, rc 0) 00000100:00100000:1.0:1746142912.245515:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32461:x1830962867410304:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3375us (3627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.245522:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14287 00000100:00100000:0.0:1746142912.247957:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.248139:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.248323:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867410432 00000100:00100000:1.0:1746142912.248330:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867410432 00010000:00010000:1.0:1746142912.248369:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.248404:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867410560 00000100:00100000:1.0:1746142912.248407:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867410560 00010000:00010000:1.0:1746142912.248417:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.248434:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6457 00000100:00100000:1.0:1746142912.248440:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867410432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142912.248441:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6458 00000100:00100000:3.0:1746142912.248449:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867410560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.248452:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.248456:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.248468:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.248468:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.248478:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.248492:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.248509:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130601000/0x2fa243e067ccd29e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d0 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.248518:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a0e00/0x2fa243e067ccd266 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a99f expref: 50 pid: 9580 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.248531:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.248533:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.248539:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.248546:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.248554:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142912.248571:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.248581:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867824128:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.248584:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867410560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 137us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.248590:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6458 00000100:00100000:1.0:1746142912.248619:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.250866:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.250896:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867824128:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.250930:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.250933:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867410816 00000100:00100000:0.0:1746142912.250934:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.250937:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867410816 00000100:00100000:1.0:1746142912.250955:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867410432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2515us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.250961:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867410944 00000100:00100000:1.0:1746142912.250962:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6457 00002000:00100000:2.0:1746142912.250963:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2752512->2756607) req@ffff880092137b80 x1830962867410816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746142912.250963:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867410944 00002000:00100000:2.0:1746142912.250969:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137b80 with x1830962867410816 ext(2752512->2756607) 00002000:00010000:2.0:1746142912.250972:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137b80 00000100:00100000:2.0:1746142912.250982:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4422 00000100:00100000:0.0:1746142912.250983:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14288 00000100:00100000:2.0:1746142912.250985:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867410816:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142912.250987:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:32464:x1830962867410944:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142912.250995:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142912.251005:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9f3 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.251024:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 49 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142912.251030:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142912.251037:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.251038:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.251041:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1888256->2002943] (req 1888256->2002943) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.251056:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867410816:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 70us (195us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.251060:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4422 00002000:00100000:2.0:1746142912.251063:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2752512->2756607) req@ffff880092137b80 x1830962867410816/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746142912.251064:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746142912.251067:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092137b80 with x1830962867410816 ext(2752512->2756607) 00002000:00010000:2.0:1746142912.251069:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092137b80 00010000:00010000:1.0:1746142912.251074:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.251083:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867824256:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.251120:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 48 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.251128:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 48 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.251135:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867824384:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.251154:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.252190:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867824256:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.252198:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867824384:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.252211:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1888256->2002943] (req 1888256->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.252220:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1e00, rc 0) 00000100:00100000:1.0:1746142912.252239:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:32464:x1830962867410944:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1251us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.252244:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14288 00000100:00100000:0.0:1746142912.253542:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.253608:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867411072 00000100:00100000:1.0:1746142912.253613:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867411072 00010000:00010000:1.0:1746142912.253630:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 49 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.253769:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6459 00000100:00100000:1.0:1746142912.253776:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867411072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.253786:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.253799:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 49 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.253808:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 49 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.253824:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c3a800/0x2fa243e067ccd274 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a998 expref: 49 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.253836:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.254052:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867411072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 276us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.254058:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6459 00000100:00100000:0.0:1746142912.254594:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.254645:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.254675:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867411328 00000100:00100000:2.0:1746142912.254679:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867411328 00000100:00100000:2.0:1746142912.254696:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14289 00000100:00100000:2.0:1746142912.254699:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32461:x1830962867411328:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142912.254707:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.254715:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8a9fa expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.254727:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.254732:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 29 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.254735:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.254736:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.254738:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2379775] (req 2097152->2379775) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.254753:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 29 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.254760:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 29 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.254774:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867824512:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.254835:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.254843:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.254850:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867824640:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.254867:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.255015:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867411200 00000100:00100000:1.0:1746142912.255019:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867411200 00010000:00010000:1.0:1746142912.255031:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.255052:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6460 00000100:00100000:1.0:1746142912.255056:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867411200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.255063:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.255070:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.255167:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.255179:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130601200/0x2fa243e067ccd297 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9c9 expref: 21 pid: 11421 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.255188:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.255189:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.255194:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.255201:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.255218:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.255226:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867824768:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142912.255410:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.256003:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867824512:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.256011:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867824640:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.256025:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2379775] (req 2097152->2379775) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.256034:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0c00, rc 0) 00000100:00100000:2.0:1746142912.256062:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32461:x1830962867411328:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1362us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.256067:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14289 00000100:00100000:1.0:1746142912.257039:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867824768:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.257049:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.257074:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867411200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2017us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.257150:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6460 00000100:00100000:0.0:1746142912.257762:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.257793:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867411456 00000100:00100000:1.0:1746142912.257799:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867411456 00010000:00010000:1.0:1746142912.257814:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 30 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.257837:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6461 00000100:00100000:1.0:1746142912.257843:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867411456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.257851:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.257867:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 30 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.257876:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 30 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.257891:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4fb600/0x2fa243e067ccd2a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9d7 expref: 30 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.257929:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.257952:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867411456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.257958:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6461 00000100:00100000:0.0:1746142912.258426:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.258483:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.258486:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867411584 00000100:00100000:1.0:1746142912.258489:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867411584 00010000:00010000:1.0:1746142912.258500:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.258540:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867411840 00000100:00100000:2.0:1746142912.258543:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867411840 00002000:00100000:2.0:1746142912.258584:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1888256->1892351) req@ffff88009a359180 x1830962867411840/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.258591:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a359180 with x1830962867411840 ext(1888256->1892351) 00002000:00010000:2.0:1746142912.258595:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a359180 00000100:00100000:1.0:1746142912.258636:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6462 00000100:00100000:2.0:1746142912.258642:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4423 00000100:00100000:1.0:1746142912.258642:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867411584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142912.258646:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867411840:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:1.0:1746142912.258651:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.258658:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.258665:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.258675:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a400/0x2fa243e067ccd26d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9a6 expref: 45 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.258684:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.258685:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.258689:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.258696:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.258714:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.258722:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867824896:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142912.258841:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867411840:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 193us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.258846:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4423 00002000:00100000:2.0:1746142912.258851:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1888256->1892351) req@ffff88009a359180 x1830962867411840/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.258857:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a359180 with x1830962867411840 ext(1888256->1892351) 00002000:00010000:2.0:1746142912.258859:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a359180 00000100:00100000:1.0:1746142912.258967:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.260117:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867824896:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.260130:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.260148:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867411584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1506us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.260154:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6462 00000100:00100000:0.0:1746142912.261210:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.261315:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867412096 00000100:00100000:2.0:1746142912.261320:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867412096 00002000:00100000:2.0:1746142912.261354:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1998848->2002943) req@ffff88009a35aa00 x1830962867412096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.261362:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35aa00 with x1830962867412096 ext(1998848->2002943) 00002000:00010000:2.0:1746142912.261366:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35aa00 00000100:00100000:2.0:1746142912.261387:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4424 00000100:00100000:2.0:1746142912.261393:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867412096:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.261479:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867412096:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 85us (269us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.261484:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4424 00002000:00100000:2.0:1746142912.261489:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1998848->2002943) req@ffff88009a35aa00 x1830962867412096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.261501:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35aa00 with x1830962867412096 ext(1998848->2002943) 00002000:00010000:2.0:1746142912.261504:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a35aa00 00000100:00100000:0.0:1746142912.262129:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.262217:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867412352 00000100:00100000:2.0:1746142912.262221:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867412352 00002000:00100000:2.0:1746142912.262236:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2375680->2379775) req@ffff88009a35a680 x1830962867412352/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.262243:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35a680 with x1830962867412352 ext(2375680->2379775) 00002000:00010000:2.0:1746142912.262246:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a35a680 00000100:00100000:2.0:1746142912.262267:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4425 00000100:00100000:2.0:1746142912.262271:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867412352:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.262324:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867412352:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 53us (197us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.262328:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4425 00002000:00100000:2.0:1746142912.262331:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2375680->2379775) req@ffff88009a35a680 x1830962867412352/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.262347:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a35a680 with x1830962867412352 ext(2375680->2379775) 00002000:00010000:2.0:1746142912.262350:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a35a680 00000100:00100000:0.0:1746142912.272954:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.273020:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867412480 00000100:00100000:2.0:1746142912.273028:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867412480 00000100:00100000:2.0:1746142912.273064:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14290 00000100:00100000:2.0:1746142912.273069:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867412480:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.273084:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.273097:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984b0600/0x2fa243e067ccd2cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa01 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.273140:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867825024:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142912.273224:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00002000:00010000:2.0:1746142912.274941:0:1852:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746142911 -> 1746142912 00002000:00010000:2.0:1746142912.274946:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142911 -> 1746142912 00002000:00010000:2.0:1746142912.274948:0:1852:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746142911 -> 1746142912 00000100:00100000:2.0:1746142912.274964:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867825024:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.274986:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984b0600/0x2fa243e067ccd2cf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa01 expref: 49 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.274997:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984b0600/0x2fa243e067ccd2cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa01 expref: 49 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.275021:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0600, rc 0) 00000100:00100000:2.0:1746142912.275065:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867412480:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1995us (2119us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.275071:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14290 00000100:00100000:0.0:1746142912.281740:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.281884:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867412736 00000100:00100000:2.0:1746142912.281891:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867412736 00002000:00100000:2.0:1746142912.281948:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096070380 x1830962867412736/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.281955:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070380 with x1830962867412736 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.281958:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096070380 00000100:00100000:2.0:1746142912.281977:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4426 00000100:00100000:2.0:1746142912.281983:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2003:x1830962867412736:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.286957:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2003:x1830962867412736:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4966us (5217us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.286968:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4426 00002000:00100000:2.0:1746142912.286978:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880096070380 x1830962867412736/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.286989:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096070380 with x1830962867412736 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.286994:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096070380 00000100:00100000:0.0:1746142912.291864:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.292927:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867412864 00000100:00100000:3.0:1746142912.292936:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867412864 00000100:00100000:3.0:1746142912.292980:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14291 00000100:00100000:3.0:1746142912.292988:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32469:x1830962867412864:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.293002:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.293016:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa08 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.293039:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.293046:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.293049:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.293052:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.293186:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.293197:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 19 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.293208:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867825152:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.293287:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.294223:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867825152:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.294239:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 49 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.294247:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3ca00, rc 0) 00000100:00100000:3.0:1746142912.294278:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096072680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32469:x1830962867412864:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1290us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.294284:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14291 00000100:00100000:0.0:1746142912.294548:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.294625:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867412992 00000100:00100000:2.0:1746142912.294629:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867412992 00002000:00100000:2.0:1746142912.294660:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1888256->2002943) req@ffff880096073800 x1830962867412992/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.294668:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073800 with x1830962867412992 ext(1888256->2002943) 00010000:00010000:2.0:1746142912.294673:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 20 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.294683:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 20 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.294689:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096073800 00000100:00100000:2.0:1746142912.294701:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1378 00000100:00100000:2.0:1746142912.294706:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867412992:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142912.296519:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867412992:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 1807us (1965us total) trans 21474841194 rc 0/0 00000100:00100000:2.0:1746142912.296526:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1378 00002000:00100000:2.0:1746142912.296533:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1888256->2002943) req@ffff880096073800 x1830962867412992/t21474841194(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.296541:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096073800 with x1830962867412992 ext(1888256->2002943) 00010000:00010000:2.0:1746142912.296546:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 22 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.296557:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 22 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.296563:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096073800 00000100:00100000:0.0:1746142912.298318:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.298497:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867413120 00000100:00100000:1.0:1746142912.298504:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867413120 00010000:00010000:1.0:1746142912.298534:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 22 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.298566:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6463 00000100:00100000:1.0:1746142912.298573:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867413120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.298583:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.298597:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 22 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.298606:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 22 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.298621:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0a1e00/0x2fa243e067ccd2c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2002943) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9f3 expref: 22 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.298644:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.298646:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.298650:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.298655:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.298675:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.298682:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867825280:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142912.298799:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.300971:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867825280:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.300987:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.301083:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096070000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867413120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2509us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.301091:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6463 00000100:00100000:0.0:1746142912.301694:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.301765:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867413376 00000100:00100000:2.0:1746142912.301770:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867413376 00002000:00100000:2.0:1746142912.301797:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dbf4a80 x1830962867413376/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.301804:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4a80 with x1830962867413376 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.301807:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4a80 00000100:00100000:2.0:1746142912.301824:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4427 00000100:00100000:2.0:1746142912.301829:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867413376:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.307689:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867413376:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5850us (5987us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.307700:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4427 00002000:00100000:2.0:1746142912.307710:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dbf4a80 x1830962867413376/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.307719:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4a80 with x1830962867413376 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.307724:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf4a80 00000100:00100000:3.0:1746142912.318103:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.318142:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.318154:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867413632 00000100:00100000:2.0:1746142912.318162:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867413632 00000100:00100000:0.0:1746142912.318171:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867413888 00000100:00100000:0.0:1746142912.318175:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867413888 00002000:00100000:0.0:1746142912.318194:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2379776->4194303) req@ffff880096af2a00 x1830962867413888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.318195:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880096af0e00 x1830962867413632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 504/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142912.318201:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2a00 with x1830962867413888 ext(2379776->4194303) 00002000:00100000:2.0:1746142912.318202:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0e00 with x1830962867413632 ext(2097152->4194303) 00002000:00010000:0.0:1746142912.318205:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af2a00 00002000:00010000:2.0:1746142912.318206:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af0e00 00000100:00100000:2.0:1746142912.318233:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4428 00000100:00100000:2.0:1746142912.318239:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867413632:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142912.318323:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4429 00000100:00100000:0.0:1746142912.318330:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867413888:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.328027:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867413888:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9690us (9877us total) trans 0 rc 1814528/1814528 00000100:00100000:2.0:1746142912.328035:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4429 00002000:00100000:2.0:1746142912.328044:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2379776->4194303) req@ffff880096af2a00 x1830962867413888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1814528/1814528 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.328050:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2a00 with x1830962867413888 ext(2379776->4194303) 00002000:00010000:2.0:1746142912.328054:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af2a00 00000100:00100000:2.0:1746142912.331399:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867413632:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13153us (13295us total) trans 0 rc 1703936/1703936 00000100:00100000:2.0:1746142912.331409:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4428 00002000:00100000:2.0:1746142912.331418:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880096af0e00 x1830962867413632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 504/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1703936/1703936 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.331426:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0e00 with x1830962867413632 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.331431:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af0e00 00000100:00100000:0.0:1746142912.339129:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.339222:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867414144 00000100:00100000:2.0:1746142912.339229:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867414144 00002000:00100000:2.0:1746142912.339262:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012dbf5c00 x1830962867414144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.339269:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5c00 with x1830962867414144 ext(4194304->5066751) 00002000:00010000:2.0:1746142912.339273:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf5c00 00000100:00100000:2.0:1746142912.339286:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4430 00000100:00100000:2.0:1746142912.339291:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867414144:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.344763:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2003:x1830962867414144:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5463us (5631us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142912.344774:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4430 00002000:00100000:2.0:1746142912.344784:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012dbf5c00 x1830962867414144/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.344793:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5c00 with x1830962867414144 ext(4194304->5066751) 00002000:00010000:2.0:1746142912.344798:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf5c00 00000100:00100000:0.0:1746142912.385657:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.385755:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867414272 00000100:00100000:3.0:1746142912.385763:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867414272 00000100:00100000:3.0:1746142912.386435:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14292 00000100:00100000:3.0:1746142912.386443:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32474:x1830962867414272:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142912.386461:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.386476:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa0f expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.386500:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.386508:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 28 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.386514:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.386515:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.386518:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1576960->1622015] (req 1576960->1622015) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.386543:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 28 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.386554:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 28 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746142912.386564:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867825408:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.388794:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.388808:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.388819:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867825536:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.389977:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.390106:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867825408:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142912.391317:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.391418:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867825536:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.391448:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1576960->1622015] (req 1576960->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 45 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.391462:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d800, rc 0) 00000100:00100000:3.0:1746142912.391497:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32474:x1830962867414272:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5054us (5846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.391504:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14292 00000100:00100000:1.0:1746142912.391868:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867414400 00000100:00100000:1.0:1746142912.391875:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867414400 00010000:00010000:1.0:1746142912.391920:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 29 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.391952:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6464 00000100:00100000:1.0:1746142912.391959:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867414400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.391969:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.391985:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 29 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.391994:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 29 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.392011:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067ccd289 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9bb expref: 29 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.392039:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.392058:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867414400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.392063:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6464 00000100:00100000:0.0:1746142912.392472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.392494:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867414528 00000100:00100000:3.0:1746142912.392497:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867414528 00010000:00010000:3.0:1746142912.392509:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.392525:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6465 00000100:00100000:3.0:1746142912.392530:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867414528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.392536:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.392544:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.392557:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.392569:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3b400/0x2fa243e067ccd27b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ad expref: 45 pid: 9579 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.392581:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.392582:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.392588:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.392595:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.392620:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.392629:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867825664:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.392690:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.396792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.396842:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867825664:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142912.396859:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142912.396896:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867414528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4361us (4420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.396922:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6465 00000100:00100000:2.0:1746142912.396926:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867414784 00000100:00100000:2.0:1746142912.396932:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867414784 00002000:00100000:2.0:1746142912.396960:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1617920->1622015) req@ffff88012dbf7480 x1830962867414784/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.396969:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7480 with x1830962867414784 ext(1617920->1622015) 00002000:00010000:2.0:1746142912.396973:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7480 00000100:00100000:2.0:1746142912.397275:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4431 00000100:00100000:2.0:1746142912.397283:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867414784:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.397731:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867414784:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 448us (944us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.397737:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4431 00002000:00100000:2.0:1746142912.397743:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1617920->1622015) req@ffff88012dbf7480 x1830962867414784/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.397751:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7480 with x1830962867414784 ext(1617920->1622015) 00002000:00010000:2.0:1746142912.397753:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7480 00000100:00100000:0.0:1746142912.425285:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.425463:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867414912 00000100:00100000:3.0:1746142912.425471:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867414912 00000100:00100000:3.0:1746142912.425508:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14293 00000100:00100000:3.0:1746142912.425515:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+28:32473:x1830962867414912:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142912.425529:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.425544:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa16 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.425571:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 43 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.425577:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.425578:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.425581:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1499136->2084863] (req 1499136->2084863) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.425602:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 43 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.425611:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 43 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.425620:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867825792:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.426440:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.427960:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867825792:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.427980:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1499136->2084863] (req 1499136->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.427993:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c600, rc 0) 00000100:00100000:3.0:1746142912.428023:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+29:32473:x1830962867414912:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2509us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.428030:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14293 00000100:00100000:0.0:1746142912.428378:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.428627:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867415040 00000100:00100000:2.0:1746142912.428633:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867415040 00002000:00100000:2.0:1746142912.428660:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1576960->1622015) req@ffff880088d7fb80 x1830962867415040/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.428668:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7fb80 with x1830962867415040 ext(1576960->1622015) 00010000:00010000:2.0:1746142912.428673:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 44 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.428683:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 44 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.428688:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088d7fb80 00000100:00100000:1.0:1746142912.428919:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1379 00000100:00100000:1.0:1746142912.428927:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867415040:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142912.433683:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867415040:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4749us (5297us total) trans 17179873934 rc 0/0 00000100:00100000:1.0:1746142912.433697:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1379 00002000:00100000:1.0:1746142912.433709:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1576960->1622015) req@ffff880088d7fb80 x1830962867415040/t17179873934(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.433717:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7fb80 with x1830962867415040 ext(1576960->1622015) 00010000:00010000:1.0:1746142912.433732:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 46 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.433749:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 46 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.433755:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088d7fb80 00000100:00100000:0.0:1746142912.435981:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.436134:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867415168 00000100:00100000:3.0:1746142912.436143:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867415168 00010000:00010000:3.0:1746142912.436168:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 46 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.436189:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6466 00000100:00100000:3.0:1746142912.436201:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867415168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.436215:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142912.436228:0:7217:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142912 -> 1746142913 00002000:00010000:3.0:1746142912.436230:0:7217:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142912 -> 1746142913 00010000:00010000:3.0:1746142912.436235:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 46 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.436245:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 46 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.436262:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d800/0x2fa243e067ccd2dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1576960->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa0f expref: 46 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.436290:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.436298:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.436304:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.436311:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.436353:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.436373:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867825920:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.436451:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.438276:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.438295:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.438313:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.438340:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867415552 00000100:00100000:0.0:1746142912.438344:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867415552 00000100:00100000:0.0:1746142912.438373:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867415680 00000100:00100000:0.0:1746142912.438375:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867415680 00000100:00100000:0.0:1746142912.438389:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14294 00000100:00100000:0.0:1746142912.438401:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867415552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142912.438414:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142912.438432:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa1d expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.438445:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.438447:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.438458:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142912.438470:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142912.438483:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495de00, rc 0) 00000100:00100000:0.0:1746142912.438520:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867415552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 119us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.438526:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14294 00000100:00100000:0.0:1746142912.438544:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14295 00000100:00100000:0.0:1746142912.438549:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867415680:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142912.438560:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142912.438567:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067ccd2f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa24 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142912.438599:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867826048:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142912.438647:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.438658:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867825920:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142912.438672:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142912.438686:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867415168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2486us (2717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.438692:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6466 00000100:00100000:0.0:1746142912.438695:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.438707:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867415808 00000100:00100000:0.0:1746142912.438710:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867415808 00000100:00100000:1.0:1746142912.438760:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867415424 00000100:00100000:1.0:1746142912.438763:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867415424 00002000:00100000:1.0:1746142912.438791:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1499136->1503231) req@ffff880088d7ed80 x1830962867415424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.438812:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ed80 with x1830962867415424 ext(1499136->1503231) 00002000:00010000:1.0:1746142912.438816:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7ed80 00000100:00100000:1.0:1746142912.438836:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4432 00000100:00100000:0.0:1746142912.438836:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14296 00000100:00100000:1.0:1746142912.438841:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867415424:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142912.438841:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867415808:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142912.438960:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.438979:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed4600/0x2fa243e067ccd2f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa2b expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.439001:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867826176:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142912.439044:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.439105:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867415424:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 263us (833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.439112:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4432 00002000:00100000:2.0:1746142912.439117:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1499136->1503231) req@ffff880088d7ed80 x1830962867415424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.439123:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ed80 with x1830962867415424 ext(1499136->1503231) 00002000:00010000:2.0:1746142912.439126:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7ed80 00002000:00010000:2.0:1746142912.440176:0:9579:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142912 -> 1746142913 00002000:00010000:2.0:1746142912.440181:0:9579:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142912 -> 1746142913 00000100:00100000:2.0:1746142912.440193:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867826048:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.440210:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067ccd2f2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa24 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.440219:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067ccd2f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa24 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.440231:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495c000, rc 0) 00000100:00100000:2.0:1746142912.440263:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867415680:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1714us (1948us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.440269:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14295 00002000:00010000:1.0:1746142912.440571:0:9578:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142912 -> 1746142913 00002000:00010000:1.0:1746142912.440574:0:9578:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142912 -> 1746142913 00000100:00100000:1.0:1746142912.440583:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867826176:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142912.440596:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed4600/0x2fa243e067ccd2f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa2b expref: 30 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.440604:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed4600/0x2fa243e067ccd2f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa2b expref: 30 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.440716:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed4600, rc 0) 00000100:00100000:1.0:1746142912.440792:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867415808:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1950us (2100us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142912.440797:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14296 00000100:00100000:0.0:1746142912.444357:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.444445:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867416064 00000100:00100000:2.0:1746142912.444454:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867416064 00002000:00100000:2.0:1746142912.444491:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2080768->2084863) req@ffff880088d7c700 x1830962867416064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.444500:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c700 with x1830962867416064 ext(2080768->2084863) 00002000:00010000:2.0:1746142912.444504:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7c700 00000100:00100000:2.0:1746142912.444523:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4433 00000100:00100000:2.0:1746142912.444530:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867416064:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.444654:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867416064:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 124us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.444660:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4433 00002000:00100000:2.0:1746142912.444665:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2080768->2084863) req@ffff880088d7c700 x1830962867416064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.444671:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c700 with x1830962867416064 ext(2080768->2084863) 00002000:00010000:2.0:1746142912.444674:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7c700 00000100:00100000:0.0:1746142912.446471:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.446966:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867416320 00000100:00100000:2.0:1746142912.446974:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867416320 00002000:00100000:2.0:1746142912.447003:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1499135) req@ffff88012b1a0380 x1830962867416320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.447011:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0380 with x1830962867416320 ext(1048576->1499135) 00002000:00010000:2.0:1746142912.447015:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1a0380 00000100:00100000:2.0:1746142912.447036:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4434 00000100:00100000:2.0:1746142912.447043:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867416320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.450809:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867416320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 3759us (4335us total) trans 0 rc 450560/450560 00000100:00100000:2.0:1746142912.450820:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4434 00002000:00100000:2.0:1746142912.450829:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1499135) req@ffff88012b1a0380 x1830962867416320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 450560/450560 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.450838:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0380 with x1830962867416320 ext(1048576->1499135) 00002000:00010000:2.0:1746142912.450844:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1a0380 00000100:00100000:0.0:1746142912.453737:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.453826:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867416576 00000100:00100000:2.0:1746142912.453834:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867416576 00002000:00100000:2.0:1746142912.453870:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2084864->2097151) req@ffff88012b1a2300 x1830962867416576/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.453878:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a2300 with x1830962867416576 ext(2084864->2097151) 00002000:00010000:2.0:1746142912.453883:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1a2300 00000100:00100000:2.0:1746142912.454064:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4435 00000100:00100000:2.0:1746142912.454072:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867416576:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.454215:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867416576:12345-192.168.204.50@tcp:3:cat.0 Request processed in 143us (485us total) trans 0 rc 12288/12288 00000100:00100000:2.0:1746142912.454222:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4435 00002000:00100000:2.0:1746142912.454227:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2084864->2097151) req@ffff88012b1a2300 x1830962867416576/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/12728 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 12288/12288 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.454234:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a2300 with x1830962867416576 ext(2084864->2097151) 00002000:00010000:2.0:1746142912.454237:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b1a2300 00000100:00100000:0.0:1746142912.454674:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.454846:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867416832 00000100:00100000:2.0:1746142912.454850:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867416832 00002000:00100000:2.0:1746142912.454868:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012b1a1500 x1830962867416832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.454875:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1500 with x1830962867416832 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.454877:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a1500 00000100:00100000:2.0:1746142912.454889:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4436 00000100:00100000:2.0:1746142912.454895:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867416832:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.460933:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867416832:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6029us (6251us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.460942:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4436 00002000:00100000:2.0:1746142912.460952:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012b1a1500 x1830962867416832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.460960:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1500 with x1830962867416832 ext(1048576->2097151) 00002000:00010000:2.0:1746142912.460964:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a1500 00000100:00100000:0.0:1746142912.465932:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.465968:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.466105:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867416960 00000100:00100000:2.0:1746142912.466113:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867416960 00000100:00100000:2.0:1746142912.466160:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417088 00000100:00100000:2.0:1746142912.466162:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417088 00000100:00100000:2.0:1746142912.466178:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14297 00000100:00100000:2.0:1746142912.466185:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867416960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.466199:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.466212:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccd300 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa32 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.466251:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867826304:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.466583:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14298 00000100:00100000:3.0:1746142912.466591:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867417088:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.466598:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.466607:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccd307 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa39 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.466628:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867826432:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142912.466991:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.466996:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.468480:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867826304:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.468502:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccd300 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa32 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.468514:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccd300 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa32 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.468534:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1e00, rc 0) 00000100:00100000:2.0:1746142912.468563:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867416960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2378us (2670us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.468569:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14297 00000100:00100000:3.0:1746142912.468647:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867826432:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.468662:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccd307 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa39 expref: 30 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.468670:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3dc00/0x2fa243e067ccd307 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa39 expref: 30 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.468689:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3dc00, rc 0) 00000100:00100000:3.0:1746142912.468706:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867417088:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2116us (2737us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.468711:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14298 00000100:00100000:0.0:1746142912.470561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.470621:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417216 00000100:00100000:3.0:1746142912.470627:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417216 00000100:00100000:3.0:1746142912.470664:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14299 00000100:00100000:3.0:1746142912.470669:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:32478:x1830962867417216:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.470680:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.470690:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa40 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.470737:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.470744:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.470745:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.470748:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.470770:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 48 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.470779:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 48 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.470790:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867826560:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.470863:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.471937:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867826560:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.471958:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.471968:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d800, rc 0) 00000100:00100000:3.0:1746142912.472002:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:32478:x1830962867417216:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1332us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.472009:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14299 00000100:00100000:0.0:1746142912.473610:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.473709:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417344 00000100:00100000:2.0:1746142912.473716:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417344 00002000:00100000:2.0:1746142912.473750:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2752512->3145727) req@ffff88012b1a1f80 x1830962867417344/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.473759:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1f80 with x1830962867417344 ext(2752512->3145727) 00010000:00010000:2.0:1746142912.473767:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 49 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.473782:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 49 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.473789:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1a1f80 00000100:00100000:2.0:1746142912.473816:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1380 00000100:00100000:2.0:1746142912.473823:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867417344:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142912.478278:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2005:x1830962867417344:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4448us (4665us total) trans 21474841195 rc 0/0 00000100:00100000:2.0:1746142912.478289:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1380 00002000:00100000:2.0:1746142912.478299:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2752512->3145727) req@ffff88012b1a1f80 x1830962867417344/t21474841195(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.478308:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1f80 with x1830962867417344 ext(2752512->3145727) 00010000:00010000:2.0:1746142912.478316:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.478340:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.478347:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1a1f80 00000100:00100000:0.0:1746142912.482583:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.482691:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417472 00000100:00100000:3.0:1746142912.482699:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417472 00010000:00010000:3.0:1746142912.482729:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.482970:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6467 00000100:00100000:3.0:1746142912.482978:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2003:x1830962867417472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.482990:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.483007:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.483018:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.483036:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495da00/0x2fa243e067ccd2ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2752512->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9ec expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.483298:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.483301:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.483308:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.483314:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.483352:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.483362:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867826688:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.483757:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.485176:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867826688:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142912.485192:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142912.485224:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2003:x1830962867417472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2246us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.485231:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6467 00000100:00100000:0.0:1746142912.487752:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.488680:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417728 00000100:00100000:2.0:1746142912.488689:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417728 00002000:00100000:2.0:1746142912.488730:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012b1a0700 x1830962867417728/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.488743:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0700 with x1830962867417728 ext(2097152->3145727) 00002000:00010000:2.0:1746142912.488748:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a0700 00000100:00100000:2.0:1746142912.488777:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4437 00000100:00100000:2.0:1746142912.488784:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867417728:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.499717:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867417728:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10923us (11963us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142912.499727:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4437 00002000:00100000:2.0:1746142912.499736:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012b1a0700 x1830962867417728/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.499744:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0700 with x1830962867417728 ext(2097152->3145727) 00002000:00010000:2.0:1746142912.499749:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a0700 00000100:00100000:2.0:1746142912.504542:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.504916:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417856 00000100:00100000:3.0:1746142912.504924:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417856 00000100:00100000:3.0:1746142912.504960:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14300 00000100:00100000:3.0:1746142912.504968:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+29:32478:x1830962867417856:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.504981:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.504995:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa47 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.505017:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.505028:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.505029:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.505032:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.505054:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 44 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.505064:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 44 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.505074:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867826816:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.505148:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.506712:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867826816:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.506735:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.506747:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d600, rc 0) 00000100:00100000:3.0:1746142912.506788:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:32478:x1830962867417856:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1820us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.506795:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14300 00000100:00100000:0.0:1746142912.511063:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.511509:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867417984 00000100:00100000:2.0:1746142912.511517:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867417984 00002000:00100000:2.0:1746142912.511551:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2379775) req@ffff8800946c5c00 x1830962867417984/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.511560:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c5c00 with x1830962867417984 ext(2097152->2379775) 00010000:00010000:2.0:1746142912.511568:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 45 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.511581:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 45 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.511587:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800946c5c00 00000100:00100000:2.0:1746142912.511618:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1381 00000100:00100000:2.0:1746142912.511624:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867417984:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142912.520340:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867417984:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 8699us (9267us total) trans 17179873935 rc 0/0 00000100:00100000:2.0:1746142912.520354:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1381 00002000:00100000:2.0:1746142912.520366:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2379775) req@ffff8800946c5c00 x1830962867417984/t17179873935(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.520377:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c5c00 with x1830962867417984 ext(2097152->2379775) 00010000:00010000:2.0:1746142912.520386:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 47 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.520404:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 47 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.520411:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800946c5c00 00000100:00100000:0.0:1746142912.526442:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.526725:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867418112 00000100:00100000:3.0:1746142912.526733:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867418112 00000100:00100000:3.0:1746142912.526772:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14301 00000100:00100000:3.0:1746142912.526778:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32481:x1830962867418112:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142912.526793:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.526808:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa4e expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.526829:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.526836:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 22 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.526841:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.526842:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.526845:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 51 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.526867:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 22 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.526877:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 22 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746142912.526886:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867826944:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.527543:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.527551:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.527563:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867827072:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.527584:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.531745:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867826944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.531755:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867827072:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.531780:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [2035712->2097151] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 51 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.531794:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3dc00, rc 0) 00000100:00100000:3.0:1746142912.532626:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32481:x1830962867418112:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5845us (6188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.532633:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14301 00000100:00100000:2.0:1746142912.534877:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.534923:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867418240 00000100:00100000:2.0:1746142912.534924:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.534930:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867418240 00010000:00010000:3.0:1746142912.534956:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 47 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.534981:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867418368 00000100:00100000:2.0:1746142912.534982:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.534983:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867418368 00010000:00010000:3.0:1746142912.534993:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.534993:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867418496 00000100:00100000:2.0:1746142912.534995:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867418496 00010000:00010000:2.0:1746142912.535007:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.535016:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6468 00000100:00100000:3.0:1746142912.535023:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867418240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.535034:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142912.535036:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6469 00000100:00100000:1.0:1746142912.535042:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867418368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.535050:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.535052:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 47 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.535060:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.535061:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 47 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.535067:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.535079:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0c00/0x2fa243e067ccd2c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9fa expref: 47 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.535079:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495de00/0x2fa243e067ccd2eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa1d expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.535094:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.535096:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.535102:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.535110:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.535182:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 29 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.535184:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6470 00000100:00100000:2.0:1746142912.535189:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2004:x1830962867418496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142912.535193:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867827200:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142912.535198:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.535204:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.535211:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.535220:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3ca00/0x2fa243e067ccd2d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa08 expref: 51 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.535230:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.535231:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.535234:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 50 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.535241:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 50 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.535249:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746142912.535256:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 50 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.535263:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867827328:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142912.535281:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746142912.535478:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.535499:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867418368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 457us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.535505:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6469 00000100:00100000:0.0:1746142912.536834:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.536935:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867827328:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142912.536949:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.536970:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2004:x1830962867418496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1781us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.536977:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6470 00000100:00100000:2.0:1746142912.536998:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867418752 00000100:00100000:2.0:1746142912.537002:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867418752 00002000:00100000:2.0:1746142912.537026:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (2035712->2039807) req@ffff8800946c4a80 x1830962867418752/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.537034:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4a80 with x1830962867418752 ext(2035712->2039807) 00002000:00010000:2.0:1746142912.537038:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c4a80 00000100:00100000:2.0:1746142912.537734:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4438 00000100:00100000:2.0:1746142912.537742:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2003:x1830962867418752:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142912.538187:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867827200:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142912.538198:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.538271:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2003:x1830962867418752:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 530us (1439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.538277:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4438 00002000:00100000:2.0:1746142912.538283:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (2035712->2039807) req@ffff8800946c4a80 x1830962867418752/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.538290:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4a80 with x1830962867418752 ext(2035712->2039807) 00002000:00010000:2.0:1746142912.538293:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c4a80 00000100:00100000:3.0:1746142912.538470:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867418240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3446us (3597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.538477:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6468 00000100:00100000:0.0:1746142912.542280:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.542380:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867419008 00000100:00100000:2.0:1746142912.542388:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867419008 00002000:00100000:2.0:1746142912.542420:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800946c6a00 x1830962867419008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.542428:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c6a00 with x1830962867419008 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.542432:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800946c6a00 00000100:00100000:2.0:1746142912.542463:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4439 00000100:00100000:2.0:1746142912.542470:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867419008:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142912.543063:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.543123:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867419264 00000100:00100000:3.0:1746142912.543127:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867419264 00000100:00100000:3.0:1746142912.543149:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14302 00000100:00100000:3.0:1746142912.543153:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32481:x1830962867419264:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142912.543163:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.543175:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa55 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.543194:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.543199:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.543201:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.543203:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->2232319] (req 2097152->2232319) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 51 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.543226:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 21 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.543237:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 21 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.543247:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867827456:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.543297:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.543734:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.543750:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867419392 00000100:00100000:1.0:1746142912.543752:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867419392 00002000:00100000:1.0:1746142912.543767:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880088d62d80 x1830962867419392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.543774:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62d80 with x1830962867419392 ext(3145728->4194303) 00010000:00010000:1.0:1746142912.543779:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.543787:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.543791:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d62d80 00000100:00100000:1.0:1746142912.543814:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1382 00000100:00100000:1.0:1746142912.543819:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867419392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142912.547655:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867827456:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.547680:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->2232319] (req 2097152->2232319) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 51 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.547699:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06a00, rc 0) 00000100:00100000:3.0:1746142912.547739:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32481:x1830962867419264:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4578us (5404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.547747:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14302 00000100:00100000:2.0:1746142912.554819:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867419008:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12342us (12538us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142912.554829:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4439 00002000:00100000:2.0:1746142912.554839:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800946c6a00 x1830962867419008/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.554847:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c6a00 with x1830962867419008 ext(2097152->4194303) 00002000:00010000:2.0:1746142912.554852:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800946c6a00 00000100:00100000:1.0:1746142912.558967:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867419392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15138us (15223us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.558978:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1382 00002000:00100000:1.0:1746142912.558989:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880088d62d80 x1830962867419392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.558998:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d62d80 with x1830962867419392 ext(3145728->4194303) 00010000:00010000:1.0:1746142912.559007:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.559020:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 22 pid: 11421 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.559027:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d62d80 00000100:00100000:0.0:1746142912.559239:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.559629:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867419520 00000100:00100000:3.0:1746142912.559635:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867419520 00000100:00100000:3.0:1746142912.559889:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14303 00000100:00100000:3.0:1746142912.559895:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:32478:x1830962867419520:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.563218:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.563238:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa5c expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.563263:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.563266:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.563274:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.563287:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 23 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.563297:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07200, rc 0) 00000100:00100000:3.0:1746142912.563371:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:32478:x1830962867419520:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3475us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.563378:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14303 00000100:00100000:0.0:1746142912.563756:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.564138:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867419648 00000100:00100000:3.0:1746142912.564145:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867419648 00010000:00010000:3.0:1746142912.564165:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 23 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.564737:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6471 00000100:00100000:3.0:1746142912.564750:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867419648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.564760:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.564776:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 23 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.564787:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 23 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.564801:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3d800/0x2fa243e067ccd30e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa40 expref: 23 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.564823:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.564825:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.564830:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 50 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.564838:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 50 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.564864:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 50 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.564875:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867827584:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.564957:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.567757:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.567844:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867419904 00000100:00100000:1.0:1746142912.567851:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867419904 00000100:00100000:3.0:1746142912.567881:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867827584:192.168.204.50@tcp:105: 00002000:00100000:1.0:1746142912.567883:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800946c4e00 x1830962867419904/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.567891:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4e00 with x1830962867419904 ext(3145728->4194303) 00002000:00010000:1.0:1746142912.567895:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c4e00 00010000:00010000:3.0:1746142912.567924:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.567936:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4440 00000100:00100000:1.0:1746142912.567943:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867419904:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142912.567963:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867419648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3214us (4207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.567970:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6471 00000100:00100000:0.0:1746142912.572470:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.572526:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867420160 00000100:00100000:2.0:1746142912.572534:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867420160 00002000:00100000:2.0:1746142912.572566:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2228224->2232319) req@ffff8800946c7800 x1830962867420160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.572576:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c7800 with x1830962867420160 ext(2228224->2232319) 00002000:00010000:2.0:1746142912.572581:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c7800 00000100:00100000:2.0:1746142912.572612:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4441 00000100:00100000:2.0:1746142912.572619:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2005:x1830962867420160:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.573843:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2005:x1830962867420160:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1220us (1375us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.573851:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4441 00002000:00100000:2.0:1746142912.573862:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2228224->2232319) req@ffff8800946c7800 x1830962867420160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.573873:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c7800 with x1830962867420160 ext(2228224->2232319) 00002000:00010000:2.0:1746142912.573876:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c7800 00000100:00100000:1.0:1746142912.575687:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867419904:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7739us (7930us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.575695:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4440 00002000:00100000:1.0:1746142912.575700:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800946c4e00 x1830962867419904/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.575707:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c4e00 with x1830962867419904 ext(3145728->4194303) 00002000:00010000:1.0:1746142912.575711:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c4e00 00000100:00100000:0.0:1746142912.582149:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.582186:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.582213:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.582251:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.582417:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867420288 00000100:00100000:2.0:1746142912.582424:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867420288 00000100:00100000:2.0:1746142912.582456:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867420416 00000100:00100000:2.0:1746142912.582459:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867420416 00000100:00100000:2.0:1746142912.582469:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867420544 00000100:00100000:2.0:1746142912.582471:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867420544 00000100:00100000:2.0:1746142912.582488:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867420672 00000100:00100000:2.0:1746142912.582489:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867420672 00000100:00100000:2.0:1746142912.582504:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14304 00000100:00100000:2.0:1746142912.582510:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867420288:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.582525:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.582538:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b1e00/0x2fa243e067ccd331 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa63 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.582578:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867827712:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.582585:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14305 00000100:00100000:3.0:1746142912.582593:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2006:x1830962867420416:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.582601:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.582610:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067ccd338 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa6a expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.582628:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067ccd338 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa6a expref: 52 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142912.582635:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746142912.582638:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067ccd338 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa6a expref: 52 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142912.582649:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14306 00010000:00010000:3.0:1746142912.582650:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06200, rc 0) 00000100:00100000:2.0:1746142912.582654:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867420544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.582660:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.582666:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa71 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.582673:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2006:x1830962867420416:12345-192.168.204.50@tcp:101:cat.0 Request processed in 80us (486us total) trans 0 rc 301/301 00010000:00010000:2.0:1746142912.582676:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.582678:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142912.582679:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14305 00010000:00010000:2.0:1746142912.582684:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 49 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142912.582695:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14307 00010000:00010000:2.0:1746142912.582696:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 49 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142912.582700:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867420672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.582706:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.582709:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2a00, rc 0) 00010000:00010000:3.0:1746142912.582713:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06e00/0x2fa243e067ccd346 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa78 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.582723:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867420544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 69us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.582728:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14306 00000100:00100000:3.0:1746142912.582734:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867827840:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.582755:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.584554:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.584601:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867420800 00000100:00100000:2.0:1746142912.584606:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867420800 00000100:00100000:2.0:1746142912.584641:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14308 00000100:00100000:2.0:1746142912.584647:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867420800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.584661:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.584673:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d6000/0x2fa243e067ccd34d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa7f expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.584691:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927d6000/0x2fa243e067ccd34d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa7f expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.584700:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d6000/0x2fa243e067ccd34d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa7f expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.584712:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6000, rc 0) 00000100:00100000:2.0:1746142912.584761:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867420800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 114us (213us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.584767:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14308 00002000:00010000:2.0:1746142912.585016:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142912 -> 1746142913 00000100:00100000:2.0:1746142912.585032:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867827712:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.585050:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1e00/0x2fa243e067ccd331 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa63 expref: 48 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.585058:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1e00/0x2fa243e067ccd331 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa63 expref: 48 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.585065:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1e00, rc 0) 00000100:00100000:2.0:1746142912.585079:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867420288:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2570us (2939us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.585085:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14304 00002000:00010000:3.0:1746142912.585416:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746142912 -> 1746142913 00002000:00010000:3.0:1746142912.585420:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746142912 -> 1746142913 00000100:00100000:3.0:1746142912.585431:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867827840:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.585446:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06e00/0x2fa243e067ccd346 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa78 expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.585456:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06e00/0x2fa243e067ccd346 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa78 expref: 23 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.585463:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06e00, rc 0) 00000100:00100000:3.0:1746142912.585495:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867420672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2795us (3242us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.585501:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14307 00000100:00100000:0.0:1746142912.588187:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.588263:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421056 00000100:00100000:1.0:1746142912.588270:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421056 00002000:00100000:1.0:1746142912.588301:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800946c6680 x1830962867421056/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.588311:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c6680 with x1830962867421056 ext(4194304->5066751) 00002000:00010000:1.0:1746142912.588325:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c6680 00000100:00100000:1.0:1746142912.588364:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4442 00000100:00100000:1.0:1746142912.588371:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867421056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142912.589336:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.590014:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421184 00000100:00100000:3.0:1746142912.590018:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421184 00000100:00100000:3.0:1746142912.590050:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14309 00000100:00100000:3.0:1746142912.590055:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32485:x1830962867421184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.590064:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.590076:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa86 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.590096:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.590104:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.590105:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.590109:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 48 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.590130:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.590140:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 29 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.590149:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867827968:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.590200:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.593760:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.594073:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867827968:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.594096:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 48 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.594109:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06400, rc 0) 00000100:00100000:3.0:1746142912.594140:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32485:x1830962867421184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4084us (4814us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.594147:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14309 00000100:00100000:2.0:1746142912.594216:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421312 00000100:00100000:2.0:1746142912.594226:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421312 00002000:00100000:2.0:1746142912.594251:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1499136->2084863) req@ffff88009cd5e680 x1830962867421312/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.594259:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5e680 with x1830962867421312 ext(1499136->2084863) 00010000:00010000:2.0:1746142912.594264:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 30 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.594274:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 30 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.594280:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd5e680 00000100:00100000:1.0:1746142912.594283:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867421056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5911us (6101us total) trans 0 rc 872448/872448 00000100:00100000:1.0:1746142912.594290:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4442 00000100:00100000:2.0:1746142912.594293:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1383 00002000:00100000:1.0:1746142912.594296:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800946c6680 x1830962867421056/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142912.594299:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+30:2005:x1830962867421312:12345-192.168.204.50@tcp:4:cat.0 00002000:00100000:1.0:1746142912.594304:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800946c6680 with x1830962867421056 ext(4194304->5066751) 00002000:00010000:1.0:1746142912.594308:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800946c6680 00000100:00100000:3.0:1746142912.596965:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.596983:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421568 00000100:00100000:3.0:1746142912.596988:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421568 00000100:00100000:0.0:1746142912.596996:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.597049:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.597242:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421440 00000100:00100000:3.0:1746142912.597246:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421440 00000100:00100000:1.0:1746142912.597268:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421696 00000100:00100000:1.0:1746142912.597271:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421696 00000100:00100000:2.0:1746142912.597380:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14310 00000100:00100000:2.0:1746142912.597388:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867421568:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.597404:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.597417:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5a00/0x2fa243e067ccd35b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa94 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.597437:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14311 00000100:00100000:1.0:1746142912.597444:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867421696:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142912.597452:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142912.597460:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828096:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142912.597460:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccd362 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa9b expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.597477:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccd362 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa9b expref: 25 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.597487:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471f200/0x2fa243e067ccd362 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa9b expref: 25 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.597498:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f200, rc 0) 00000100:00100000:2.0:1746142912.597512:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.597518:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867421696:12345-192.168.204.50@tcp:101:cat.0 Request processed in 75us (469us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142912.597523:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14311 00000100:00100000:2.0:1746142912.597531:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14312 00000100:00100000:2.0:1746142912.597536:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867421440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.597543:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.597550:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd369 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aa8d expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.597568:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867828224:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142912.597584:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.598385:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867421312:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4084us (4630us total) trans 17179873936 rc 0/0 00000100:00100000:2.0:1746142912.598392:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1383 00002000:00100000:2.0:1746142912.598400:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1499136->2084863) req@ffff88009cd5e680 x1830962867421312/t17179873936(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.598408:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5e680 with x1830962867421312 ext(1499136->2084863) 00010000:00010000:2.0:1746142912.598414:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 34 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.598423:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 34 pid: 1852 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.598434:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cd5e680 00002000:00010000:2.0:1746142912.600295:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142912 -> 1746142913 00000100:00100000:2.0:1746142912.600312:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828096:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.600340:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5a00/0x2fa243e067ccd35b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa94 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.600349:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5a00/0x2fa243e067ccd35b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa94 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.600357:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5a00, rc 0) 00000100:00100000:2.0:1746142912.600390:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867421568:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3004us (3431us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.600396:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14310 00000100:00100000:0.0:1746142912.601307:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.601458:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867828224:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.601478:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd369 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa8d expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.601487:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd369 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa8d expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.601500:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4a00, rc 0) 00000100:00100000:3.0:1746142912.601525:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867421440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3988us (4529us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.601529:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14312 00000100:00100000:2.0:1746142912.601569:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421824 00000100:00100000:2.0:1746142912.601575:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421824 00010000:00010000:2.0:1746142912.601592:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 32 pid: 1852 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.601617:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6472 00000100:00100000:2.0:1746142912.601623:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867421824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.601633:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.601640:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 32 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.601653:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 32 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.601666:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3c600/0x2fa243e067ccd2e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1499136->2084863) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa16 expref: 32 pid: 1852 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.601674:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.601675:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.601681:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.601687:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.601707:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.601717:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867828352:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142912.601782:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.603445:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867828352:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142912.603460:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.603496:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867421824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1872us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.603503:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6472 00000100:00100000:0.0:1746142912.604133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.604178:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867421952 00000100:00100000:3.0:1746142912.604183:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867421952 00000100:00100000:3.0:1746142912.604216:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14313 00000100:00100000:3.0:1746142912.604222:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867421952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.604234:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.604245:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aaa2 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.604261:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.604263:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.604269:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 32 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.604280:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 32 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.604374:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07c00, rc 0) 00000100:00100000:3.0:1746142912.604405:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867421952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 183us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.604410:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14313 00000100:00100000:0.0:1746142912.606039:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.606077:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.606157:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867422080 00000100:00100000:3.0:1746142912.606163:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867422080 00000100:00100000:3.0:1746142912.606196:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867422208 00000100:00100000:3.0:1746142912.606198:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867422208 00000100:00100000:2.0:1746142912.606203:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14314 00000100:00100000:2.0:1746142912.606213:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867422080:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142912.606214:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14315 00000100:00100000:3.0:1746142912.606219:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867422208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.606223:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.606226:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.606234:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd37e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aab0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.606235:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccd377 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aaa9 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.606253:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd37e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab0 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.606261:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd37e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab0 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142912.606268:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828480:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.606269:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07000, rc 0) 00000100:00100000:3.0:1746142912.606293:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867422208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (216us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.606298:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14315 00000100:00100000:2.0:1746142912.606316:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.607443:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.607481:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867422592 00000100:00100000:3.0:1746142912.607486:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867422592 00000100:00100000:0.0:1746142912.607498:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1746142912.607510:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800938de680 x1830962867422592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.607518:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830962867422592 ext(1048576->2097151) 00002000:00010000:3.0:1746142912.607522:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:3.0:1746142912.607542:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867422720 00000100:00100000:3.0:1746142912.607544:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867422720 00002000:00100000:3.0:1746142912.607555:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2035711) req@ffff8800938ddf80 x1830962867422720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.607560:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938ddf80 with x1830962867422720 ext(1048576->2035711) 00002000:00010000:3.0:1746142912.607563:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938ddf80 00000100:00100000:3.0:1746142912.607574:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4443 00000100:00100000:3.0:1746142912.607579:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867422592:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.607579:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828480:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.607595:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccd377 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa9 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.607603:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5600/0x2fa243e067ccd377 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa9 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.607610:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5600, rc 0) 00000100:00100000:2.0:1746142912.607628:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867422080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1418us (1594us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.607633:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14314 00000100:00100000:1.0:1746142912.607682:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4444 00000100:00100000:1.0:1746142912.607692:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2006:x1830962867422720:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142912.616711:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867422592:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9124us (9261us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142912.616721:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4443 00002000:00100000:3.0:1746142912.616731:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800938de680 x1830962867422592/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.616739:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830962867422592 ext(1048576->2097151) 00002000:00010000:3.0:1746142912.616744:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:1.0:1746142912.619663:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2006:x1830962867422720:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11966us (12157us total) trans 0 rc 987136/987136 00000100:00100000:1.0:1746142912.619924:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4444 00002000:00100000:1.0:1746142912.619933:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2035711) req@ffff8800938ddf80 x1830962867422720/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.619941:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938ddf80 with x1830962867422720 ext(1048576->2035711) 00002000:00010000:1.0:1746142912.619945:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938ddf80 00000100:00100000:0.0:1746142912.631962:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.631994:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867423232 00000100:00100000:0.0:1746142912.631999:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.632002:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867423232 00002000:00100000:1.0:1746142912.632038:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff8800938dc700 x1830962867423232/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142912.632045:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867423104 00002000:00100000:1.0:1746142912.632047:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc700 with x1830962867423232 ext(2097152->3145727) 00000100:00100000:3.0:1746142912.632049:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867423104 00002000:00010000:1.0:1746142912.632052:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dc700 00002000:00100000:3.0:1746142912.632066:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2232320->3145727) req@ffff8800938df100 x1830962867423104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.632073:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938df100 with x1830962867423104 ext(2232320->3145727) 00002000:00010000:3.0:1746142912.632077:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938df100 00000100:00100000:1.0:1746142912.632085:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4445 00000100:00100000:1.0:1746142912.632092:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867423232:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142912.632096:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4446 00000100:00100000:3.0:1746142912.632101:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2004:x1830962867423104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142912.638322:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2004:x1830962867423104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6212us (6314us total) trans 0 rc 913408/913408 00000100:00100000:3.0:1746142912.638343:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4446 00002000:00100000:3.0:1746142912.638355:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2232320->3145727) req@ffff8800938df100 x1830962867423104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.638363:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938df100 with x1830962867423104 ext(2232320->3145727) 00002000:00010000:3.0:1746142912.638368:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938df100 00000100:00100000:1.0:1746142912.639026:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867423232:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6931us (7068us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.639034:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4445 00002000:00100000:1.0:1746142912.639040:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff8800938dc700 x1830962867423232/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.639047:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc700 with x1830962867423232 ext(2097152->3145727) 00002000:00010000:1.0:1746142912.639050:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dc700 00000100:00100000:0.0:1746142912.647533:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.647608:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867423360 00000100:00100000:2.0:1746142912.647616:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867423360 00000100:00100000:2.0:1746142912.647660:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14316 00000100:00100000:2.0:1746142912.647668:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32485:x1830962867423360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142912.647682:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.647695:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aab7 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.647723:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.647725:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.647732:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 52 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.647744:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 52 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.647753:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5400, rc 0) 00000100:00100000:2.0:1746142912.647790:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32485:x1830962867423360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.647795:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14316 00000100:00100000:0.0:1746142912.652447:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.652488:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.652561:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867423744 00000100:00100000:3.0:1746142912.652570:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867423744 00002000:00100000:3.0:1746142912.652601:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff8800949d0700 x1830962867423744/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.652610:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0700 with x1830962867423744 ext(3145728->4194303) 00002000:00010000:3.0:1746142912.652615:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d0700 00000100:00100000:3.0:1746142912.652637:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867423872 00000100:00100000:3.0:1746142912.652639:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867423872 00002000:00100000:3.0:1746142912.652648:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800949d3800 x1830962867423872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.652654:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3800 with x1830962867423872 ext(3145728->4194303) 00002000:00010000:3.0:1746142912.652657:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d3800 00000100:00100000:3.0:1746142912.652666:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4447 00000100:00100000:3.0:1746142912.652671:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867423744:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.652733:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4448 00000100:00100000:1.0:1746142912.652741:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2005:x1830962867423872:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.660728:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2005:x1830962867423872:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7979us (8230us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.660739:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4448 00002000:00100000:1.0:1746142912.660749:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800949d3800 x1830962867423872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.660759:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3800 with x1830962867423872 ext(3145728->4194303) 00002000:00010000:1.0:1746142912.660764:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d3800 00000100:00100000:3.0:1746142912.663835:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867423744:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11154us (11386us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142912.663844:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4447 00002000:00100000:3.0:1746142912.663853:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff8800949d0700 x1830962867423744/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.663862:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0700 with x1830962867423744 ext(3145728->4194303) 00002000:00010000:3.0:1746142912.663866:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d0700 00000100:00100000:2.0:1746142912.669731:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.669891:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424000 00000100:00100000:1.0:1746142912.669918:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424000 00000100:00100000:1.0:1746142912.669964:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14317 00000100:00100000:1.0:1746142912.669973:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424000:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142912.669988:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.670004:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd38c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aabe expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.670031:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd38c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aabe expref: 53 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.670041:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd38c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aabe expref: 53 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.670842:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ee00, rc 0) 00000100:00100000:1.0:1746142912.671238:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424000:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1263us (1510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142912.671244:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14317 00000100:00100000:0.0:1746142912.677449:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.677532:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424256 00000100:00100000:3.0:1746142912.677541:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424256 00002000:00100000:3.0:1746142912.677609:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800949d1180 x1830962867424256/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.677617:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1180 with x1830962867424256 ext(4194304->5066751) 00002000:00010000:3.0:1746142912.677622:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d1180 00000100:00100000:3.0:1746142912.677650:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4449 00000100:00100000:3.0:1746142912.677656:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424256:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142912.682004:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424256:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4339us (4554us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142912.682014:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4449 00002000:00100000:3.0:1746142912.682023:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800949d1180 x1830962867424256/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.682031:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1180 with x1830962867424256 ext(4194304->5066751) 00002000:00010000:3.0:1746142912.682036:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d1180 00000100:00100000:0.0:1746142912.688491:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.688805:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424384 00000100:00100000:1.0:1746142912.688813:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424384 00000100:00100000:1.0:1746142912.688853:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14318 00000100:00100000:1.0:1746142912.688861:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142912.688875:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.688889:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd393 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aac5 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.688943:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd393 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aac5 expref: 53 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.688957:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd393 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aac5 expref: 53 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.689272:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ea00, rc 0) 00000100:00100000:1.0:1746142912.689636:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 775us (1151us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142912.689642:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14318 00000100:00100000:0.0:1746142912.691789:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.693015:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424512 00000100:00100000:1.0:1746142912.693024:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424512 00000100:00100000:1.0:1746142912.693074:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14319 00000100:00100000:1.0:1746142912.693082:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2003:x1830962867424512:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142912.693096:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.693111:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067ccd39a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aacc expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.693135:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067ccd39a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aacc expref: 53 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.693144:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471f400/0x2fa243e067ccd39a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aacc expref: 53 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.693152:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f400, rc 0) 00000100:00100000:1.0:1746142912.693202:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2003:x1830962867424512:12345-192.168.204.50@tcp:101:cat.0 Request processed in 120us (1418us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142912.693208:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14319 00000100:00100000:0.0:1746142912.714403:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.714720:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424640 00000100:00100000:2.0:1746142912.714730:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424640 00000100:00100000:2.0:1746142912.714808:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14320 00000100:00100000:2.0:1746142912.714818:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:32489:x1830962867424640:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142912.714835:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.714852:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aad3 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.714881:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 51 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.714889:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.714951:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.714955:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.714959:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [913408->1048575] (req 913408->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.714990:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.715001:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.715012:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828608:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.715119:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 51 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.715129:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 51 pid: 9580 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.715137:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828736:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.715165:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.719496:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.719526:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828608:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142912.719534:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.719536:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867828736:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.719558:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [913408->1048575] (req 913408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.719581:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89c400, rc 0) 00000100:00100000:2.0:1746142912.719632:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:32489:x1830962867424640:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4816us (5238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.719640:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14320 00000100:00100000:1.0:1746142912.719703:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424768 00000100:00100000:1.0:1746142912.719708:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424768 00010000:00010000:1.0:1746142912.719730:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 52 pid: 9580 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.719746:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867424896 00000100:00100000:1.0:1746142912.719748:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867424896 00010000:00010000:1.0:1746142912.719755:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.719766:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6473 00000100:00100000:1.0:1746142912.719771:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867424768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.719780:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.719796:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 52 pid: 9580 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.719804:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 52 pid: 9580 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.719821:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1200/0x2fa243e067ccd258 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a98a expref: 52 pid: 9580 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.719844:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.719860:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2006:x1830962867424768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.719865:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6473 00000100:00100000:1.0:1746142912.719875:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6474 00000100:00100000:1.0:1746142912.719879:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867424896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.719885:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.719892:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.719933:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.719944:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccd282 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9b4 expref: 23 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.719951:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.719953:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.719958:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 22 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.719965:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 22 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.719986:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 22 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.719995:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867828864:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142912.720038:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.721385:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867828864:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142912.721396:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.721416:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867424896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1536us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.721426:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6474 00000100:00100000:0.0:1746142912.721773:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.721956:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867425152 00000100:00100000:3.0:1746142912.721961:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867425152 00002000:00100000:3.0:1746142912.721990:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (913408->917503) req@ffff88012e519180 x1830962867425152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.722040:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e519180 with x1830962867425152 ext(913408->917503) 00002000:00010000:3.0:1746142912.722044:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e519180 00000100:00100000:3.0:1746142912.722072:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4450 00000100:00100000:3.0:1746142912.722079:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867425152:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142912.722176:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867425152:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 97us (402us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142912.722181:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4450 00002000:00100000:3.0:1746142912.722186:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (913408->917503) req@ffff88012e519180 x1830962867425152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.722192:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e519180 with x1830962867425152 ext(913408->917503) 00002000:00010000:3.0:1746142912.722195:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e519180 00000100:00100000:0.0:1746142912.727367:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.727454:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867425280 00000100:00100000:2.0:1746142912.727462:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867425280 00000100:00100000:2.0:1746142912.727510:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14321 00000100:00100000:2.0:1746142912.727517:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:32489:x1830962867425280:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142912.727533:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.727547:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aada expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.727570:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.727577:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.727583:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.727585:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.727588:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1445887] (req 1048576->1445887) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.727613:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.727627:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.727637:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867828992:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.727714:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 47 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.728056:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 47 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.728066:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867829120:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.728113:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.730794:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867828992:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.730806:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867829120:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.730828:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1445887] (req 1048576->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.730842:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89dc00, rc 0) 00000100:00100000:2.0:1746142912.730885:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+33:32489:x1830962867425280:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3367us (3522us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.730892:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14321 00000100:00100000:0.0:1746142912.731791:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.731830:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.731857:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867425408 00000100:00100000:1.0:1746142912.731863:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867425408 00000100:00100000:3.0:1746142912.731876:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867425536 00000100:00100000:3.0:1746142912.731879:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867425536 00010000:00010000:1.0:1746142912.731885:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.731890:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 48 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.731933:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6475 00000100:00100000:3.0:1746142912.731939:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867425408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.731950:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.731966:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.731980:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.732238:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6476 00000100:00100000:1.0:1746142912.732245:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867425536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.732254:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.732511:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 48 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.732520:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 48 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.732538:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd354 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa86 expref: 48 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.732561:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142912.732586:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07c00/0x2fa243e067ccd370 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaa2 expref: 33 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.732599:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142912.732600:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a00050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867425536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 356us (770us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142912.732601:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142912.732606:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6476 00010000:00010000:3.0:1746142912.732607:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.732613:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.732646:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.732656:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867829248:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.732779:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.740073:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.740085:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867829248:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142912.740102:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.740104:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.740143:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867425408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8203us (8354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.740143:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.740156:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6475 00000100:00100000:3.0:1746142912.740215:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867426048 00000100:00100000:3.0:1746142912.740221:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867426048 00002000:00100000:3.0:1746142912.740260:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1441792->1445887) req@ffff880088d60e00 x1830962867426048/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.740272:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d60e00 with x1830962867426048 ext(1441792->1445887) 00002000:00010000:3.0:1746142912.740276:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d60e00 00000100:00100000:3.0:1746142912.740298:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4451 00000100:00100000:3.0:1746142912.740304:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:2003:x1830962867426048:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142912.740449:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:2003:x1830962867426048:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 143us (304us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142912.740454:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4451 00002000:00100000:3.0:1746142912.740459:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1441792->1445887) req@ffff880088d60e00 x1830962867426048/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.740464:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d60e00 with x1830962867426048 ext(1441792->1445887) 00002000:00010000:3.0:1746142912.740467:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d60e00 00000100:00100000:0.0:1746142912.740478:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867425664 00000100:00100000:0.0:1746142912.740483:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867425664 00000100:00100000:0.0:1746142912.740502:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867425792 00000100:00100000:0.0:1746142912.740504:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867425792 00000100:00100000:0.0:1746142912.740516:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14322 00000100:00100000:0.0:1746142912.740521:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867425664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142912.740530:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142912.740541:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3921200/0x2fa243e067ccd3af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aae1 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142912.740576:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867829376:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142912.740622:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.740729:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14323 00000100:00100000:1.0:1746142912.740736:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867425792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142912.740749:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.740757:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471fe00/0x2fa243e067ccd3b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aae8 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.740789:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471fe00/0x2fa243e067ccd3b6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aae8 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.740798:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471fe00/0x2fa243e067ccd3b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aae8 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.740809:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471fe00, rc 0) 00000100:00100000:1.0:1746142912.740827:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867425792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 92us (723us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142912.740832:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14323 00000100:00100000:2.0:1746142912.744449:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867829376:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.744476:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3921200/0x2fa243e067ccd3af lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aae1 expref: 23 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.744489:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3921200/0x2fa243e067ccd3af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aae1 expref: 23 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.744516:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3921200, rc 0) 00000100:00100000:2.0:1746142912.744588:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867425664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4065us (4520us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.744596:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14322 00000100:00100000:0.0:1746142912.746398:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.746829:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867426176 00000100:00100000:2.0:1746142912.746836:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867426176 00000100:00100000:2.0:1746142912.747362:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14324 00000100:00100000:2.0:1746142912.747369:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32492:x1830962867426176:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142912.747434:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.747446:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aaef expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.747469:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.747475:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142912.747477:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142912.747480:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [36864->622591] (req 36864->622591) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 52 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.747500:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.747513:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 21 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.747522:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867829504:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.750372:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.752363:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.752414:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.752511:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867426432 00000100:00100000:3.0:1746142912.752518:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867426432 00000100:00100000:1.0:1746142912.752540:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867426688 00000100:00100000:1.0:1746142912.752544:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867426688 00002000:00100000:3.0:1746142912.752547:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->913407) req@ffff880088fdad80 x1830962867426432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.752554:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdad80 with x1830962867426432 ext(0->913407) 00010000:00010000:3.0:1746142912.752560:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 22 pid: 1397 timeout: 786 lvb_type: 0 00002000:00100000:1.0:1746142912.752564:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1445888->2097151) req@ffff880088fdb480 x1830962867426688/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746142912.752570:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 22 pid: 1397 timeout: 786 lvb_type: 0 00002000:00100000:1.0:1746142912.752571:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb480 with x1830962867426688 ext(1445888->2097151) 00002000:00010000:1.0:1746142912.752575:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fdb480 00002000:00010000:3.0:1746142912.752577:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fdad80 00000100:00100000:3.0:1746142912.752597:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1384 00000100:00100000:3.0:1746142912.752602:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867426432:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.752662:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4452 00000100:00100000:1.0:1746142912.752668:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867426688:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142912.753522:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867829504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.753527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142912.753556:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [36864->622591] (req 36864->622591) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 52 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142912.753557:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867426816 00000100:00100000:0.0:1746142912.753560:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867426816 00010000:00010000:2.0:1746142912.753568:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89ca00, rc 0) 00002000:00100000:0.0:1746142912.753575:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (913408->1048575) req@ffff880088d61180 x1830962867426816/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142912.753582:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d61180 with x1830962867426816 ext(913408->1048575) 00010000:00010000:0.0:1746142912.753587:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.753601:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746142912.753607:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d61180 00000100:00100000:2.0:1746142912.753612:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32492:x1830962867426176:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6243us (7217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.753618:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1385 00000100:00100000:2.0:1746142912.753619:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14324 00000100:00100000:0.0:1746142912.753623:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867426816:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142912.759970:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867426688:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7293us (7547us total) trans 0 rc 651264/651264 00000100:00100000:1.0:1746142912.759982:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4452 00002000:00100000:1.0:1746142912.759992:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1445888->2097151) req@ffff880088fdb480 x1830962867426688/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.760000:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb480 with x1830962867426688 ext(1445888->2097151) 00002000:00010000:1.0:1746142912.760005:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fdb480 00000100:00100000:1.0:1746142912.760977:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867426816:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7351us (7448us total) trans 21474841196 rc 0/0 00000100:00100000:1.0:1746142912.760985:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1385 00002000:00100000:1.0:1746142912.760991:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (913408->1048575) req@ffff880088d61180 x1830962867426816/t21474841196(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.760999:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d61180 with x1830962867426816 ext(913408->1048575) 00010000:00010000:1.0:1746142912.761006:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 26 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.761019:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 26 pid: 1397 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.761026:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d61180 00000100:00100000:3.0:1746142912.761151:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867426432:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8546us (8794us total) trans 0 rc 913408/913408 00000100:00100000:3.0:1746142912.761157:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1384 00002000:00100000:3.0:1746142912.761162:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->913407) req@ffff880088fdad80 x1830962867426432/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142912.761168:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdad80 with x1830962867426432 ext(0->913407) 00010000:00010000:3.0:1746142912.761173:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.761182:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00002000:00010000:3.0:1746142912.761187:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088fdad80 00000100:00100000:0.0:1746142912.770694:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.770846:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867426944 00000100:00100000:3.0:1746142912.770854:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867426944 00010000:00010000:3.0:1746142912.770884:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.772113:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6477 00000100:00100000:3.0:1746142912.772122:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867426944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.772134:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142912.772149:0:7217:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142911 -> 1746142913 00002000:00010000:3.0:1746142912.772152:0:7217:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142911 -> 1746142913 00010000:00010000:3.0:1746142912.772157:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.772169:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.772187:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a89c400/0x2fa243e067ccd3a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 913408->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aad3 expref: 24 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746142912.772259:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142912.772556:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.772558:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.772564:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 51 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.772572:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 51 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.772598:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 51 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.772609:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867829632:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142912.772664:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.773802:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867427072 00000100:00100000:2.0:1746142912.773809:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867427072 00000100:00100000:3.0:1746142912.774103:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14325 00000100:00100000:3.0:1746142912.774110:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+24:32496:x1830962867427072:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.774124:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.774136:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aaf6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.774155:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 51 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.774160:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.774162:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.774165:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.774182:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 51 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.774191:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 51 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.774201:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867829760:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.775491:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.775754:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.775847:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867829632:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142912.775862:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142912.775916:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867426944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3779us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.775924:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6477 00000100:00100000:2.0:1746142912.776422:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867427328 00000100:00100000:2.0:1746142912.776428:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867427328 00002000:00100000:2.0:1746142912.776457:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (36864->40959) req@ffff88009734ea00 x1830962867427328/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.776466:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ea00 with x1830962867427328 ext(36864->40959) 00002000:00010000:2.0:1746142912.776470:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734ea00 00000100:00100000:2.0:1746142912.776495:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4453 00000100:00100000:2.0:1746142912.776501:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2005:x1830962867427328:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.776606:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2005:x1830962867427328:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 105us (853us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.776612:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4453 00002000:00100000:2.0:1746142912.776617:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (36864->40959) req@ffff88009734ea00 x1830962867427328/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.776624:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734ea00 with x1830962867427328 ext(36864->40959) 00002000:00010000:2.0:1746142912.776627:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734ea00 00000100:00100000:3.0:1746142912.778863:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867829760:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.778887:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.778929:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07000, rc 0) 00000100:00100000:0.0:1746142912.778936:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.778958:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+24:32496:x1830962867427072:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4850us (6700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.778965:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14325 00000100:00100000:1.0:1746142912.778968:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867427456 00000100:00100000:1.0:1746142912.778974:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867427456 00002000:00100000:1.0:1746142912.779003:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (2035712->2097151) req@ffff8800922fd050 x1830962867427456/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.779011:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800922fd050 with x1830962867427456 ext(2035712->2097151) 00010000:00010000:1.0:1746142912.779017:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 52 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.779027:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 52 pid: 11421 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.779033:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800922fd050 00000100:00100000:1.0:1746142912.779054:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1386 00000100:00100000:1.0:1746142912.779059:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800922fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2006:x1830962867427456:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142912.783527:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.783612:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867427712 00000100:00100000:2.0:1746142912.783624:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867427712 00002000:00100000:2.0:1746142912.783670:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (618496->622591) req@ffff88009734f480 x1830962867427712/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.783681:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734f480 with x1830962867427712 ext(618496->622591) 00002000:00010000:2.0:1746142912.783686:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734f480 00000100:00100000:2.0:1746142912.783725:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4454 00000100:00100000:2.0:1746142912.783732:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2003:x1830962867427712:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142912.784956:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2003:x1830962867427712:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1220us (1431us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142912.785372:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4454 00002000:00100000:2.0:1746142912.785380:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (618496->622591) req@ffff88009734f480 x1830962867427712/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/4536 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.785389:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734f480 with x1830962867427712 ext(618496->622591) 00002000:00010000:2.0:1746142912.785393:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734f480 00000100:00100000:0.0:1746142912.786837:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800922fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2006:x1830962867427456:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 7769us (7893us total) trans 21474841197 rc 0/0 00000100:00100000:0.0:1746142912.786845:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1386 00002000:00100000:0.0:1746142912.786854:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (2035712->2097151) req@ffff8800922fd050 x1830962867427456/t21474841197(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142912.786861:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800922fd050 with x1830962867427456 ext(2035712->2097151) 00010000:00010000:0.0:1746142912.786869:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 54 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.786881:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 54 pid: 11421 timeout: 786 lvb_type: 0 00002000:00010000:0.0:1746142912.786887:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800922fd050 00000100:00100000:0.0:1746142912.792375:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.792646:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867427840 00000100:00100000:3.0:1746142912.792653:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867427840 00010000:00010000:3.0:1746142912.792690:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 54 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.792728:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6478 00000100:00100000:3.0:1746142912.792736:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2006:x1830962867427840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.792749:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.792766:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 54 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.792777:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 54 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.792797:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3dc00/0x2fa243e067ccd31c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2035712->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa4e expref: 54 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.792822:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.792824:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.792830:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.792842:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.794995:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142912.795010:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867829888:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142912.795409:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.797397:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867829888:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142912.797412:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.797440:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+53:2006:x1830962867427840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4704us (5072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.797449:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6478 00000100:00100000:0.0:1746142912.798489:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.798567:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428096 00000100:00100000:1.0:1746142912.798573:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428096 00002000:00100000:1.0:1746142912.798602:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009734e680 x1830962867428096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.798611:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e680 with x1830962867428096 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.798615:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734e680 00000100:00100000:1.0:1746142912.798640:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4455 00000100:00100000:1.0:1746142912.798646:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867428096:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.803705:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867428096:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5050us (5209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.803716:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4455 00002000:00100000:1.0:1746142912.803726:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009734e680 x1830962867428096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.803735:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e680 with x1830962867428096 ext(1048576->2097151) 00002000:00010000:1.0:1746142912.803741:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734e680 00000100:00100000:0.0:1746142912.808036:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.808126:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428224 00000100:00100000:3.0:1746142912.808133:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428224 00000100:00100000:3.0:1746142912.808171:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14326 00000100:00100000:3.0:1746142912.808175:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+24:32496:x1830962867428224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.808288:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.808301:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aafd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.808321:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 52 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.808339:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.808341:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142912.808346:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.808375:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 52 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.808386:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 52 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.808396:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830016:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.808474:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.809465:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830016:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.809481:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.809491:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07400, rc 0) 00000100:00100000:3.0:1746142912.809519:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:32496:x1830962867428224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1343us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.809525:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14326 00000100:00100000:0.0:1746142912.810303:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.810407:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428352 00000100:00100000:1.0:1746142912.810413:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428352 00002000:00100000:1.0:1746142912.810439:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2232319) req@ffff88009734e300 x1830962867428352/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.810447:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e300 with x1830962867428352 ext(2097152->2232319) 00010000:00010000:1.0:1746142912.810453:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 53 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.810463:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 53 pid: 11421 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.810469:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734e300 00000100:00100000:1.0:1746142912.810494:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1387 00000100:00100000:1.0:1746142912.810500:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+53:2005:x1830962867428352:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142912.814890:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2005:x1830962867428352:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4380us (4579us total) trans 21474841198 rc 0/0 00000100:00100000:1.0:1746142912.814924:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1387 00002000:00100000:1.0:1746142912.814935:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2232319) req@ffff88009734e300 x1830962867428352/t21474841198(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.814943:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734e300 with x1830962867428352 ext(2097152->2232319) 00010000:00010000:1.0:1746142912.814951:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 55 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.814964:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 55 pid: 11421 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.814970:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734e300 00000100:00100000:0.0:1746142912.817566:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.817654:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428480 00000100:00100000:2.0:1746142912.817661:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428480 00010000:00010000:2.0:1746142912.817719:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 55 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.817758:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6479 00000100:00100000:2.0:1746142912.817765:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2005:x1830962867428480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.817777:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142912.817791:0:7217:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142912 -> 1746142913 00010000:00010000:2.0:1746142912.817797:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 55 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.817807:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 55 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.817824:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd323 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->2232319) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa55 expref: 55 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.817852:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.817854:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.817861:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.817868:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.817920:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.817931:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867830144:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142912.818251:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069180 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.819693:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867830144:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142912.819709:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.819734:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2005:x1830962867428480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1970us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.819741:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6479 00000100:00100000:0.0:1746142912.822607:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.822727:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428736 00000100:00100000:1.0:1746142912.822737:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428736 00002000:00100000:1.0:1746142912.822770:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009734c700 x1830962867428736/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.822779:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c700 with x1830962867428736 ext(2097152->3145727) 00002000:00010000:1.0:1746142912.822783:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734c700 00000100:00100000:1.0:1746142912.823511:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4456 00000100:00100000:1.0:1746142912.823519:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867428736:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142912.830662:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867428736:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6781us (7698us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142912.830674:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4456 00002000:00100000:1.0:1746142912.830684:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009734c700 x1830962867428736/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/440 e 0 to 0 dl 1746142923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.830694:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c700 with x1830962867428736 ext(2097152->3145727) 00002000:00010000:1.0:1746142912.830699:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009734c700 00000100:00100000:0.0:1746142912.838682:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.838756:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428864 00000100:00100000:3.0:1746142912.838764:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428864 00000100:00100000:3.0:1746142912.838812:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14327 00000100:00100000:3.0:1746142912.838821:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867428864:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.838836:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.838853:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccd3d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab04 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.838928:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830272:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.838990:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00002000:00010000:3.0:1746142912.840636:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746142911 -> 1746142913 00000100:00100000:3.0:1746142912.840654:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830272:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.840674:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccd3d2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab04 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.840684:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccd3d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab04 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.840708:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07a00, rc 0) 00000100:00100000:3.0:1746142912.840749:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867428864:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1930us (2074us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.840756:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14327 00000100:00100000:0.0:1746142912.842757:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.842816:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867428992 00000100:00100000:3.0:1746142912.842822:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867428992 00000100:00100000:3.0:1746142912.842995:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14328 00000100:00100000:3.0:1746142912.843003:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867428992:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.843018:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.843032:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067ccd3d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab0b expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.843078:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830400:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.843159:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.845251:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830400:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.845276:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067ccd3d9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab0b expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.845286:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067ccd3d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab0b expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.845308:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06200, rc 0) 00000100:00100000:3.0:1746142912.845348:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867428992:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2345us (2597us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.845358:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14328 00000100:00100000:0.0:1746142912.847133:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.847193:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867429120 00000100:00100000:3.0:1746142912.847199:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867429120 00000100:00100000:3.0:1746142912.847238:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14329 00000100:00100000:3.0:1746142912.847244:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867429120:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142912.847256:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.847267:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd3e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab12 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.847307:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830528:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.847439:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.849319:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867830528:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.849362:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd3e0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab12 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.849374:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd3e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab12 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.849868:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07c00, rc 0) 00000100:00100000:3.0:1746142912.849936:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867429120:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2691us (2807us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.849944:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14329 00000100:00100000:0.0:1746142912.862538:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.862591:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867429248 00000100:00100000:1.0:1746142912.862606:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867429248 00000100:00100000:1.0:1746142912.862669:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14447 00000100:00100000:1.0:1746142912.862677:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+24:32499:x1830962867429248:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142912.862698:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.862712:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ec00/0x2fa243e067ccd3e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab19 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.862761:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862775:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862783:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862795:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862800:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862805:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862865:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.862876:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 66 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.862882:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.862888:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 5/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00000100:00080000:0.0:1746142912.862918:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746142912.862931:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 33 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.862968:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 33 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.862984:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867830656:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.863060:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 66 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.863067:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 66 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.863074:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867830784:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.863195:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.865262:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.865300:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.865592:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867830656:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.865601:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867830784:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.865610:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867429632 00000100:00100000:3.0:1746142912.865615:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867429632 00010000:00010000:1.0:1746142912.865617:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:3.0:1746142912.865639:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867429760 00000100:00100000:3.0:1746142912.865640:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867429760 00000100:00100000:3.0:1746142912.865655:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5268 00000100:00100000:3.0:1746142912.865661:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4850850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+34:16986:x1830962867429632:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142912.865680:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5269 00000100:00100000:2.0:1746142912.865686:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+67:8514:x1830962867429760:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746142912.865830:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4850850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+35:16986:x1830962867429632:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 168us (572us total) trans 8589936615 rc 0/0 00000100:00100000:3.0:1746142912.865836:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5268 00000100:00100000:2.0:1746142912.865891:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+68:8514:x1830962867429760:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 205us (590us total) trans 8589936614 rc 0/0 00000100:00100000:2.0:1746142912.865896:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5269 00000100:00100000:0.0:1746142912.867100:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.867169:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.867334:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867429888 00000100:00100000:2.0:1746142912.867339:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867429888 00010000:00010000:2.0:1746142912.867359:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 68 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.867376:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430016 00000100:00100000:2.0:1746142912.867378:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430016 00010000:00010000:2.0:1746142912.867385:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 35 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.867400:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6480 00000100:00100000:2.0:1746142912.867404:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+68:2006:x1830962867429888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.867412:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.867416:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 68 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.867424:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 68 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.867439:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a0400/0x2fa243e067ccd227 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a96e expref: 68 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.867449:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.867453:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.867460:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.867465:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.867469:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.867505:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+67:2006:x1830962867429888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.867511:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6480 00000100:00100000:2.0:1746142912.867522:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6481 00000100:00100000:2.0:1746142912.867527:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+35:2005:x1830962867430016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.867533:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.867536:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 35 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.867543:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 35 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.867553:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9a1c00/0x2fa243e067ccd243 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a97c expref: 35 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.867559:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.867562:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.867567:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.867573:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.867589:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.867603:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867430016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.867608:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6481 00010000:00010000:1.0:1746142912.867750:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867757:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:1.0:1746142912.867785:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00000004:00200000:1.0:1746142912.867789:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142912.867801:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867808:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867819:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867823:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867828:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867833:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867837:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471ea00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142912.867839:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867844:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867851:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142912.867853:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142912.867856:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867860:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccd3ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867872:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.867877:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.868332:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.868337:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142912.868339:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.868343:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.868350:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097f1ab00) 00010000:00010000:1.0:1746142912.868352:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142912.868354:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.868358:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccd3f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.868384:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ec00/0x2fa243e067ccd3e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.868393:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 25 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.868397:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.868693:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142912.868697:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471ee00, rc 0) 00000100:00100000:1.0:1746142912.869147:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+25:32499:x1830962867429248:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 6470us (6616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.869154:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14447 00000001:00080000:3.0:1746142912.871734:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936615 is committed 00000001:00080000:3.0:1746142912.871744:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936614 is committed 00000001:00080000:3.0:1746142912.871762:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936612 is committed 00010000:00010000:2.0:1746142912.871792:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142912.871800:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142912.871805:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142912.871810:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009710c200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142912.871814:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142912.871819:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142912.871830:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.871832:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142912.871834:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142912.871838:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710c200/0x2fa243e067ccc730 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142912.873433:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.873466:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.873478:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.873484:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430144 00000100:00100000:0.0:1746142912.873490:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.873492:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430144 00000100:00100000:0.0:1746142912.873512:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.874067:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.874450:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430272 00000100:00100000:2.0:1746142912.874454:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430272 00000100:00100000:2.0:1746142912.874475:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430400 00000100:00100000:2.0:1746142912.874477:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430400 00000100:00100000:2.0:1746142912.874517:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430528 00000100:00100000:3.0:1746142912.874519:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430656 00000100:00100000:2.0:1746142912.874519:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430528 00000100:00100000:3.0:1746142912.874522:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430656 00000100:00100000:2.0:1746142912.874532:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867430784 00000100:00100000:2.0:1746142912.874534:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867430784 00000100:00100000:3.0:1746142912.874537:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14330 00000100:00100000:3.0:1746142912.874543:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867430144:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:2.0:1746142912.874543:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14331 00000100:00100000:2.0:1746142912.874547:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867430272:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142912.874555:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.874555:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.874567:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067ccd403 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab20 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.874567:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3f800/0x2fa243e067ccd40a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab27 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.874603:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867831040:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142912.874604:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867830912:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142912.874659:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14332 00000100:00100000:0.0:1746142912.874665:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867430400:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1746142912.874668:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14333 00010000:00010000:0.0:1746142912.874671:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142912.874674:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867430528:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142912.874677:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab2e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.874679:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.874684:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab35 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.874686:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.874687:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.874691:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.874692:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.874694:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.874696:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.874706:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142912.874706:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.874714:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0200, rc 0) 00010000:00010000:0.0:1746142912.874714:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6400, rc 0) 00000100:00100000:2.0:1746142912.874821:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.874837:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14334 00000100:00100000:2.0:1746142912.874843:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867430656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142912.874849:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.874855:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab3c expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.874864:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.874865:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.874870:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.874877:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.874883:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3e600, rc 0) 00000100:00100000:2.0:1746142912.875448:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867430656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 604us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.875449:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.875454:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14334 00000100:00100000:3.0:1746142912.875462:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14335 00000100:00100000:3.0:1746142912.875467:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867430784:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142912.875473:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.875479:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab43 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.875488:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.875489:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.875495:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.875503:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.875509:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06400, rc 0) 00000100:00100000:1.0:1746142912.875511:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867430528:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 838us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.875516:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14333 00000100:00100000:3.0:1746142912.875520:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867430784:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 54us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.875524:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14335 00000100:00100000:0.0:1746142912.875777:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867430400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1112us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.875782:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14332 00000100:00100000:2.0:1746142912.877615:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867830912:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.877638:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3f800/0x2fa243e067ccd40a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab27 expref: 12 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.877648:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3f800/0x2fa243e067ccd40a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab27 expref: 12 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.877657:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3f800, rc 0) 00000100:00100000:2.0:1746142912.877687:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867430272:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3138us (4220us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.877693:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14331 00000100:00100000:3.0:1746142912.877776:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867831040:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.877790:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067ccd403 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab20 expref: 9 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.877798:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067ccd403 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab20 expref: 9 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.877808:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06800, rc 0) 00000100:00100000:3.0:1746142912.877823:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867430144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3280us (4396us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.877828:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14330 00000100:00100000:0.0:1746142912.880046:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.880736:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431040 00000100:00100000:1.0:1746142912.880743:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431040 00000100:00100000:1.0:1746142912.881384:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14448 00000100:00100000:1.0:1746142912.881392:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+7:32499:x1830962867431040:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142912.881409:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.881425:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1a00/0x2fa243e067ccd42d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab4a expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.881507:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.881520:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 8 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.881528:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.881553:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 8 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.881563:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 8 pid: 7232 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.881573:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867831168:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.881654:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.883981:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867831168:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.884001:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142912.884666:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.885082:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431168 00000100:00100000:2.0:1746142912.885088:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431168 00010000:00010000:2.0:1746142912.885115:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 9 pid: 7232 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.885138:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6482 00000100:00100000:2.0:1746142912.885143:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867431168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.885153:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.885157:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 9 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.885166:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 9 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.885183:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ee00/0x2fa243e067ccd3fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab19 expref: 9 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.885194:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.885198:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.885206:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.885215:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.885230:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.885259:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867431168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 116us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.885265:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6482 00010000:00010000:1.0:1746142912.885390:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.885397:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:1.0:1746142912.885410:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00010000:00010000:1.0:1746142912.885507:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1a00/0x2fa243e067ccd42d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.885521:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 8 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.885527:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.885529:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746142912.885531:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0600, rc 0) 00000100:00100000:1.0:1746142912.885556:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867431040:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4166us (5516us total) trans 8589936616 rc 0/0 00000100:00100000:1.0:1746142912.885562:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14448 00000100:00100000:0.0:1746142912.887851:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.888367:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431296 00000100:00100000:1.0:1746142912.888375:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431296 00000100:00100000:1.0:1746142912.888418:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14449 00000100:00100000:1.0:1746142912.888425:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867431296:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142912.888445:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.888459:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccd442 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab51 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.888524:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.888664:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.888670:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.888692:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.888700:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 9 pid: 7232 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.888709:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867831296:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.889587:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.891204:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867831296:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.891222:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142912.892173:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.892219:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431424 00000100:00100000:2.0:1746142912.892226:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431424 00010000:00010000:2.0:1746142912.892253:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 10 pid: 7232 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.892286:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6483 00000100:00100000:2.0:1746142912.892293:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867431424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.892303:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.892312:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 10 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.892332:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 10 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.892352:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd434 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab4a expref: 10 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.892363:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.892367:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.892378:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.892384:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142912.892412:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.892459:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867431424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.892465:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6483 00010000:00010000:1.0:1746142912.892503:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.892509:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:1.0:1746142912.892552:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00000004:00200000:1.0:1746142912.892555:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142912.892569:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.892594:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccd442 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab51 expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.892606:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab51 expref: 8 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.892612:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.892614:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142912.892617:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d1600, rc 0) 00000100:00100000:1.0:1746142912.893234:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867431296:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4807us (5388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.893240:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14449 00000100:00100000:0.0:1746142912.895754:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.895958:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431552 00000100:00100000:3.0:1746142912.895967:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431552 00000100:00100000:3.0:1746142912.896012:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14336 00000100:00100000:3.0:1746142912.896020:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867431552:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142912.896033:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.896048:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccd450 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab58 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.896091:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867831424:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142912.896161:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.897682:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.898831:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431680 00000100:00100000:2.0:1746142912.898839:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431680 00000100:00100000:2.0:1746142912.898885:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14337 00000100:00100000:2.0:1746142912.898892:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867431680:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142912.899197:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.899211:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3ea00/0x2fa243e067ccd457 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab5f expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.899254:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867831552:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142912.899343:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.900277:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867831424:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142912.900301:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccd450 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab58 expref: 9 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.900313:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07a00/0x2fa243e067ccd450 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab58 expref: 9 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.900631:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07a00, rc 0) 00000100:00100000:3.0:1746142912.900681:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867431552:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4660us (4931us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142912.900689:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14336 00000100:00100000:2.0:1746142912.904499:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867831552:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142912.904530:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3ea00/0x2fa243e067ccd457 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab5f expref: 12 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.904543:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3ea00/0x2fa243e067ccd457 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab5f expref: 12 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.904557:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3ea00, rc 0) 00000100:00100000:2.0:1746142912.904600:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867431680:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5708us (6921us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142912.904607:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14337 00000100:00100000:0.0:1746142912.908293:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.908446:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867431936 00000100:00100000:1.0:1746142912.908453:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867431936 00000100:00100000:1.0:1746142912.908508:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14450 00000100:00100000:1.0:1746142912.908515:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867431936:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142912.908531:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142912.908546:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccd45e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab66 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.908620:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccd465 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.908631:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccd465 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142912.908639:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccd465 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:1.0:1746142912.908648:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00010000:00010000:1.0:1746142912.908720:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccd45e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab66 expref: 11 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.908737:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccd465 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab66 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.908743:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.908746:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142912.908748:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0400, rc 0) 00000100:00100000:1.0:1746142912.908782:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:32499:x1830962867431936:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 268us (496us total) trans 8589936617 rc 0/0 00000100:00100000:1.0:1746142912.908787:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14450 00000100:00100000:0.0:1746142912.912059:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.912113:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.912426:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432192 00000100:00100000:2.0:1746142912.912433:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432192 00000100:00100000:2.0:1746142912.912495:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432064 00000100:00100000:2.0:1746142912.912511:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432064 00000100:00100000:2.0:1746142912.912544:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14338 00000100:00100000:2.0:1746142912.912566:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867432192:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142912.912622:0:9579:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.912649:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 31 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.912669:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142912.912670:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142912.912681:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.912720:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 31 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.912731:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 31 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.912771:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867831680:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.912891:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142912.913015:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14339 00000100:00100000:1.0:1746142912.913045:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867432064:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142912.913065:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.913074:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 53 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.913095:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142912.913096:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142912.913098:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.913121:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 53 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.913129:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 53 pid: 11943 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.913146:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867831808:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142912.913190:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142912.917342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.917524:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432448 00000100:00100000:3.0:1746142912.917532:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432448 00000100:00100000:3.0:1746142912.918118:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14340 00000100:00100000:3.0:1746142912.918126:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867432448:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142912.918158:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.918171:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.918177:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.918183:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.918185:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.918187:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.918211:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.918220:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 9 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746142912.918230:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867831936:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.918289:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.918297:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 24 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.918304:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867832064:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.918332:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.919940:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867831680:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.919960:0:9579:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.920786:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867831808:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142912.920798:0:12211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142912.923368:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.923635:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.923736:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432832 00000100:00100000:1.0:1746142912.923744:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432832 00002000:00100000:1.0:1746142912.923780:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1445887) req@ffff8800981cfb80 x1830962867432832/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.923795:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cfb80 with x1830962867432832 ext(1048576->1445887) 00010000:00010000:1.0:1746142912.923802:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.923813:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.923819:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800981cfb80 00000100:00100000:1.0:1746142912.923846:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1388 00000100:00100000:1.0:1746142912.923852:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:2004:x1830962867432832:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142912.924078:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.924111:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.924135:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.924439:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432704 00000100:00100000:2.0:1746142912.924443:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432704 00000100:00100000:2.0:1746142912.924467:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432320 00000100:00100000:2.0:1746142912.924469:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432320 00000100:00100000:2.0:1746142912.924478:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432576 00000100:00100000:2.0:1746142912.924479:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432576 00000100:00100000:2.0:1746142912.924491:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14341 00000100:00100000:2.0:1746142912.924496:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867432704:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142912.924517:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924529:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924536:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924541:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924550:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.924552:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.924554:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924575:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924583:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.924592:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867832192:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.924642:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924649:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 13 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.924655:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867832320:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.924674:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924680:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.924691:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867832448:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.924704:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b0690c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.924716:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14342 00000100:00100000:2.0:1746142912.924720:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867432320:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142912.924731:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924740:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 33 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924746:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924751:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 46 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924755:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.924756:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.924758:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924768:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 46 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924774:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 46 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.924780:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867832576:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.924797:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924804:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 13 pid: 12211 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.924810:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867832704:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.924823:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 33 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924830:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 33 pid: 9579 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.924836:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867832832:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.924845:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142912.924856:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14343 00000100:00100000:2.0:1746142912.924860:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867432576:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142912.924873:0:11943:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924881:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924891:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.924896:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924917:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 53 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924921:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142912.924922:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142912.924924:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 7/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924936:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 53 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924942:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 53 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.924949:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867832960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.924977:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.924984:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746142912.925241:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.925257:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433088 00000100:00100000:0.0:1746142912.925260:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433088 00010000:00010000:0.0:1746142912.925275:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 11 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:0.0:1746142912.925293:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6484 00000100:00100000:0.0:1746142912.925297:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867433088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142912.925303:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142912.925316:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 11 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:0.0:1746142912.925341:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 11 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.925397:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867432960 00000100:00100000:1.0:1746142912.925400:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867432960 00002000:00100000:1.0:1746142912.925416:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (36864->622591) req@ffff8800981cc000 x1830962867432960/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/0 e 0 to 0 dl 1746142923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.925423:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc000 with x1830962867432960 ext(36864->622591) 00010000:00010000:1.0:1746142912.925428:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 54 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.925435:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 54 pid: 11943 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.925440:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800981cc000 00000100:00100000:1.0:1746142912.925451:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1389 00000100:00100000:1.0:1746142912.925456:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2006:x1830962867432960:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142912.925581:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.925595:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433216 00000100:00100000:1.0:1746142912.925598:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433216 00010000:00010000:1.0:1746142912.925609:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.925623:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6485 00000100:00100000:1.0:1746142912.925627:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867433216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.925632:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142912.925678:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867831936:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.925687:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867832064:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142912.925956:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccd418 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab35 expref: 11 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.926052:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867833088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.926187:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 10 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.926194:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 10 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.926201:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867833216:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142912.926221:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 25 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.926229:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:2.0:1746142912.926235:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867833344:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142912.926247:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069600 going to sleep for 11 seconds 00010000:00010000:1.0:1746142912.927022:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.927031:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.927043:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07000/0x2fa243e067ccd3c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaf6 expref: 25 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.927055:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.927057:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.927060:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.927067:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.927081:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142912.927090:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.927097:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867433216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1469us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.927103:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6485 00010000:00010000:3.0:1746142912.927104:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927109:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927123:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927129:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927134:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927139:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc06a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142912.927142:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927148:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927156:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.927162:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06a00/0x2fa243e067ccd481 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.927201:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867432448:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 9075us (9865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.927206:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14340 00010000:00010000:0.0:1746142912.927411:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142912.927440:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867433088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2141us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.927445:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6484 00000100:00100000:3.0:1746142912.931978:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867832576:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.931990:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867832704:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.931998:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867832832:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.932019:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.932040:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867832960:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.932047:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867833088:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.932053:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867833216:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.932060:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867833344:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.932074:0:11943:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.932094:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867832192:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.932100:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867832320:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.932106:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867832448:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.932116:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.932372:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867432832:12345-192.168.204.50@tcp:4:cat.0 Request processed in 8519us (9008us total) trans 17179873937 rc 0/0 00000100:00100000:2.0:1746142912.932382:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1388 00002000:00100000:2.0:1746142912.932391:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1445887) req@ffff8800981cfb80 x1830962867432832/t17179873937(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142912.932398:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cfb80 with x1830962867432832 ext(1048576->1445887) 00010000:00010000:2.0:1746142912.932406:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 34 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:2.0:1746142912.932414:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 34 pid: 1397 timeout: 786 lvb_type: 0 00002000:00010000:2.0:1746142912.932419:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800981cfb80 00000100:00100000:0.0:1746142912.935106:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.937072:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.937131:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433344 00000100:00100000:2.0:1746142912.937138:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433344 00010000:00010000:2.0:1746142912.937174:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:2.0:1746142912.937199:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6486 00000100:00100000:2.0:1746142912.937206:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867433344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142912.937215:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142912.937232:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746142912.937241:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00010000:00010000:2.0:1746142912.937258:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067ccd426 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab43 expref: 14 pid: 1854 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.938093:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433600 00000100:00100000:1.0:1746142912.938097:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433600 00010000:00010000:1.0:1746142912.938110:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 14 pid: 12211 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.938127:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6487 00000100:00100000:1.0:1746142912.938131:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867433600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.938138:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.938145:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 14 pid: 12211 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.938151:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 14 pid: 12211 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.938162:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067ccd411 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab2e expref: 14 pid: 12211 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.938175:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.938206:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867433600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.938211:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6487 00000100:00100000:1.0:1746142912.938237:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.938290:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142912.939679:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.939717:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867433344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2509us (4615us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.939724:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6486 00000100:00100000:2.0:1746142912.940016:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867434240 00000100:00100000:2.0:1746142912.940021:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867434240 00000100:00100000:1.0:1746142912.940027:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433728 00000100:00100000:1.0:1746142912.940031:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433728 00010000:00010000:2.0:1746142912.940038:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 58 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940040:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 47 pid: 9579 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.940057:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6488 00000100:00100000:1.0:1746142912.940062:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2003:x1830962867433728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142912.940066:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6489 00010000:00010000:1.0:1746142912.940069:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142912.940072:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2006:x1830962867434240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142912.940078:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.940080:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 47 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.940087:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 58 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940088:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 47 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.940094:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 58 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940100:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d000/0x2fa243e067ccd2b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9e5 expref: 47 pid: 9579 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.940103:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c5400/0x2fa243e067ccd385 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aab7 expref: 58 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940109:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142912.940113:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142912.940123:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2006:x1830962867434240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 52us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.940123:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2003:x1830962867433728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 61us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.940128:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6488 00000100:00100000:3.0:1746142912.940175:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6489 00000100:00100000:1.0:1746142912.940177:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.940185:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867434112 00000100:00100000:3.0:1746142912.940188:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867434112 00010000:00010000:3.0:1746142912.940197:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 9 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.940197:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.940205:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433472 00000100:00100000:3.0:1746142912.940207:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6490 00000100:00100000:1.0:1746142912.940207:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433472 00000100:00100000:3.0:1746142912.940210:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867434112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.940214:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.940216:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.940222:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 9 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.940228:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6491 00010000:00010000:3.0:1746142912.940229:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 9 pid: 1853 timeout: 786 lvb_type: 1 00000100:00100000:1.0:1746142912.940232:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867433472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.940236:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.940239:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880088f3e600/0x2fa243e067ccd41f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab3c expref: 9 pid: 1853 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.940242:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:3.0:1746142912.940246:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142912.940249:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 786 lvb_type: 1 00010000:00010000:1.0:1746142912.940257:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d2a00/0x2fa243e067ccd33f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa71 expref: 46 pid: 1852 timeout: 786 lvb_type: 1 00000100:00100000:3.0:1746142912.940258:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867434112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 48us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.940263:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6490 00010000:00010000:1.0:1746142912.940264:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.940273:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867433472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 41us (76us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.940277:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6491 00000100:00100000:1.0:1746142912.940305:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.940318:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433984 00000100:00100000:3.0:1746142912.940332:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433984 00000100:00100000:1.0:1746142912.940334:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142912.940342:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.940360:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867433856 00000100:00100000:3.0:1746142912.940361:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867433856 00010000:00010000:3.0:1746142912.940369:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 34 pid: 9579 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.940380:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6492 00000100:00100000:3.0:1746142912.940384:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867433984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142912.940388:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6493 00010000:00010000:3.0:1746142912.940390:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.940396:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.940407:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.940417:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067ccd32a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa5c expref: 24 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:3.0:1746142912.940424:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.940435:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867433856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142912.940437:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867433984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.940441:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6492 00010000:00010000:1.0:1746142912.940442:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.940449:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 34 pid: 9579 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940461:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 34 pid: 9579 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940471:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3de00/0x2fa243e067ccd2ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a9de expref: 34 pid: 9579 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940478:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.940480:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.940483:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.940679:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.940699:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.940713:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+33:2006:x1830962867433856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 320us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.940718:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6493 00000100:00100000:1.0:1746142912.940754:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.940765:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867434368 00000100:00100000:1.0:1746142912.940767:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867434368 00010000:00010000:1.0:1746142912.940777:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.940791:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6494 00000100:00100000:1.0:1746142912.940795:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867434368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.940801:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.940808:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940814:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940823:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067ccd315 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aa47 expref: 33 pid: 11421 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.940830:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.940832:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.940834:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.940838:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.940861:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.940875:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867434368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.940880:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6494 00010000:00010000:2.0:1746142912.940884:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940892:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940919:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940925:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940932:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940937:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3fa00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142912.940941:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940948:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940961:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.940967:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3fa00/0x2fa243e067ccd488 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.941003:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867432704:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 16506us (17368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.941010:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14341 00000100:00100000:0.0:1746142912.941202:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.941214:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867434496 00000100:00100000:0.0:1746142912.941217:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867434496 00010000:00010000:0.0:1746142912.941229:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746142912.941241:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6495 00000100:00100000:0.0:1746142912.941244:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867434496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142912.941250:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142912.941258:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.941264:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.941273:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a89dc00/0x2fa243e067ccd3a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1445887) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aada expref: 32 pid: 1397 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.941813:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2006:x1830962867432960:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 16355us (17733us total) trans 21474841199 rc 0/0 00000100:00100000:1.0:1746142912.941819:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1389 00002000:00100000:1.0:1746142912.941826:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (36864->622591) req@ffff8800981cc000 x1830962867432960/t21474841199(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:63/0 lens 488/448 e 0 to 0 dl 1746142923 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142912.941840:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800981cc000 with x1830962867432960 ext(36864->622591) 00010000:00010000:1.0:1746142912.941845:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 55 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.941853:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 55 pid: 11943 timeout: 786 lvb_type: 0 00002000:00010000:1.0:1746142912.941858:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800981cc000 00000100:00100000:1.0:1746142912.941916:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.941925:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867434624 00000100:00100000:1.0:1746142912.941927:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867434624 00010000:00010000:1.0:1746142912.941936:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.941948:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6496 00000100:00100000:1.0:1746142912.941952:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867434624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.941957:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.941963:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.941969:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.941978:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07400/0x2fa243e067ccd3cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aafd expref: 23 pid: 1853 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.941990:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.941991:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.941993:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.941999:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.942010:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.942020:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867434624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 67us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.942024:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6496 00010000:00010000:3.0:1746142912.942196:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942203:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942216:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942221:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942226:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942231:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2b200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142912.942234:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942239:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942248:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942253:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2b200/0x2fa243e067ccd48f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.942283:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867432320:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 17562us (18170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.942289:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14342 00010000:00010000:3.0:1746142912.942306:0:11943:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942311:0:11943:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942331:0:11943:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942337:0:11943:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942341:0:11943:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942346:0:11943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2b800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142912.942348:0:11943:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942354:0:11943:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942362:0:11943:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.942367:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b800/0x2fa243e067ccd496 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.942393:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867432576:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 17533us (18257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.942399:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14343 00010000:00010000:0.0:1746142912.942562:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.942564:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.942567:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.942573:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.942587:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142912.942601:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867434496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1355us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.942607:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6495 00010000:00010000:3.0:1746142912.943122:0:9579:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943130:0:9579:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943142:0:9579:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943148:0:9579:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943154:0:9579:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943159:0:9579:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3e400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142912.943161:0:9579:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943167:0:9579:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943175:0:9579:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.943180:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e400/0x2fa243e067ccd473 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.943216:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867432192:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 30665us (31163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.943221:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14338 00000100:00100000:1.0:1746142912.946356:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.946449:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867434752 00000100:00100000:0.0:1746142912.946456:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867434752 00010000:00010000:0.0:1746142912.946482:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 55 pid: 11943 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746142912.946517:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6497 00000100:00100000:0.0:1746142912.946524:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2005:x1830962867434752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142912.946534:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142912.946550:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 55 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.946561:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 55 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.946578:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a89ca00/0x2fa243e067ccd3bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 36864->622591) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aaef expref: 55 pid: 11943 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.946590:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.946592:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142912.946595:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.946602:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142912.946619:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142912.946649:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:2005:x1830962867434752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.946655:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6497 00010000:00010000:1.0:1746142912.946784:0:12211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946792:0:12211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946805:0:12211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946811:0:12211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946818:0:12211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946829:0:12211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9d0600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142912.946832:0:12211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946838:0:12211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946848:0:12211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.946853:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccd47a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142912.946890:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962867432064:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 33869us (34783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.946910:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14339 00000100:00100000:0.0:1746142912.950749:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.950796:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867435008 00000100:00100000:3.0:1746142912.950804:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867435008 00000100:00100000:3.0:1746142912.950850:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14451 00000100:00100000:3.0:1746142912.950857:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32499:x1830962867435008:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1746142912.950895:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142912.950939:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd449 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab51 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.950953:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142912.950956:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142912.950975:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.950985:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.950991:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.950997:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951002:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951007:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951012:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951017:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 9/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.951039:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951052:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.951063:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833472:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.951566:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951574:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.951581:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833600:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.951622:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951629:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 28 pid: 7230 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.951636:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833728:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.951655:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951662:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 9 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.951668:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833856:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.951686:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951693:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 28 pid: 7232 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.951699:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833984:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142912.951716:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.951722:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 9 pid: 7231 timeout: 786 lvb_type: 0 00000100:00100000:3.0:1746142912.951729:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867834112:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.951740:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142912.954541:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833472:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142912.954542:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.954550:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833600:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142912.954577:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.954595:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867435264 00000100:00100000:0.0:1746142912.954599:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.954601:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867435264 00000100:00100000:0.0:1746142912.954625:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.954635:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867435520 00000100:00100000:2.0:1746142912.954637:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867435520 00000100:00100000:1.0:1746142912.954645:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867435648 00000100:00100000:0.0:1746142912.954645:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5270 00000100:00100000:1.0:1746142912.954649:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867435648 00000100:00100000:0.0:1746142912.954651:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:8514:x1830962867435264:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142912.954657:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5271 00000100:00100000:2.0:1746142912.954661:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:16986:x1830962867435520:12345-192.168.204.50@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746142912.954666:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 30 pid: 7230 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.954686:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867435776 00000100:00100000:1.0:1746142912.954688:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867435776 00010000:00010000:1.0:1746142912.954695:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 11 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.954706:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6498 00000100:00100000:1.0:1746142912.954711:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867435648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.954718:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.954723:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 30 pid: 7230 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.954731:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 31 pid: 7230 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.954746:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.954751:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142912.954758:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142912.954780:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:16986:x1830962867435520:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 119us (203us total) trans 8589936619 rc 0/0 00000100:00100000:0.0:1746142912.954780:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:8514:x1830962867435264:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 128us (243us total) trans 8589936618 rc 0/0 00000100:00100000:2.0:1746142912.954786:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5271 00000100:00100000:0.0:1746142912.954788:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5270 00000100:00100000:0.0:1746142912.954804:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6499 00000100:00100000:0.0:1746142912.954809:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867435776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142912.954815:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142912.954820:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 11 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.954828:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 11 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.954838:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142912.954840:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131323000/0x2fa243e067ccc737 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a244 expref: 30 pid: 7230 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.954842:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142912.954847:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142912.954853:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833728:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142912.954860:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867435776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142912.954864:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4d9200/0x2fa243e067ccc729 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a23d expref: 11 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746142912.954865:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6499 00000100:00100000:3.0:1746142912.954870:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833856:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.954879:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867833984:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142912.954885:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867834112:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142912.954897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.954924:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867435904 00010000:00010000:3.0:1746142912.954925:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142912.954927:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867435904 00010000:00010000:0.0:1746142912.954936:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 10 pid: 7231 timeout: 786 lvb_type: 0 00000100:00100000:0.0:1746142912.954960:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6500 00000100:00100000:0.0:1746142912.954965:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867435904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142912.954970:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142912.954974:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 10 pid: 7231 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.954981:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 10 pid: 7231 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.954991:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1200/0x2fa243e067ccc895 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a316 expref: 10 pid: 7231 timeout: 786 lvb_type: 0 00010000:00010000:0.0:1746142912.954998:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142912.955001:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142912.955005:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142912.955021:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867435904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.955022:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867435648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 308us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142912.955026:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6500 00000100:00100000:1.0:1746142912.955029:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6498 00000100:00100000:0.0:1746142912.955080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.955116:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436032 00000100:00100000:1.0:1746142912.955119:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436032 00010000:00010000:1.0:1746142912.955128:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 29 pid: 7232 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.955149:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6501 00000100:00100000:1.0:1746142912.955153:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867436032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.955159:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.955163:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 29 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.955169:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 29 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.955179:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccca63 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a420 expref: 29 pid: 7232 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.955187:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.955190:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142912.955194:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.955220:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867436032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.955224:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6501 00000100:00100000:0.0:1746142912.957293:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.957468:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436288 00000100:00100000:1.0:1746142912.957475:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436288 00010000:00010000:1.0:1746142912.957494:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.957524:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6502 00000100:00100000:1.0:1746142912.957530:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867436288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.957538:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.957543:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.957551:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.957564:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0a1000/0x2fa243e067ccceed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a706 expref: 28 pid: 10924 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.957579:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.957583:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142912.957588:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.957619:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867436288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.957624:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6502 00000100:00100000:0.0:1746142912.957668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.957926:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436160 00000100:00100000:1.0:1746142912.957930:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436160 00010000:00010000:1.0:1746142912.957941:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 786 lvb_type: 0 00000100:00100000:1.0:1746142912.957966:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6503 00000100:00100000:1.0:1746142912.957971:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867436160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142912.957977:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142912.957981:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.957988:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.957997:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ce34400/0x2fa243e067ccc817 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8a2c2 expref: 9 pid: 7231 timeout: 786 lvb_type: 0 00010000:00010000:1.0:1746142912.958005:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142912.958008:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142912.958014:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142912.958019:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142912.958040:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142912.958062:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867436160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 91us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.958068:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6503 00010000:00010000:3.0:1746142912.958074:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.958082:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000040:00080000:3.0:1746142912.958281:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].625, 88 off62712 00000004:00080000:3.0:1746142912.958288:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957387497ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958341:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].696, 88 off69056 00000004:00080000:3.0:1746142912.958347:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957446599ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958376:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].697, 88 off69144 00000004:00080000:3.0:1746142912.958379:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957479159ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958388:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].626, 88 off62800 00000004:00080000:3.0:1746142912.958390:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957490495ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958398:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].627, 88 off62888 00000004:00080000:3.0:1746142912.958400:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957500286ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958408:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].698, 88 off69232 00000004:00080000:3.0:1746142912.958410:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957510239ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958418:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].699, 88 off69320 00000004:00080000:3.0:1746142912.958420:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957519886ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958427:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].628, 88 off62976 00000004:00080000:3.0:1746142912.958429:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957529494ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958436:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].700, 88 off69408 00000004:00080000:3.0:1746142912.958439:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957539735ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958447:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].629, 88 off63064 00000004:00080000:3.0:1746142912.958449:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957549287ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958456:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].701, 88 off69496 00000004:00080000:3.0:1746142912.958459:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957559084ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958466:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].630, 88 off63152 00000004:00080000:3.0:1746142912.958468:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957568786ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958476:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].702, 88 off69584 00000004:00080000:3.0:1746142912.958478:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957578626ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958490:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].631, 88 off63240 00000004:00080000:3.0:1746142912.958492:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957592375ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142912.958592:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].703, 88 off69672 00000004:00080000:3.0:1746142912.958596:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957696537ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958627:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].704, 88 off69760 00000004:00080000:3.0:1746142912.958630:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686957730185ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142912.958639:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].632, 88 off63328 00000004:00080000:3.0:1746142912.958642:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 686957741897ns, next at 629431245375ns, rc = 0 00000001:00080000:2.0:1746142912.960319:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936620 is committed 00000004:00080000:2.0:1746142912.960339:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 621 committed 00000004:00080000:2.0:1746142912.960353:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 693 committed 00000004:00080000:2.0:1746142912.960362:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 692 committed 00000004:00080000:2.0:1746142912.960363:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 620 committed 00000004:00080000:2.0:1746142912.960364:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 691 committed 00000004:00080000:2.0:1746142912.960366:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 619 committed 00000004:00080000:2.0:1746142912.960367:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 690 committed 00000004:00080000:2.0:1746142912.960368:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 618 committed 00000004:00080000:2.0:1746142912.960369:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 689 committed 00000004:00080000:2.0:1746142912.960370:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 617 committed 00000004:00080000:2.0:1746142912.960372:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 688 committed 00000004:00080000:2.0:1746142912.960373:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 687 committed 00000004:00080000:2.0:1746142912.960375:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 616 committed 00000004:00080000:2.0:1746142912.960376:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 615 committed 00000004:00080000:2.0:1746142912.960378:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 686 committed 00000004:00080000:2.0:1746142912.960380:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 685 committed 00000004:00080000:2.0:1746142912.960381:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 614 committed 00000001:00080000:2.0:1746142912.960384:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936618 is committed 00000001:00080000:2.0:1746142912.960388:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936619 is committed 00000100:00100000:2.0:1746142912.960424:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142912.960468:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142912.960496:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834752:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746142912.960499:0:10924:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800981cea00 reply state ffff88009cf69800 transno 8589936620 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.960510:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142912.960512:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746142912.960515:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142912.960517:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746142912.960519:0:10924:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746142912.960523:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142912.960537:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142912.960548:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835776:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142912.960561:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746142912.960564:0:10924:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746142912.960572:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867435008:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 9716us (9830us total) trans 8589936620 rc 0/0 00000100:00100000:2.0:1746142912.960573:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746142912.960578:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.960580:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14451 00000100:00100000:1.0:1746142912.960586:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867834496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142912.960592:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142912.960602:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867834240 00000100:00100000:2.0:1746142912.960603:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.960605:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867834240 00000100:00100000:2.0:1746142912.960614:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746142912.960619:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746142912.960624:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835392:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142912.960631:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142912.960632:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867834752 00000100:00100000:3.0:1746142912.960633:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867834752 00000100:00100000:2.0:1746142912.960637:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.960639:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835264 00000100:00100000:3.0:1746142912.960640:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835264 00000100:00100000:2.0:1746142912.960644:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142912.960645:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835776 00000100:00100000:3.0:1746142912.960646:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867834368 00000100:00100000:3.0:1746142912.960647:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867834368 00000100:00100000:1.0:1746142912.960648:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835776 00000100:00080000:3.0:1746142912.960651:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746142912.960656:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142912.960657:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867834880 00000100:00100000:3.0:1746142912.960658:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867834880 00000100:00100000:1.0:1746142912.960660:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835392 00000100:00100000:1.0:1746142912.960662:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835392 00000100:00100000:3.0:1746142912.960663:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835904 00010000:00010000:2.0:1746142912.960663:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142912.960664:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835904 00010000:00010000:2.0:1746142912.960669:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142912.960670:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14344 00000100:00100000:3.0:1746142912.960673:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3762:x1830962867834240:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746142912.960674:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc07c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142912.960677:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142912.960684:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142912.960692:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142912.960694:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142912.960697:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142912.960701:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07c00/0x2fa243e067ccd49d lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142912.960705:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867834624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142912.960725:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142912.960751:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3762:x1830962867834240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (282us total) trans 17179873938 rc 0/0 00000100:00100000:0.0:1746142912.960912:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867835136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142912.960930:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142912.960939:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867835648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142912.960948:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142912.960985:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14345 00000100:00100000:2.0:1746142912.960991:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14346 00000100:00100000:1.0:1746142912.960991:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3762:x1830962867834752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.960997:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14344 00000100:00100000:2.0:1746142912.960999:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3762:x1830962867835264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.961007:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867834624 00000100:00100000:3.0:1746142912.961009:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867834624 00000100:00100000:3.0:1746142912.961016:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835136 00000100:00100000:3.0:1746142912.961017:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835136 00000100:00100000:3.0:1746142912.961022:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835648 00000100:00100000:3.0:1746142912.961023:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835648 00000100:00100000:3.0:1746142912.961029:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14347 00000100:00100000:3.0:1746142912.961033:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3762:x1830962867835776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.961044:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14348 00000100:00100000:3.0:1746142912.961047:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3762:x1830962867834880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142912.961051:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3762:x1830962867834752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (538us total) trans 17179873939 rc 0/0 00002000:00010000:2.0:1746142912.961054:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746142912.961057:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00000100:00100000:1.0:1746142912.961057:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14345 00002000:00010000:2.0:1746142912.961059:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142912.961061:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.961062:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:1.0:1746142912.961067:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14349 00000100:00100000:1.0:1746142912.961071:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3762:x1830962867835392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142912.961083:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3762:x1830962867835264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (544us total) trans 17179873940 rc 0/0 00000100:00100000:2.0:1746142912.961089:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14346 00000100:00100000:2.0:1746142912.961100:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14350 00000100:00100000:2.0:1746142912.961105:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867835904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.961110:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867834880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (494us total) trans 21474841200 rc 0/0 00000100:00100000:3.0:1746142912.961115:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14348 00000100:00100000:1.0:1746142912.961123:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830962867835392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (490us total) trans 21474841201 rc 0/0 00000100:00100000:3.0:1746142912.961125:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14351 00000100:00100000:3.0:1746142912.961129:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867834624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142912.961129:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14349 00000100:00100000:1.0:1746142912.961139:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14352 00000100:00100000:1.0:1746142912.961143:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867835136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142912.961147:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142912.961150:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.961151:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142912.961153:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.961154:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142912.961176:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867835904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (530us total) trans 21474841202 rc 0/0 00000100:00100000:3.0:1746142912.961177:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867834624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (451us total) trans 21474841203 rc 0/0 00000100:00100000:2.0:1746142912.961182:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14350 00000100:00100000:3.0:1746142912.961185:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14351 00000100:00100000:1.0:1746142912.961189:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867835136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (258us total) trans 21474841204 rc 0/0 00000100:00100000:2.0:1746142912.961193:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14353 00000100:00100000:1.0:1746142912.961196:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14352 00000100:00100000:2.0:1746142912.961198:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867835648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.961199:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14354 00000100:00100000:3.0:1746142912.961203:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3762:x1830962867834368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142912.961211:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142912.961222:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867835008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142912.961237:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142912.961244:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867835520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142912.961247:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809ce00/2, rc 0, transno 21474841200 00000100:00100000:3.0:1746142912.961250:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867834368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (657us total) trans 21474841205 rc 0/0 00000100:00100000:2.0:1746142912.961252:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.961255:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14354 00000100:00100000:1.0:1746142912.961256:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746142912.961258:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809e300/2, rc 0, transno 21474841201 00000100:00100000:2.0:1746142912.961261:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142912.961262:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867836032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.961263:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867834496 00000100:00100000:3.0:1746142912.961265:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867834496 00000004:00080000:2.0:1746142912.961265:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809dc00/2, rc 0, transno 21474841202 00000100:00100000:2.0:1746142912.961268:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142912.961272:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835008 00000100:00100000:3.0:1746142912.961274:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835008 00000004:00080000:2.0:1746142912.961274:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af3b80/2, rc 0, transno 17179873939 00000100:00100000:1.0:1746142912.961274:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142912.961279:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867835520 00000100:00100000:3.0:1746142912.961280:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867835520 00000100:00100000:2.0:1746142912.961281:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.961285:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836032 00000100:00100000:3.0:1746142912.961287:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836032 00000004:00080000:2.0:1746142912.961287:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1500/2, rc 0, transno 17179873940 00000100:00100000:2.0:1746142912.961289:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142912.961290:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14355 00000100:00100000:3.0:1746142912.961295:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14356 00000004:00080000:2.0:1746142912.961295:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1f80/2, rc 0, transno 17179873938 00000100:00100000:1.0:1746142912.961295:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867834496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142912.961297:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.961300:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867835008:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142912.961304:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809d500/2, rc 0, transno 21474841205 00000100:00100000:2.0:1746142912.961306:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867834368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142912.961346:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867836288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142912.961358:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3764:x1830962867834496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (146us total) trans 17179873941 rc 0/0 00002000:00010000:3.0:1746142912.961363:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746142912.961363:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14355 00000100:00100000:2.0:1746142912.961364:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746142912.961366:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142912.961367:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142912.961369:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142912.961371:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746142912.961371:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836288 00000100:00100000:1.0:1746142912.961374:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836288 00000100:00100000:2.0:1746142912.961382:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14357 00000100:00100000:1.0:1746142912.961385:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14358 00000100:00100000:3.0:1746142912.961388:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3764:x1830962867835008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (149us total) trans 17179873942 rc 0/0 00000100:00100000:2.0:1746142912.961388:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3764:x1830962867835520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142912.961389:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3764:x1830962867836032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142912.961393:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14356 00000100:00100000:3.0:1746142912.961403:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14359 00000100:00100000:3.0:1746142912.961407:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867836288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142912.961428:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:1.0:1746142912.961431:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142912.961432:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142912.961434:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142912.961435:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:2.0:1746142912.961453:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867835648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 254us (502us total) trans 21474841206 rc 0/0 00000100:00100000:1.0:1746142912.961455:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867836032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (181us total) trans 17179873943 rc 0/0 00000100:00100000:2.0:1746142912.961458:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14353 00000100:00100000:3.0:1746142912.961460:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3762:x1830962867836288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (95us total) trans 17179873945 rc 0/0 00000100:00100000:1.0:1746142912.961461:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14358 00000100:00100000:3.0:1746142912.961464:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14359 00000004:00080000:2.0:1746142912.961480:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de2a00/2, rc 0, transno 17179873945 00000100:00100000:2.0:1746142912.961483:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867836288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142912.961483:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af2d80/2, rc 0, transno 17179873941 00000100:00100000:1.0:1746142912.961487:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867834496:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142912.961493:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1180/2, rc 0, transno 17179873942 00000100:00100000:1.0:1746142912.961496:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867835008:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142912.961502:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00000004:00080000:1.0:1746142912.961502:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0700/2, rc 0, transno 17179873943 00000100:00100000:1.0:1746142912.961504:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867836032:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142912.961505:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142912.961506:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142912.961508:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142912.961509:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142912.961523:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3762:x1830962867835776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 489us (960us total) trans 17179873946 rc 0/0 00000100:00100000:3.0:1746142912.961527:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14347 00000100:00100000:2.0:1746142912.961536:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3764:x1830962867835520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (278us total) trans 17179873944 rc 0/0 00000004:00080000:1.0:1746142912.961539:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0a80/2, rc 0, transno 17179873944 00000100:00100000:2.0:1746142912.961541:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14357 00000100:00100000:1.0:1746142912.961542:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867835520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142912.961560:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af2680/2, rc 0, transno 17179873946 00000100:00100000:2.0:1746142912.961563:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867835776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142912.961574:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867836160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142912.961592:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142912.961617:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809f800/2, rc 0, transno 21474841203 00000100:00100000:0.0:1746142912.961621:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867834624:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142912.961626:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809c380/2, rc 0, transno 21474841204 00000100:00100000:0.0:1746142912.961629:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867835136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142912.961630:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836160 00000100:00100000:2.0:1746142912.961634:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836160 00000004:00080000:0.0:1746142912.961634:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809f480/2, rc 0, transno 21474841206 00000100:00100000:0.0:1746142912.961637:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867835648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142912.961653:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14360 00000100:00100000:2.0:1746142912.961656:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867836160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142912.961713:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867836160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (120us total) trans 21474841207 rc 0/0 00000100:00100000:2.0:1746142912.961718:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14360 00000004:00080000:1.0:1746142912.961974:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809fb80/2, rc 0, transno 21474841207 00000100:00100000:1.0:1746142912.961978:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867836160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142912.963675:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.963721:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436416 00000100:00100000:3.0:1746142912.963727:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436416 00000100:00100000:3.0:1746142912.963768:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14452 00000100:00100000:3.0:1746142912.963774:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32499:x1830962867436416:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142912.963790:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.963803:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab6d expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.963839:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.963852:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.963869:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142912.963872:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142912.963875:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a800, rc 0) 00000100:00100000:3.0:1746142912.963940:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867436416:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 165us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.963946:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14452 00000100:00100000:0.0:1746142912.965887:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.965967:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436544 00000100:00100000:3.0:1746142912.965973:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436544 00000100:00100000:3.0:1746142912.966004:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14453 00000100:00100000:3.0:1746142912.966011:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867436544:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142912.966023:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.966035:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab74 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.966100:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccd4b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.966109:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccd4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.966118:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccd4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142912.966142:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 16777217 00000004:00200000:3.0:1746142912.966146:0:10924:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142912.966158:0:10924:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccd4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142912.966177:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab74 expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.966189:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccd4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab74 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.966195:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142912.966197:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142912.966200:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b000, rc 0) 00000100:00100000:3.0:1746142912.966237:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32499:x1830962867436544:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 226us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.966241:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14453 00000100:00100000:0.0:1746142912.968835:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.968940:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436800 00000100:00100000:2.0:1746142912.968947:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436800 00000100:00100000:2.0:1746142912.968995:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14361 00000100:00100000:2.0:1746142912.969334:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867436800:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142912.969349:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.969366:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab82 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142912.969384:0:11421:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c1, atime: 0x681406c1, ctime: 0x681406c1, blocks: 0x808 00010000:00010000:2.0:1746142912.969398:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.969400:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.969407:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.969419:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.969428:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712ac00, rc 0) 00000100:00100000:0.0:1746142912.969439:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.969462:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867436800:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 458us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.969467:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14361 00000100:00100000:3.0:1746142912.969475:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437056 00000100:00100000:3.0:1746142912.969478:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437056 00000100:00100000:3.0:1746142912.969496:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14362 00000100:00100000:3.0:1746142912.969500:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962867437056:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142912.969507:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142912.969516:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab90 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142912.969528:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406c1, atime: 0x681406c1, ctime: 0x681406c1, blocks: 0x808 00010000:00010000:3.0:1746142912.969536:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.969537:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.969542:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 7 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.969551:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 7 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142912.969562:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2bc00, rc 0) 00000100:00100000:3.0:1746142912.969592:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867437056:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 91us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.969597:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14362 00000100:00100000:0.0:1746142912.971214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.971244:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.972377:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.972557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.972596:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437312 00000100:00100000:1.0:1746142912.972602:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437312 00000100:00100000:2.0:1746142912.972603:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436672 00000100:00100000:2.0:1746142912.972607:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436672 00000100:00100000:1.0:1746142912.972625:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867436928 00000100:00100000:1.0:1746142912.972627:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867436928 00000100:00100000:2.0:1746142912.972631:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14363 00000100:00100000:2.0:1746142912.972636:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867437312:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1746142912.972641:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14364 00010000:00010000:2.0:1746142912.972646:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142912.972646:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867436672:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142912.972654:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.972659:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab9e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.972663:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab7b expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142912.972675:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c1, atime: 0x681406c0, ctime: 0x681406c0, blocks: 0x1008 00002000:00010000:1.0:1746142912.972675:0:1852:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406c1, atime: 0x681406bf, ctime: 0x681406c1, blocks: 0x7f0 00010000:00010000:2.0:1746142912.972687:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.972689:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.972695:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.972705:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.972713:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800923f2a00, rc 0) 00000100:00100000:2.0:1746142912.972741:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867437312:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 104us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.972746:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14363 00000100:00100000:2.0:1746142912.972759:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14365 00000100:00100000:2.0:1746142912.972763:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867436928:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142912.972768:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.972776:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab89 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142912.972909:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c0, atime: 0x681406c0, ctime: 0x681406c0, blocks: 0x800 00010000:00010000:2.0:1746142912.972917:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.972918:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.972922:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.972930:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.972936:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb24400, rc 0) 00000100:00100000:2.0:1746142912.972953:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867436928:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 190us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.972957:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14365 00000100:00100000:2.0:1746142912.972965:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437184 00000100:00100000:2.0:1746142912.972967:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437184 00000100:00100000:2.0:1746142912.972978:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14366 00000100:00100000:2.0:1746142912.972982:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867437184:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142912.972987:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142912.972993:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ab97 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142912.973118:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.973121:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.973127:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.973137:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142912.973144:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d1600, rc 0) 00000100:00100000:1.0:1746142912.973164:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867436672:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 518us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.973170:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14364 00002000:00010000:2.0:1746142912.973438:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c1, atime: 0x681406c1, ctime: 0x681406c1, blocks: 0x16b0 00010000:00010000:2.0:1746142912.973447:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.973448:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.973452:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 9 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.973465:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 9 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142912.973471:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25200, rc 0) 00000100:00100000:2.0:1746142912.973498:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867437184:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 515us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.973503:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14366 00000100:00100000:0.0:1746142912.976680:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.978072:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.978100:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.978247:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.978522:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.978533:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437568 00000100:00100000:2.0:1746142912.978534:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437824 00000100:00100000:3.0:1746142912.978540:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437568 00000100:00100000:3.0:1746142912.978568:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438080 00000100:00100000:3.0:1746142912.978570:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438080 00000100:00100000:3.0:1746142912.978579:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437440 00000100:00100000:3.0:1746142912.978581:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437440 00000100:00100000:1.0:1746142912.978584:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14367 00000100:00100000:1.0:1746142912.978592:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867437568:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142912.978593:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14368 00000100:00100000:3.0:1746142912.978596:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867438080:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142912.978608:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14369 00000100:00100000:1.0:1746142912.978612:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867437440:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142912.978632:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437824 00000100:00100000:2.0:1746142912.978642:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437696 00000100:00100000:2.0:1746142912.978645:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437696 00000100:00100000:1.0:1746142912.978932:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867437440:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 318us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.978939:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14369 00000100:00100000:1.0:1746142912.978952:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14370 00000100:00100000:1.0:1746142912.978957:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867437696:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142912.979075:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867438080:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 477us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.979080:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14368 00000100:00100000:3.0:1746142912.979109:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14371 00000100:00100000:3.0:1746142912.979112:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867437824:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142912.979134:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867437824:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 21us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.979138:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14371 00000100:00100000:0.0:1746142912.979278:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142912.979682:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867437952 00000100:00100000:1.0:1746142912.979686:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867437952 00000100:00100000:1.0:1746142912.979704:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14372 00000100:00100000:1.0:1746142912.979708:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867437952:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142912.979742:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867437952:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.979750:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14372 00000100:00100000:1.0:1746142912.979816:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867437568:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 1225us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.979820:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14367 00000100:00100000:1.0:1746142912.979846:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867437696:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 888us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.979850:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14370 00000100:00100000:0.0:1746142912.982786:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.983271:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.983297:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.983310:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.983706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.983802:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142912.983820:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438208 00000100:00100000:3.0:1746142912.983827:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438208 00000100:00100000:2.0:1746142912.983840:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438464 00000100:00100000:1.0:1746142912.983841:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438720 00000100:00100000:2.0:1746142912.983843:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438464 00000100:00100000:1.0:1746142912.983845:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438720 00000100:00100000:1.0:1746142912.983867:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438336 00000100:00100000:1.0:1746142912.983869:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438336 00000100:00100000:2.0:1746142912.983896:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438592 00000100:00100000:1.0:1746142912.983913:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14373 00000100:00100000:2.0:1746142912.983915:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438592 00000100:00100000:1.0:1746142912.983920:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867438720:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142912.983938:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14374 00000100:00100000:2.0:1746142912.983944:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867438464:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142912.983996:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867438464:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 52us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.983996:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14375 00000100:00100000:2.0:1746142912.984001:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14374 00000100:00100000:1.0:1746142912.984001:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867438336:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142912.984013:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14376 00000100:00100000:2.0:1746142912.984017:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867438208:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142912.984034:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867438336:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.984039:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14375 00000100:00100000:2.0:1746142912.984044:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867438208:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 26us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142912.984049:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14376 00000100:00100000:1.0:1746142912.984053:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14377 00000100:00100000:1.0:1746142912.984057:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867438592:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142912.984083:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867438592:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.984087:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14377 00000100:00100000:1.0:1746142912.984114:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867438720:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 196us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142912.984120:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14373 00000100:00100000:3.0:1746142912.984498:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438848 00000100:00100000:3.0:1746142912.984501:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438848 00000100:00100000:3.0:1746142912.984516:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14378 00000100:00100000:3.0:1746142912.984521:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867438848:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142912.984589:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867438848:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 67us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142912.984594:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14378 00000100:00100000:0.0:1746142912.987569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.987623:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867438976 00000100:00100000:2.0:1746142912.987629:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867438976 00000100:00100000:2.0:1746142912.987663:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14379 00000100:00100000:2.0:1746142912.987669:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867438976:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:2.0:1746142912.988102:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142912.988105:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.988107:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:2.0:1746142912.988108:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.988110:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746142912.988192:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867438976:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 519us (624us total) trans 17179873947 rc 0/0 00000100:00100000:2.0:1746142912.988199:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14379 00000100:00100000:0.0:1746142912.989651:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.989700:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867439104 00000100:00100000:2.0:1746142912.989705:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867439104 00000100:00100000:2.0:1746142912.989736:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14380 00000100:00100000:2.0:1746142912.989742:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867439104:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:2.0:1746142912.989834:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142912.989837:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.989839:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142912.989841:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142912.989843:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142912.989877:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867439104:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 135us (227us total) trans 21474841208 rc 0/0 00000100:00100000:2.0:1746142912.989882:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14380 00000100:00100000:0.0:1746142912.995411:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.996086:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142912.996123:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142912.996187:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867439360 00000100:00100000:2.0:1746142912.996195:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867439360 00000100:00100000:1.0:1746142912.996197:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867439616 00000100:00100000:1.0:1746142912.996201:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867439616 00000100:00100000:3.0:1746142912.996226:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867439872 00000100:00100000:3.0:1746142912.996230:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867439872 00000100:00100000:1.0:1746142912.996250:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4457 00000100:00100000:1.0:1746142912.996256:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867439616:12345-192.168.204.50@tcp:3:lfs.0 00000100:00100000:2.0:1746142912.996277:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4458 00010000:00010000:1.0:1746142912.996282:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142912.996284:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867439360:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142912.996293:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.996294:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.996298:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.996299:0:20333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.996307:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142912.996308:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142912.996308:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.996311:0:20333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142912.996318:0:20333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142912.996888:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4459 00000100:00100000:3.0:1746142912.996895:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867439872:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142912.996925:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.996932:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.996933:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142912.996936:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142912.996943:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.000656:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.000719:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867440128 00000100:00100000:3.0:1746142913.000726:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867440128 00000100:00100000:3.0:1746142913.000767:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4460 00000100:00100000:3.0:1746142913.000774:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867440128:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142913.000799:0:20334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.000811:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.000813:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.000817:0:20334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.000827:0:20334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746142913.001512:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746142913.005238:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.005866:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.005882:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.005914:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867440384 00000100:00100000:2.0:1746142913.005922:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867440384 00000100:00100000:2.0:1746142913.005968:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867440640 00000100:00100000:2.0:1746142913.005970:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867440640 00000100:00100000:1.0:1746142913.005978:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867440896 00000100:00100000:1.0:1746142913.005982:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867440896 00000100:00100000:2.0:1746142913.005994:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4461 00000100:00100000:2.0:1746142913.006001:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867440384:12345-192.168.204.50@tcp:3:lfs.0 00000100:00100000:1.0:1746142913.006008:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4462 00000100:00100000:1.0:1746142913.006014:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867440640:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142913.006029:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.006029:0:9583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.006039:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.006039:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.006041:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.006041:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.006044:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.006044:0:9583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.006055:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.006058:0:9583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.006585:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4463 00000100:00100000:1.0:1746142913.006592:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+16:2003:x1830962867440896:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:1.0:1746142913.006606:0:13318:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746142913.006607:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746142913.006613:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.006614:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.006617:0:13318:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.006624:0:13318:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.009260:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142913.009418:0:20333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009428:0:20333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009436:0:20333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009442:0:20333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb24000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142913.009445:0:20333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009453:0:20333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009467:0:20333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009473:0:20333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccd4ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.009513:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867439360:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 13229us (14108us total) trans 0 rc 1036288/1036288 00000100:00100000:2.0:1746142913.009521:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4458 00000100:00100000:2.0:1746142913.009542:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867441152 00000100:00100000:2.0:1746142913.009547:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867441152 00000100:00100000:2.0:1746142913.009574:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4464 00000100:00100000:2.0:1746142913.009579:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962867441152:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142913.009600:0:20333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009608:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.009609:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.009614:0:20333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.009622:0:20333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015528:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015542:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015550:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015556:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9d1c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142913.015559:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015566:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015579:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.015585:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d1c00/0x2fa243e067ccd4e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.015652:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962867439616:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 19392us (19561us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142913.015661:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4457 00010000:00010000:0.0:1746142913.024130:0:20334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.024145:0:20334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.024153:0:20334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.024159:0:20334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2be00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142913.024162:0:20334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.024170:0:20334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.024185:0:20334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.024190:0:20334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2be00/0x2fa243e067ccd4f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142913.024251:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867440128:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 23474us (23599us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142913.024260:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4460 00010000:00010000:2.0:1746142913.024306:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.024314:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.024330:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.024335:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a2a200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142913.024338:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.024348:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.024359:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.024364:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067ccd4f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.024402:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2003:x1830962867439872:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 27508us (28277us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.024408:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4459 00010000:00010000:1.0:1746142913.030010:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.030027:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.030035:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.030041:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d76a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142913.030045:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.030052:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.030071:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.030076:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d76a00/0x2fa243e067ccd506 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.030463:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867440640:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 24444us (24592us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142913.030473:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4462 00010000:00010000:2.0:1746142913.035102:0:29472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.035116:0:29472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.035123:0:29472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.035129:0:29472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb24600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142913.035132:0:29472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.035138:0:29472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.035158:0:29472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.035163:0:29472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd4ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.035225:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867440384:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 29221us (29992us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.035234:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4461 00010000:00010000:1.0:1746142913.040755:0:13318:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.040843:0:13318:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.040852:0:13318:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.040858:0:13318:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009236a200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142913.040862:0:13318:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.040868:0:13318:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.040883:0:13318:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.040893:0:13318:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009236a200/0x2fa243e067ccd50d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.040983:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+10:2003:x1830962867440896:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 34387us (35095us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142913.040992:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4463 00010000:00010000:2.0:1746142913.041851:0:20333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.041860:0:20333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.041866:0:20333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.041871:0:20333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb25000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142913.041873:0:20333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.041879:0:20333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.041890:0:20333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.041926:0:20333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd514 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.041976:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962867441152:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 32394us (32722us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.041982:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4464 00000100:00100000:0.0:1746142913.046584:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.046646:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867441408 00000100:00100000:3.0:1746142913.046654:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867441408 00000100:00100000:3.0:1746142913.046704:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14454 00000100:00100000:3.0:1746142913.046711:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:32499:x1830962867441408:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1746142913.046748:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.046769:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2b000/0x2fa243e067ccd4b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab74 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.046794:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.046798:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142913.046831:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.046841:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.046848:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00010000:3.0:1746142913.046952:0:10924:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cd5c700 reply state ffff880089824000 transno 8589936621 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.046963:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.046968:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.046970:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746142913.046972:0:10924:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746142913.047032:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:32499:x1830962867441408:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 320us (453us total) trans 8589936621 rc 0/0 00000100:00100000:3.0:1746142913.047038:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14454 00000100:00100000:0.0:1746142913.050444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.050483:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.050510:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867441536 00000100:00100000:0.0:1746142913.050511:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.050517:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867441536 00000100:00100000:2.0:1746142913.050532:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867441664 00000100:00100000:2.0:1746142913.050537:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867441664 00000100:00100000:0.0:1746142913.050540:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.050551:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867441792 00000100:00100000:3.0:1746142913.050552:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867441792 00000100:00100000:3.0:1746142913.050561:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867441920 00000100:00100000:0.0:1746142913.050561:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.050563:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867441920 00000100:00100000:2.0:1746142913.050566:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867442048 00000100:00100000:2.0:1746142913.050569:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867442048 00000100:00100000:3.0:1746142913.050574:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14381 00000100:00100000:3.0:1746142913.050580:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867441536:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:2.0:1746142913.050588:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14382 00000100:00100000:0.0:1746142913.050590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.050593:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867441792:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:2.0:1746142913.050607:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867442176 00000100:00100000:2.0:1746142913.050609:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867442176 00000100:00100000:2.0:1746142913.050618:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14383 00002000:00010000:3.0:1746142913.050675:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746142913.050677:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:3.0:1746142913.050679:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142911 -> 1746142913 00002000:00010000:3.0:1746142913.050681:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:3.0:1746142913.050683:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:3.0:1746142913.050716:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867441536:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 135us (279us total) trans 21474841209 rc 0/0 00000100:00100000:2.0:1746142913.050724:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867441920:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:1.0:1746142913.050924:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14384 00000100:00100000:1.0:1746142913.050932:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867442048:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142913.050981:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:1.0:1746142913.050983:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.050985:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.050987:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.050988:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:1.0:1746142913.051007:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867442048:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 77us (445us total) trans 21474841210 rc 0/0 00000100:00100000:1.0:1746142913.051013:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14384 00000100:00100000:1.0:1746142913.051028:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14385 00000100:00100000:1.0:1746142913.051032:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867442176:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142913.051081:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142913.051083:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.051085:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142912 -> 1746142913 00002000:00010000:1.0:1746142913.051087:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142912 -> 1746142913 00002000:00010000:1.0:1746142913.051088:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746142913.051105:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867442176:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 73us (515us total) trans 17179873948 rc 0/0 00000100:00100000:1.0:1746142913.051110:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14385 00002000:00010000:2.0:1746142913.051186:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142913.051189:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.051190:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.051192:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.051193:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142913.051211:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867441920:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 489us (670us total) trans 21474841211 rc 0/0 00000100:00100000:2.0:1746142913.051216:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14383 00002000:00010000:2.0:1746142913.051266:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142913.051269:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142912 -> 1746142913 00002000:00010000:2.0:1746142913.051271:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142912 -> 1746142913 00002000:00010000:2.0:1746142913.051272:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142912 -> 1746142913 00002000:00010000:2.0:1746142913.051274:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746142913.051291:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867441792:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 698us (779us total) trans 17179873949 rc 0/0 00000100:00100000:2.0:1746142913.051296:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14382 00000100:00100000:2.0:1746142913.051331:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14386 00000100:00100000:2.0:1746142913.051337:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867441664:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:3.0:1746142913.051339:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14381 00002000:00010000:2.0:1746142913.051371:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142913.051373:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.051375:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.051376:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.051516:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142913.051539:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867441664:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 202us (1055us total) trans 17179873950 rc 0/0 00000100:00100000:2.0:1746142913.051544:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14386 00000100:00100000:0.0:1746142913.053516:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.053572:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867442432 00000100:00100000:3.0:1746142913.053579:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867442432 00000100:00100000:3.0:1746142913.054008:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5272 00000100:00100000:3.0:1746142913.054015:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32499:x1830962867442432:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:3.0:1746142913.054057:0:7234:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x55:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccd465 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab66 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.054096:0:7234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.054106:0:7234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.054111:0:7234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.054133:0:7234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.054142:0:7234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 10 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.054152:0:7234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7234:1830962867836416:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.054220:0:7234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.056191:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.056267:0:7234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7234:1830962867836416:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.056282:0:7234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 00000100:00100000:2.0:1746142913.056304:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867442560 00000100:00100000:2.0:1746142913.056310:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867442560 00010000:00010000:2.0:1746142913.056341:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 11 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.056373:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6504 00000100:00100000:2.0:1746142913.056380:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867442560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.056389:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.056393:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 11 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.056403:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 11 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.056418:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067ccd4a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab6d expref: 11 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.056440:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.056445:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 00010000:00010000:2.0:1746142913.056451:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 00010000:00010000:2.0:1746142913.056456:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7234 initiator: MDT0 00010000:00010000:2.0:1746142913.056471:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.056507:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867442560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 127us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.056513:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6504 00010000:00010000:3.0:1746142913.056833:0:7234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.056839:0:7234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 00000040:00080000:3.0:1746142913.057064:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].633, 88 off63416 00000004:00080000:3.0:1746142913.057071:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687056171019ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.057095:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].705, 88 off69848 00000004:00080000:3.0:1746142913.057099:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687056199146ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.057109:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].706, 88 off69936 00000004:00080000:3.0:1746142913.057112:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687056211907ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.057885:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].634, 88 off63504 00000004:00080000:3.0:1746142913.057891:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687056991216ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.057933:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].635, 88 off63592 00000004:00080000:3.0:1746142913.057937:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687057036916ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.057947:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].707, 88 off70024 00000004:00080000:3.0:1746142913.057949:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057049277ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.057966:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].708, 88 off70112 00000004:00080000:3.0:1746142913.057969:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057069189ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.057976:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].636, 88 off63680 00000004:00080000:3.0:1746142913.057978:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687057078554ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.057985:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].709, 88 off70200 00000004:00080000:3.0:1746142913.057987:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057087536ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.058003:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].637, 88 off63768 00000004:00080000:3.0:1746142913.058005:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687057105282ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.058012:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].710, 88 off70288 00000004:00080000:3.0:1746142913.058013:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057113689ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.058024:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].638, 88 off63856 00000004:00080000:3.0:1746142913.058026:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687057126296ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.058033:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].711, 88 off70376 00000004:00080000:3.0:1746142913.058036:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057136039ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.058046:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].639, 88 off63944 00000004:00080000:3.0:1746142913.058048:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687057147949ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142913.058057:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].712, 88 off70464 00000004:00080000:3.0:1746142913.058059:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057159230ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.058068:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].713, 88 off70552 00000004:00080000:3.0:1746142913.058070:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687057170440ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142913.058080:0:7234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].640, 88 off64032 00000004:00080000:3.0:1746142913.058083:0:7234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687057183499ns, next at 629431245375ns, rc = 0 00000001:00080000:2.0:1746142913.060160:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936622 is committed 00000004:00080000:2.0:1746142913.060171:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 629 committed 00000004:00080000:2.0:1746142913.060185:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 702 committed 00000004:00080000:2.0:1746142913.060201:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 701 committed 00000004:00080000:2.0:1746142913.060203:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 628 committed 00000004:00080000:2.0:1746142913.060204:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 700 committed 00000004:00080000:2.0:1746142913.060206:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 627 committed 00000004:00080000:2.0:1746142913.060207:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 699 committed 00000004:00080000:2.0:1746142913.060208:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 626 committed 00000004:00080000:2.0:1746142913.060210:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 698 committed 00000004:00080000:2.0:1746142913.060212:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 625 committed 00000004:00080000:2.0:1746142913.060213:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 697 committed 00000004:00080000:2.0:1746142913.060214:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 696 committed 00000004:00080000:2.0:1746142913.060215:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 624 committed 00000004:00080000:2.0:1746142913.060217:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 623 committed 00000004:00080000:2.0:1746142913.060218:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 695 committed 00000004:00080000:2.0:1746142913.060219:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 694 committed 00000004:00080000:2.0:1746142913.060221:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 622 committed 00000100:00100000:2.0:1746142913.060245:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746142913.060259:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867836544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.060298:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867837056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.060303:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.060330:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142913.060343:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867836928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.060353:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867836672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.060359:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.060370:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142913.060371:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867837440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.060382:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867837184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.060385:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.060396:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.060407:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746142913.060408:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836544 00000100:00100000:1.0:1746142913.060411:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867836800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.060413:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836544 00000100:00100000:1.0:1746142913.060424:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.060433:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867837312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.060438:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837056 00000100:00100000:2.0:1746142913.060440:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837056 00000100:00100000:1.0:1746142913.060443:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142913.060512:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142913.060557:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867837952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.060579:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142913.060605:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.060611:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.060616:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3c600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142913.060620:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.060626:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.060638:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142913.060640:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142913.060643:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.060648:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067ccd51b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00000100:00100000:3.0:1746142913.060958:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867838464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.060977:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142913.060993:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836928 00000100:00100000:1.0:1746142913.060994:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836672 00000100:00100000:2.0:1746142913.060997:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836928 00000100:00100000:1.0:1746142913.060998:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836672 00000100:00100000:2.0:1746142913.061010:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837440 00000100:00100000:2.0:1746142913.061012:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837440 00000100:00100000:1.0:1746142913.061013:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837184 00000100:00100000:1.0:1746142913.061015:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837184 00000100:00100000:2.0:1746142913.061020:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867836800 00000100:00100000:2.0:1746142913.061021:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867836800 00000100:00100000:1.0:1746142913.061022:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837312 00000100:00100000:1.0:1746142913.061023:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837312 00000100:00100000:2.0:1746142913.061029:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837952 00000100:00100000:2.0:1746142913.061031:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837952 00000100:00100000:2.0:1746142913.061040:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14387 00000100:00100000:2.0:1746142913.061045:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867836544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142913.061138:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142913.061141:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.061143:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.061145:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.061147:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142913.061169:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867836544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (866us total) trans 21474841212 rc 0/0 00000100:00100000:1.0:1746142913.061171:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14388 00000100:00100000:2.0:1746142913.061175:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14387 00000100:00100000:1.0:1746142913.061177:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867837056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.061187:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14389 00000100:00100000:2.0:1746142913.061191:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867836928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.061237:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867837056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (906us total) trans 21474841213 rc 0/0 00000100:00100000:1.0:1746142913.061242:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14388 00000100:00100000:1.0:1746142913.061252:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14390 00000100:00100000:1.0:1746142913.061257:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867836672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142913.061290:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142913.061293:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061295:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061297:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061298:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142913.061313:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867836672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (943us total) trans 21474841214 rc 0/0 00000100:00100000:1.0:1746142913.061330:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14390 00000100:00100000:1.0:1746142913.061339:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867838464 00000100:00100000:1.0:1746142913.061341:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867838464 00000004:00080000:3.0:1746142913.061342:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d62d80/2, rc 0, transno 21474841212 00000100:00100000:3.0:1746142913.061347:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867836544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.061350:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14391 00000100:00100000:3.0:1746142913.061353:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746142913.061353:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867837440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142913.061357:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867837568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.061371:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.061377:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867838080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.061386:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.061405:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867837440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (1019us total) trans 21474841215 rc 0/0 00000100:00100000:1.0:1746142913.061411:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14391 00000004:00010000:3.0:1746142913.061414:0:7234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800938ded80 reply state ffff88009ccb6800 transno 8589936622 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7234 initiator: MDT0 00000100:00100000:1.0:1746142913.061418:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837568 00000100:00100000:1.0:1746142913.061420:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837568 00010000:00010000:3.0:1746142913.061424:0:7234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 00000100:00100000:1.0:1746142913.061427:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867838080 00010000:00010000:3.0:1746142913.061429:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00000100:00100000:1.0:1746142913.061429:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867838080 00010000:00010000:3.0:1746142913.061431:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746142913.061434:0:7234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746142913.061436:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14392 00010000:00010000:3.0:1746142913.061438:0:7234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.061440:0:7234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1746142913.061440:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867837184:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746142913.061444:0:7234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccd465 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab66 expref: 7 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.061494:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867837184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1096us total) trans 21474841216 rc 0/0 00000100:00100000:1.0:1746142913.061499:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14392 00000100:00100000:1.0:1746142913.061507:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14393 00000100:00100000:1.0:1746142913.061511:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867836800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.061529:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14394 00000100:00100000:2.0:1746142913.061533:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3762:x1830962867837952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142913.061553:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:1.0:1746142913.061555:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061557:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061559:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061560:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00002000:00010000:2.0:1746142913.061573:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142913.061575:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00000100:00100000:1.0:1746142913.061576:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867836800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1151us total) trans 21474841218 rc 0/0 00002000:00010000:2.0:1746142913.061577:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:2.0:1746142913.061578:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.061580:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746142913.061581:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14393 00000100:00100000:1.0:1746142913.061589:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14395 00000100:00100000:1.0:1746142913.061593:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867837312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.061596:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3762:x1830962867837952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1016us total) trans 17179873951 rc 0/0 00000100:00100000:2.0:1746142913.061600:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14394 00000100:00100000:2.0:1746142913.061608:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14396 00000100:00100000:2.0:1746142913.061612:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3762:x1830962867838464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142913.061621:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142913.061624:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142913.061625:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142913.061627:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142913.061629:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00002000:00010000:2.0:1746142913.061641:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:2.0:1746142913.061643:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00000100:00100000:1.0:1746142913.061644:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867837312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (1199us total) trans 21474841219 rc 0/0 00002000:00010000:2.0:1746142913.061645:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142913.061647:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.061648:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142913.061649:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14395 00000100:00100000:1.0:1746142913.061657:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14397 00000100:00100000:1.0:1746142913.061661:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3762:x1830962867837568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.061665:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3762:x1830962867838464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (687us total) trans 17179873952 rc 0/0 00000100:00100000:2.0:1746142913.061669:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14396 00000100:00100000:2.0:1746142913.061679:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14398 00000100:00100000:2.0:1746142913.061684:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3762:x1830962867838080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142913.061693:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142913.061695:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061696:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061698:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.061700:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142913.061715:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3762:x1830962867837568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (343us total) trans 17179873953 rc 0/0 00002000:00010000:2.0:1746142913.061718:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746142913.061720:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00000100:00100000:1.0:1746142913.061720:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14397 00002000:00010000:2.0:1746142913.061722:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142913.061724:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.061725:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:1.0:1746142913.061732:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867837824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.061742:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3762:x1830962867838080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (354us total) trans 17179873954 rc 0/0 00000100:00100000:2.0:1746142913.061746:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14398 00000100:00100000:1.0:1746142913.061748:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.061775:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867838336:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746142913.061778:0:7234:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746142913.061787:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.061788:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:32499:x1830962867442432:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 7774us (8276us total) trans 8589936622 rc 0/0 00000100:00100000:3.0:1746142913.061795:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5272 00010000:00010000:3.0:1746142913.061812:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.061817:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.061821:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.061825:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3de00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.061828:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.061832:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.061839:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.061841:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142913.061842:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 00010000:00010000:3.0:1746142913.061852:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067ccd522 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7234 initiator: MDT0 00000004:00080000:3.0:1746142913.061877:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0380/2, rc 0, transno 17179873953 00000100:00100000:3.0:1746142913.061886:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867837568:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142913.061893:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1880/2, rc 0, transno 17179873954 00000100:00100000:3.0:1746142913.061895:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867838080:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142913.061918:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af3480/2, rc 0, transno 17179873951 00000100:00100000:3.0:1746142913.061925:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867837952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142913.061932:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0e00/2, rc 0, transno 17179873952 00000100:00100000:3.0:1746142913.061934:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867838464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142913.061941:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d60a80/2, rc 0, transno 21474841215 00000100:00100000:3.0:1746142913.061943:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867837440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142913.061979:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746142913.061988:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867838592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.062042:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837824 00000100:00100000:2.0:1746142913.062066:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837824 00000100:00100000:1.0:1746142913.062069:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746142913.062075:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867837696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.062076:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867838336 00000100:00100000:2.0:1746142913.062077:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867838336 00000100:00100000:2.0:1746142913.062083:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14399 00000100:00100000:2.0:1746142913.062086:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3765:x1830962867837824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.062091:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.062097:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867838208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.062108:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746142913.062118:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142913.062120:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.062122:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.062124:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:2.0:1746142913.062125:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000004:00080000:1.0:1746142913.062128:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d62680/2, rc 0, transno 21474841213 00000100:00100000:1.0:1746142913.062132:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867837056:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142913.062144:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61180/2, rc 0, transno 21474841218 00000100:00100000:2.0:1746142913.062145:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3765:x1830962867837824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (397us total) trans 17179873955 rc 0/0 00000100:00100000:1.0:1746142913.062146:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867836800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.062149:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14399 00000004:00080000:1.0:1746142913.062152:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61f80/2, rc 0, transno 21474841219 00000100:00100000:1.0:1746142913.062155:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867837312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.062156:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867837696 00000100:00100000:2.0:1746142913.062158:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867837696 00000004:00080000:1.0:1746142913.062160:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d60e00/2, rc 0, transno 21474841214 00000100:00100000:2.0:1746142913.062163:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867838208 00000100:00100000:1.0:1746142913.062163:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867836672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.062164:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867838208 00000004:00080000:1.0:1746142913.062168:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d61c00/2, rc 0, transno 21474841216 00000100:00100000:2.0:1746142913.062170:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14400 00000100:00100000:1.0:1746142913.062170:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867837184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.062173:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867838336:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142913.062180:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af3100/2, rc 0, transno 17179873955 00000100:00100000:1.0:1746142913.062183:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867837824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.062198:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14401 00000100:00100000:1.0:1746142913.062203:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867837696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.062211:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867838336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (423us total) trans 17179873956 rc 0/0 00000100:00100000:2.0:1746142913.062216:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14400 00000100:00100000:2.0:1746142913.062222:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14402 00000100:00100000:2.0:1746142913.062226:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867838208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142913.062241:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142913.062243:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.062245:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.062246:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.062248:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746142913.062252:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142913.062253:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142913.062255:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142913.062256:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142913.062258:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:1.0:1746142913.062265:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3765:x1830962867837696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (173us total) trans 17179873957 rc 0/0 00000100:00100000:1.0:1746142913.062270:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14401 00000100:00100000:2.0:1746142913.062271:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3765:x1830962867838208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (163us total) trans 17179873958 rc 0/0 00000100:00100000:2.0:1746142913.062275:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14402 00000004:00080000:1.0:1746142913.062289:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af3800/2, rc 0, transno 17179873957 00000100:00100000:1.0:1746142913.062292:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867837696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142913.062299:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0000/2, rc 0, transno 17179873958 00000100:00100000:1.0:1746142913.062301:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867838208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.062303:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867836928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1113us (1943us total) trans 21474841217 rc 0/0 00000004:00080000:1.0:1746142913.062306:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af2a00/2, rc 0, transno 17179873956 00000100:00100000:2.0:1746142913.062307:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14389 00000100:00100000:1.0:1746142913.062308:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867838336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.062403:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746142913.062433:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d62a00/2, rc 0, transno 21474841217 00000100:00100000:3.0:1746142913.062436:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867836928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142913.062446:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867838592 00000100:00100000:3.0:1746142913.062448:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867838592 00000100:00100000:3.0:1746142913.062463:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14403 00000100:00100000:3.0:1746142913.062467:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3762:x1830962867838592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.062531:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3762:x1830962867838592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (127us total) trans 17179873959 rc 0/0 00000100:00100000:3.0:1746142913.062536:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14403 00000004:00080000:0.0:1746142913.062553:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c7100/2, rc 0, transno 17179873959 00000100:00100000:0.0:1746142913.062557:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867838592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142913.064363:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.064406:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867442688 00000100:00100000:3.0:1746142913.064411:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867442688 00000100:00100000:3.0:1746142913.064443:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14455 00000100:00100000:3.0:1746142913.064447:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+6:32499:x1830962867442688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142913.064459:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.064470:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aba5 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.064502:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.064509:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.064519:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.064521:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142913.064522:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130c00, rc 0) 00000100:00100000:3.0:1746142913.064553:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:32499:x1830962867442688:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.064557:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14455 00000100:00100000:0.0:1746142913.066432:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.066642:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867442944 00000100:00100000:3.0:1746142913.066648:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867442944 00000100:00100000:3.0:1746142913.066674:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5273 00000100:00100000:3.0:1746142913.066680:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4850450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:32499:x1830962867442944:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1746142913.066829:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4850450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:32499:x1830962867442944:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 148us (400us total) trans 8589936623 rc 0/0 00000100:00100000:3.0:1746142913.066835:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5273 00000100:00100000:0.0:1746142913.083735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.083942:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867443200 00000100:00100000:3.0:1746142913.083950:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867443200 00000100:00100000:3.0:1746142913.084016:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14456 00000100:00080000:0.0:1746142913.084022:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142913.084024:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+7:32510:x1830962867443200:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.084043:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.084058:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067ccd530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abac expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.084112:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084121:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084130:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084140:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084145:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084150:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084230:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccd545 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084237:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccd545 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084243:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccd545 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142913.084254:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.084308:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084314:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084332:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084337:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084341:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096131c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.084344:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084349:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084358:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142913.084360:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.084363:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084367:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131c00/0x2fa243e067ccd537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084399:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084404:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084411:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084415:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096130000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.084417:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084421:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084426:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462800) 00010000:00010000:3.0:1746142913.084428:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.084430:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084434:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd53e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.084462:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067ccd530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abac expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.084471:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccd545 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abac expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.084476:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.084478:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142913.084479:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82400, rc 0) 00000100:00100000:3.0:1746142913.084522:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:32510:x1830962867443200:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 499us (795us total) trans 8589936624 rc 0/0 00000100:00100000:3.0:1746142913.084528:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14456 00000100:00100000:0.0:1746142913.085964:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.086076:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867443456 00000100:00100000:3.0:1746142913.086082:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867443456 00000100:00100000:3.0:1746142913.086129:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14457 00000100:00100000:3.0:1746142913.086136:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32509:x1830962867443456:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.086152:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.086162:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abb3 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746142913.086166:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746142913.086206:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086215:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086222:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086231:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086236:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086241:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086301:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086308:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086314:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142913.086336:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.086383:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086393:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086397:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086401:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086405:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.086408:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086413:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086421:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142913.086423:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.086426:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086430:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd55a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086438:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086442:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086451:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086454:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.086456:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086459:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086464:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462a00) 00010000:00010000:3.0:1746142913.086466:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.086468:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086472:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd561 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.086497:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.086507:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.086512:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.086514:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142913.086516:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82000, rc 0) 00000100:00100000:3.0:1746142913.086562:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32509:x1830962867443456:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 426us (602us total) trans 8589936625 rc 0/0 00000100:00100000:3.0:1746142913.086567:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14457 00000100:00100000:0.0:1746142913.087136:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.087546:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867443712 00000100:00100000:3.0:1746142913.087551:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867443712 00000100:00100000:3.0:1746142913.087774:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14458 00000100:00100000:3.0:1746142913.087781:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:32512:x1830962867443712:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.087793:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.087802:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccd576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abba expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.087845:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067ccd57d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.088333:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067ccd57d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.088340:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067ccd57d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142913.088349:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.088408:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccd576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abba expref: 12 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.088726:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067ccd57d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abba expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.088733:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.088736:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142913.088738:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130200, rc 0) 00000100:00100000:3.0:1746142913.088960:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:32512:x1830962867443712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1178us (1823us total) trans 8589936626 rc 0/0 00000100:00100000:3.0:1746142913.088965:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14458 00000100:00100000:0.0:1746142913.092291:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.092398:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867443968 00000100:00100000:3.0:1746142913.092406:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867443968 00000100:00100000:3.0:1746142913.092444:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14459 00000100:00100000:3.0:1746142913.092451:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32513:x1830962867443968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.092472:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.092487:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067ccd58b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abc1 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.092563:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.092574:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.092583:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142913.092590:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.092666:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4c000/0x2fa243e067ccd58b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 31 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.092678:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 30 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.092685:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.092687:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142913.092690:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea4d200, rc 0) 00000100:00100000:3.0:1746142913.093518:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32513:x1830962867443968:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1064us (1230us total) trans 8589936627 rc 0/0 00000100:00100000:3.0:1746142913.093525:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14459 00000100:00100000:1.0:1746142913.094009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.094096:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867444096 00000100:00100000:3.0:1746142913.094101:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867444096 00000100:00100000:3.0:1746142913.094140:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14404 00000100:00100000:3.0:1746142913.094144:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:32512:x1830962867444096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.094153:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.094162:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abc8 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.094175:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.094176:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.094181:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.094188:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.094193:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83400, rc 0) 00000100:00080000:0.0:1746142913.094230:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746142913.094275:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:32512:x1830962867444096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 128us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.094280:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14404 00000100:00100000:0.0:1746142913.095576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.096432:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867444224 00000100:00100000:3.0:1746142913.096441:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867444224 00000100:00100000:2.0:1746142913.097134:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14405 00000100:00100000:2.0:1746142913.097141:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32513:x1830962867444224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.097155:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.097268:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abcf expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746142913.097287:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746142913.097288:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.097289:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.097296:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 55 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.097307:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 55 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.097314:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131e00, rc 0) 00000100:00100000:2.0:1746142913.097367:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:32513:x1830962867444224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 227us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.097373:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14405 00000100:00100000:0.0:1746142913.100800:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.100895:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867444480 00000100:00100000:2.0:1746142913.100926:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867444480 00002000:00100000:2.0:1746142913.100962:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938dc000 x1830962867444480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.100970:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc000 with x1830962867444480 ext(0->1048575) 00002000:00010000:2.0:1746142913.100975:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dc000 00000100:00100000:2.0:1746142913.101003:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4465 00000100:00100000:2.0:1746142913.101011:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867444480:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.105294:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.105829:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867444736 00000100:00100000:1.0:1746142913.105837:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867444736 00002000:00100000:1.0:1746142913.105875:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938de680 x1830962867444736/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.105883:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830962867444736 ext(0->1048575) 00002000:00010000:1.0:1746142913.105887:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:1.0:1746142913.105928:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4466 00000100:00100000:1.0:1746142913.105935:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2004:x1830962867444736:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.111072:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867444480:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10053us (10270us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.111086:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4465 00002000:00100000:2.0:1746142913.111096:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938dc000 x1830962867444480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.111105:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc000 with x1830962867444480 ext(0->1048575) 00002000:00010000:2.0:1746142913.111110:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938dc000 00010000:00010000:3.0:1746142913.114291:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746142913.114550:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:2004:x1830962867444736:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8611us (9258us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.114558:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4466 00002000:00100000:2.0:1746142913.114567:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938de680 x1830962867444736/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.114575:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938de680 with x1830962867444736 ext(0->1048575) 00002000:00010000:2.0:1746142913.114579:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938de680 00000100:00100000:0.0:1746142913.123088:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.123153:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.123259:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867444864 00000100:00100000:2.0:1746142913.123267:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867444864 00000100:00100000:2.0:1746142913.123311:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867444992 00000100:00100000:2.0:1746142913.123313:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867444992 00000100:00100000:2.0:1746142913.123357:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14406 00000100:00100000:2.0:1746142913.123365:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+31:32512:x1830962867444864:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.123380:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142913.123395:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14407 00010000:00010000:2.0:1746142913.123396:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abd6 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.123403:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32513:x1830962867444992:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.123411:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.123416:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.123417:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abdd expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.123418:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.123424:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 32 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.123435:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.123436:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.123440:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.123796:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 32 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.123807:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e800, rc 0) 00000100:00080000:0.0:1746142913.123931:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746142913.124057:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 46 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.124066:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:3.0:1746142913.124107:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32513:x1830962867444992:12345-192.168.204.50@tcp:101:cat.0 Request processed in 706us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.124114:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14407 00000100:00100000:2.0:1746142913.124116:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:32512:x1830962867444864:12345-192.168.204.50@tcp:101:cat.0 Request processed in 752us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.124122:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14406 00000100:00100000:0.0:1746142913.127040:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.127180:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867445248 00000100:00100000:2.0:1746142913.127188:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867445248 00002000:00100000:2.0:1746142913.127225:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800938dc700 x1830962867445248/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.127233:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc700 with x1830962867445248 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.127237:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dc700 00000100:00100000:2.0:1746142913.127265:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4467 00000100:00100000:2.0:1746142913.127272:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962867445248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.131227:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.131385:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867445504 00000100:00100000:2.0:1746142913.131393:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867445504 00002000:00100000:2.0:1746142913.131429:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800938ded80 x1830962867445504/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.131437:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938ded80 with x1830962867445504 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.131442:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938ded80 00000100:00100000:0.0:1746142913.132170:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4468 00000100:00100000:0.0:1746142913.132179:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867445504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.139978:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962867445248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12697us (12936us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.139987:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4467 00002000:00100000:2.0:1746142913.139998:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800938dc700 x1830962867445248/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.140006:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938dc700 with x1830962867445248 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.140011:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938dc700 00000100:00100000:2.0:1746142913.145255:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867445504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13070us (14027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.145265:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4468 00002000:00100000:2.0:1746142913.145274:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800938ded80 x1830962867445504/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.145282:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938ded80 with x1830962867445504 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.145287:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800938ded80 00000100:00100000:0.0:1746142913.151184:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.154017:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867445632 00000100:00100000:2.0:1746142913.154030:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867445632 00000100:00100000:2.0:1746142913.154101:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14408 00000100:00100000:2.0:1746142913.154111:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32513:x1830962867445632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.154129:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.154981:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abe4 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.155005:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.155007:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.155014:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 47 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.155028:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 47 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.155044:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25000, rc 0) 00000100:00100000:2.0:1746142913.155350:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32513:x1830962867445632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1239us (4170us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.155357:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14408 00000100:00100000:0.0:1746142913.158475:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.158685:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867445760 00000100:00100000:2.0:1746142913.158694:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867445760 00000100:00100000:2.0:1746142913.158760:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14409 00000100:00100000:2.0:1746142913.158769:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:32512:x1830962867445760:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.158786:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.158802:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abeb expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.158825:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.158827:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.158835:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.158849:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.158860:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25e00, rc 0) 00000100:00100000:2.0:1746142913.158942:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+33:32512:x1830962867445760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 172us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.158949:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14409 00000100:00100000:0.0:1746142913.160645:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.160753:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867446016 00000100:00100000:2.0:1746142913.160761:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867446016 00002000:00100000:2.0:1746142913.160796:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800949d2300 x1830962867446016/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.160806:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d2300 with x1830962867446016 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.160810:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d2300 00000100:00100000:2.0:1746142913.160833:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4469 00000100:00100000:2.0:1746142913.160841:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867446016:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.166210:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.166424:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867446272 00000100:00100000:2.0:1746142913.166431:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867446272 00002000:00100000:2.0:1746142913.166466:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800949d3b80 x1830962867446272/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.166474:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3b80 with x1830962867446272 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.166478:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d3b80 00000100:00100000:2.0:1746142913.166496:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4470 00000100:00100000:2.0:1746142913.166503:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867446272:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.173576:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867446016:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12729us (12929us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.173586:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4469 00002000:00100000:2.0:1746142913.173596:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800949d2300 x1830962867446016/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.173605:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d2300 with x1830962867446016 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.173610:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d2300 00000100:00100000:3.0:1746142913.179641:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867446272:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13131us (13431us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142913.179654:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4470 00002000:00100000:3.0:1746142913.179664:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800949d3b80 x1830962867446272/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.179673:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3b80 with x1830962867446272 ext(1048576->2097151) 00002000:00010000:3.0:1746142913.179678:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d3b80 00000100:00100000:0.0:1746142913.186412:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.186456:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.186495:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867446400 00000100:00100000:2.0:1746142913.186504:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867446400 00000100:00100000:3.0:1746142913.186532:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867446528 00000100:00100000:3.0:1746142913.186536:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867446528 00000100:00100000:2.0:1746142913.186564:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14410 00000100:00100000:2.0:1746142913.186572:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:32512:x1830962867446400:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.186588:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.186602:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abf2 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.186627:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.186629:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.186635:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 24 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.186696:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 24 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.186707:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb24600, rc 0) 00000100:00100000:3.0:1746142913.186737:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14411 00000100:00100000:3.0:1746142913.186744:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+55:32513:x1830962867446528:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:2.0:1746142913.186788:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:32512:x1830962867446400:12345-192.168.204.50@tcp:101:cat.0 Request processed in 217us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.186794:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14410 00010000:00010000:3.0:1746142913.187029:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.187037:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8abf9 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.187049:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.187050:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.187055:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 56 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.187064:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 56 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.187071:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82e00, rc 0) 00000100:00100000:3.0:1746142913.187139:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32513:x1830962867446528:12345-192.168.204.50@tcp:101:cat.0 Request processed in 395us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.187144:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14411 00000100:00100000:0.0:1746142913.190009:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.190173:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867446784 00000100:00100000:3.0:1746142913.190180:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867446784 00002000:00100000:3.0:1746142913.190214:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800949d2680 x1830962867446784/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.190223:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d2680 with x1830962867446784 ext(1048576->2097151) 00002000:00010000:3.0:1746142913.190227:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d2680 00000100:00100000:3.0:1746142913.190257:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4471 00000100:00100000:3.0:1746142913.190264:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867446784:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.192686:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.193125:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447040 00000100:00100000:2.0:1746142913.193131:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447040 00002000:00100000:2.0:1746142913.193159:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800949d0e00 x1830962867447040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.193169:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0e00 with x1830962867447040 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.193173:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0e00 00000100:00100000:2.0:1746142913.193201:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4472 00000100:00100000:2.0:1746142913.193208:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867447040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.203561:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867446784:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13289us (13550us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142913.203572:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4471 00002000:00100000:3.0:1746142913.203582:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800949d2680 x1830962867446784/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.203592:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d2680 with x1830962867446784 ext(1048576->2097151) 00002000:00010000:3.0:1746142913.203597:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d2680 00000100:00100000:2.0:1746142913.210780:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867447040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17564us (18092us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.210791:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4472 00002000:00100000:2.0:1746142913.210800:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800949d0e00 x1830962867447040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.210809:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0e00 with x1830962867447040 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.210813:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0e00 00000100:00100000:0.0:1746142913.216247:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.216296:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.216358:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447168 00000100:00100000:3.0:1746142913.216366:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447168 00000100:00100000:3.0:1746142913.216403:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447296 00000100:00100000:3.0:1746142913.216405:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447296 00000100:00100000:3.0:1746142913.216800:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14412 00000100:00100000:3.0:1746142913.216810:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867447168:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.216826:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.216840:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac00 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.216860:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.216861:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.216869:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142913.216881:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14413 00010000:00010000:3.0:1746142913.216882:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142913.216888:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867447296:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.216891:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131c00, rc 0) 00010000:00010000:0.0:1746142913.216897:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142913.216928:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac07 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.216940:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.216941:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.216946:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 34 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142913.216960:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 34 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142913.216967:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715e00, rc 0) 00000100:00100000:0.0:1746142913.217004:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867447296:12345-192.168.204.50@tcp:101:cat.0 Request processed in 116us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.217010:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14413 00000100:00100000:3.0:1746142913.217483:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867447168:12345-192.168.204.50@tcp:101:cat.0 Request processed in 673us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.217488:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14412 00000100:00100000:0.0:1746142913.219868:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.220159:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447424 00000100:00100000:3.0:1746142913.220166:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447424 00000100:00100000:3.0:1746142913.220205:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14414 00000100:00100000:3.0:1746142913.220212:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2006:x1830962867447424:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.220223:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.220235:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac0e expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.220250:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.220252:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.220258:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 57 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.220269:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 57 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142913.220413:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142913.222181:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82c00, rc 0) 00000100:00100000:3.0:1746142913.222219:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2006:x1830962867447424:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2007us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.222226:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14414 00000100:00100000:3.0:1746142913.222241:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447552 00000100:00100000:3.0:1746142913.222244:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447552 00000100:00100000:3.0:1746142913.222261:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14415 00000100:00100000:3.0:1746142913.222265:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867447552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.222274:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.222284:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac15 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.222296:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.222298:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.222304:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 48 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.222314:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 48 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.222333:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea4c000, rc 0) 00000100:00100000:3.0:1746142913.222346:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867447552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 80us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.222350:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14415 00000100:00100000:0.0:1746142913.224208:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.224281:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447808 00000100:00100000:3.0:1746142913.224286:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447808 00000100:00100000:3.0:1746142913.224335:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14460 00000100:00100000:3.0:1746142913.224340:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:32510:x1830962867447808:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.224353:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.224355:0:10924:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746142913.224373:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067ccd57d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abba expref: 11 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224392:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccd545 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abac expref: 10 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224400:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.224403:0:10924:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142913.224412:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd5f4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac1c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224451:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.224460:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224467:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224472:0:10924:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224477:0:10924:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 6/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.224500:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224509:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 29 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.224518:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867838720:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.224600:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 7 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224607:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 7 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.224617:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867838848:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.224640:0:10924:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.224646:0:10924:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.224652:0:10924:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867838976:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.227862:0:10924:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.228849:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.228956:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.228984:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.229001:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867447936 00000100:00100000:2.0:1746142913.229008:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867447936 00000100:00100000:0.0:1746142913.229014:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142913.229037:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 30 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.229048:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867448064 00000100:00100000:1.0:1746142913.229052:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867448064 00000100:00100000:2.0:1746142913.229063:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6505 00010000:00010000:1.0:1746142913.229067:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 8 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.229069:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2004:x1830962867447936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.229079:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.229084:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 30 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.229084:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6506 00000100:00100000:1.0:1746142913.229089:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867448064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.229092:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 30 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.229095:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142913.229100:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 8 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.229112:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 8 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.229169:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea4d200/0x2fa243e067ccd592 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc1 expref: 30 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.229180:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867838720:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.229188:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867838848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.229271:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.229279:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142913.229287:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:2.0:1746142913.229291:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142913.229299:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067ccd529 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aba5 expref: 8 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.229311:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142913.229322:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142913.229328:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00000100:00100000:2.0:1746142913.229329:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867447936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 260us (484us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142913.229332:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.229335:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6505 00000100:00100000:1.0:1746142913.229348:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867448064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 259us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.229357:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6506 00000100:00100000:3.0:1746142913.229504:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867448320 00000100:00100000:3.0:1746142913.229508:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867448320 00002000:00100000:3.0:1746142913.229534:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800949d1180 x1830962867448320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.229542:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1180 with x1830962867448320 ext(2097152->4194303) 00002000:00010000:3.0:1746142913.229545:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d1180 00000100:00100000:3.0:1746142913.229562:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867448576 00000100:00100000:3.0:1746142913.229565:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867448576 00002000:00100000:3.0:1746142913.229576:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800949d1c00 x1830962867448576/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.229586:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1c00 with x1830962867448576 ext(2097152->4194303) 00002000:00010000:3.0:1746142913.229589:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d1c00 00000100:00100000:3.0:1746142913.229606:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4473 00000100:00100000:3.0:1746142913.229612:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867448320:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142913.230027:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4474 00000100:00100000:2.0:1746142913.230034:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867448576:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142913.230217:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.230251:0:10924:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10924:1830962867838976:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.230268:0:10924:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000100:00100000:0.0:1746142913.230326:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867448704 00000100:00100000:0.0:1746142913.230329:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867448704 00010000:00010000:0.0:1746142913.230342:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746142913.230357:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6507 00000100:00100000:0.0:1746142913.230361:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867448704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.230367:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.230371:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.230378:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.230390:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccd568 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abb3 expref: 29 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.230401:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142913.230404:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.230411:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.230417:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10924 initiator: MDT0 00010000:00010000:0.0:1746142913.230431:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142913.230449:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867448704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.230455:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6507 00010000:00010000:1.0:1746142913.231120:0:10924:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:1.0:1746142913.231126:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:02000000:1.0:1746142913.231164:0:10924:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00000040:00080000:1.0:1746142913.231335:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].641, 88 off64120 00000004:00080000:1.0:1746142913.231340:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230439409ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231728:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].714, 88 off70640 00000004:00080000:1.0:1746142913.231731:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230831472ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231742:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].715, 88 off70728 00000004:00080000:1.0:1746142913.231745:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230844792ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231752:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].642, 88 off64208 00000004:00080000:1.0:1746142913.231754:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230854600ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231760:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].643, 88 off64296 00000004:00080000:1.0:1746142913.231763:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230862846ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231768:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].716, 88 off70816 00000004:00080000:1.0:1746142913.231770:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230870619ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231776:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].717, 88 off70904 00000004:00080000:1.0:1746142913.231778:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230878217ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231784:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].644, 88 off64384 00000004:00080000:1.0:1746142913.231786:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230886479ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231792:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].718, 88 off70992 00000004:00080000:1.0:1746142913.231794:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230894125ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231800:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].645, 88 off64472 00000004:00080000:1.0:1746142913.231801:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230901724ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231807:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].719, 88 off71080 00000004:00080000:1.0:1746142913.231809:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230908777ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231814:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].646, 88 off64560 00000004:00080000:1.0:1746142913.231815:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230915796ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231821:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].720, 88 off71168 00000004:00080000:1.0:1746142913.231823:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230922839ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231828:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].647, 88 off64648 00000004:00080000:1.0:1746142913.231829:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230929799ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142913.231835:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].721, 88 off71256 00000004:00080000:1.0:1746142913.231837:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230936947ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231842:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].722, 88 off71344 00000004:00080000:1.0:1746142913.231844:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 687230943826ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142913.231849:0:10924:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].648, 88 off64736 00000004:00080000:1.0:1746142913.231851:0:10924:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 687230951382ns, next at 629431245375ns, rc = 0 00000100:00100000:0.0:1746142913.236279:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.236871:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.237169:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449088 00000100:00100000:1.0:1746142913.237180:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449088 00002000:00100000:1.0:1746142913.237212:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800949d0000 x1830962867449088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.237220:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0000 with x1830962867449088 ext(2097152->4194303) 00002000:00010000:1.0:1746142913.237225:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0000 00000100:00100000:1.0:1746142913.237249:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449216 00000100:00100000:1.0:1746142913.237251:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449216 00002000:00100000:1.0:1746142913.237262:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088fd9f80 x1830962867449216/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.237268:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9f80 with x1830962867449216 ext(2097152->4194303) 00002000:00010000:1.0:1746142913.237271:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fd9f80 00000100:00100000:1.0:1746142913.237282:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4475 00000100:00100000:1.0:1746142913.237288:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2006:x1830962867449088:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.238228:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4476 00000100:00100000:2.0:1746142913.238236:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867449216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.242240:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867448576:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 12199us (13218us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142913.242249:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4474 00002000:00100000:2.0:1746142913.242259:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800949d1c00 x1830962867448576/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.242267:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1c00 with x1830962867448576 ext(2097152->4194303) 00002000:00010000:2.0:1746142913.242272:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d1c00 00000001:00080000:2.0:1746142913.242639:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936628 is committed 00000004:00080000:2.0:1746142913.242644:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 637 committed 00000004:00080000:2.0:1746142913.242677:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 711 committed 00000004:00080000:2.0:1746142913.243387:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 710 committed 00000004:00080000:2.0:1746142913.243390:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 636 committed 00000004:00080000:2.0:1746142913.243391:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 709 committed 00000004:00080000:2.0:1746142913.243393:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 635 committed 00000004:00080000:2.0:1746142913.243394:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 708 committed 00000004:00080000:2.0:1746142913.243396:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 634 committed 00000004:00080000:2.0:1746142913.243397:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 707 committed 00000004:00080000:2.0:1746142913.243398:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 633 committed 00000004:00080000:2.0:1746142913.243400:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 706 committed 00000004:00080000:2.0:1746142913.243401:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 705 committed 00000004:00080000:2.0:1746142913.243403:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 632 committed 00000004:00080000:2.0:1746142913.243404:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 631 committed 00000004:00080000:2.0:1746142913.243406:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 704 committed 00000004:00080000:2.0:1746142913.243407:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 703 committed 00000004:00080000:2.0:1746142913.243409:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 630 committed 00000001:00080000:2.0:1746142913.243414:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936627 is committed 00000001:00080000:2.0:1746142913.243421:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936623 is committed 00000100:00100000:1.0:1746142913.243551:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867839232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.243555:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867839488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.243585:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.243592:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867839104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142913.243607:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.243608:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867839616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.243621:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867839744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.243623:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.243633:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.243639:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.243649:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.243660:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867840000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.243660:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839232 00000100:00100000:1.0:1746142913.243666:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839232 00000100:00100000:3.0:1746142913.243670:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.243679:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746142913.243683:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867839360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.243688:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839104 00000100:00100000:1.0:1746142913.243690:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839104 00000100:00100000:3.0:1746142913.243693:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.243701:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867839872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.243701:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839616 00000100:00100000:1.0:1746142913.243703:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839616 00000100:00100000:1.0:1746142913.243710:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839744 00000100:00100000:3.0:1746142913.243711:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.243712:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839744 00000100:00100000:1.0:1746142913.243717:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839488 00000100:00100000:1.0:1746142913.243718:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839488 00000100:00100000:1.0:1746142913.243723:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840000 00000100:00100000:3.0:1746142913.243724:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839360 00000100:00100000:1.0:1746142913.243725:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840000 00000100:00100000:3.0:1746142913.243727:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839360 00000100:00100000:1.0:1746142913.243731:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867839872 00000100:00100000:1.0:1746142913.243732:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867839872 00000100:00100000:3.0:1746142913.243741:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14416 00000100:00100000:0.0:1746142913.243808:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867840384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142913.243828:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142913.243841:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867840896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142913.243853:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142913.243861:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746142913.243864:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867840512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142913.243874:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142913.243880:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867841024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142913.243891:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.244031:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3764:x1830962867839232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142913.244130:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142913.244132:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:3.0:1746142913.244135:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:3.0:1746142913.244137:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:3.0:1746142913.244139:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746142913.244156:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3764:x1830962867839232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 410us (571us total) trans 17179873960 rc 0/0 00000100:00100000:1.0:1746142913.244348:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14417 00000100:00100000:2.0:1746142913.244356:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14418 00000100:00100000:1.0:1746142913.244357:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867839104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.244363:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830962867839616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142913.244400:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142913.244402:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244404:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:2.0:1746142913.244406:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244407:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00002000:00010000:1.0:1746142913.244413:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746142913.244415:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244417:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244419:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244420:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142913.244423:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830962867839616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (799us total) trans 17179873961 rc 0/0 00000100:00100000:2.0:1746142913.244427:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14418 00000100:00100000:2.0:1746142913.244436:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840384 00000100:00100000:2.0:1746142913.244439:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840384 00000100:00100000:1.0:1746142913.244440:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867839104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (831us total) trans 21474841220 rc 0/0 00000100:00100000:1.0:1746142913.244445:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14417 00000100:00100000:2.0:1746142913.244449:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840896 00000100:00100000:2.0:1746142913.244450:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840896 00000100:00100000:2.0:1746142913.244456:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840512 00000100:00100000:1.0:1746142913.244457:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867841024 00000100:00100000:2.0:1746142913.244458:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840512 00000100:00100000:1.0:1746142913.244459:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867841024 00000100:00100000:2.0:1746142913.244464:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14419 00000100:00100000:2.0:1746142913.244468:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3765:x1830962867839744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.244470:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14420 00000100:00100000:1.0:1746142913.244474:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3763:x1830962867839488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142913.244496:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746142913.244498:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244500:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142913.244502:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244503:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00002000:00010000:1.0:1746142913.244514:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746142913.244516:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3765:x1830962867839744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (883us total) trans 17179873962 rc 0/0 00002000:00010000:1.0:1746142913.244516:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244518:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244519:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00000100:00100000:2.0:1746142913.244521:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14419 00002000:00010000:1.0:1746142913.244521:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746142913.244528:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14421 00000100:00100000:2.0:1746142913.244532:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867840000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.244538:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867839488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (888us total) trans 17179873963 rc 0/0 00000100:00100000:1.0:1746142913.244543:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14420 00000100:00100000:1.0:1746142913.244553:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14422 00000100:00100000:1.0:1746142913.244557:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867839360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.244570:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867840000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 38us (899us total) trans 17179873964 rc 0/0 00000100:00100000:2.0:1746142913.244575:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14421 00000100:00100000:2.0:1746142913.244583:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14423 00000100:00100000:2.0:1746142913.244586:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867839872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142913.244592:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142913.244594:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244596:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244597:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244599:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746142913.244612:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142913.244614:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142913.244616:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142913.244617:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00000100:00100000:1.0:1746142913.244617:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867839360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (922us total) trans 17179873965 rc 0/0 00002000:00010000:2.0:1746142913.244619:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:1.0:1746142913.244621:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14422 00000100:00100000:1.0:1746142913.244631:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14424 00000100:00100000:2.0:1746142913.244632:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800946c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867839872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (919us total) trans 17179873966 rc 0/0 00000100:00100000:1.0:1746142913.244635:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3762:x1830962867840384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.244636:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14423 00000100:00100000:2.0:1746142913.244643:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14425 00000100:00100000:2.0:1746142913.244647:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3762:x1830962867840896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142913.244668:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:1.0:1746142913.244670:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244671:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244673:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.244675:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00002000:00010000:2.0:1746142913.244676:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142913.244678:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244680:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142913.244682:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244683:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142913.244693:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3762:x1830962867840384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (864us total) trans 21474841221 rc 0/0 00000100:00100000:2.0:1746142913.244697:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3762:x1830962867840896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (843us total) trans 21474841222 rc 0/0 00000100:00100000:1.0:1746142913.244698:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14424 00000100:00100000:2.0:1746142913.244701:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14425 00000100:00100000:2.0:1746142913.244709:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14426 00000100:00100000:2.0:1746142913.244712:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3762:x1830962867840512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.244747:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3762:x1830962867840512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (872us total) trans 21474841223 rc 0/0 00000100:00100000:2.0:1746142913.244752:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14426 00000100:00100000:2.0:1746142913.244759:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14427 00000100:00100000:2.0:1746142913.244763:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3762:x1830962867841024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.244787:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142913.244799:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3762:x1830962867841024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (907us total) trans 21474841224 rc 0/0 00000100:00100000:2.0:1746142913.244804:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14427 00000100:00100000:2.0:1746142913.244810:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840128 00000100:00100000:2.0:1746142913.244812:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840128 00000004:00080000:1.0:1746142913.244816:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c7b80/2, rc 0, transno 17179873960 00000100:00100000:2.0:1746142913.244823:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14428 00000100:00100000:1.0:1746142913.244824:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867839232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.244827:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3764:x1830962867840128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142913.244854:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00000004:00080000:1.0:1746142913.244855:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c6a00/2, rc 0, transno 17179873961 00002000:00010000:2.0:1746142913.244856:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244858:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1746142913.244858:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867839616:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142913.244860:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142913.244862:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142913.244866:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.244875:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3764:x1830962867840128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (88us total) trans 17179873967 rc 0/0 00000100:00100000:2.0:1746142913.244880:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14428 00000100:00100000:1.0:1746142913.244884:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.244916:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14416 00000100:00100000:3.0:1746142913.244924:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840640 00000100:00100000:3.0:1746142913.244926:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840640 00000100:00100000:2.0:1746142913.245454:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14429 00000100:00100000:2.0:1746142913.245462:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3764:x1830962867840640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.245525:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867840640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (640us total) trans 21474841225 rc 0/0 00000100:00100000:2.0:1746142913.245531:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14429 00000004:00080000:0.0:1746142913.245617:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c5c00/2, rc 0, transno 17179873965 00000100:00100000:0.0:1746142913.245622:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867839360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142913.245629:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c4e00/2, rc 0, transno 17179873966 00000100:00100000:0.0:1746142913.245632:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867839872:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142913.245638:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c4a80/2, rc 0, transno 17179873963 00000100:00100000:0.0:1746142913.245640:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867839488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142913.245646:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c6680/2, rc 0, transno 17179873964 00000100:00100000:0.0:1746142913.245648:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867840000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142913.245663:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fdbb80/2, rc 0, transno 21474841223 00000100:00100000:0.0:1746142913.245666:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867840512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142913.245671:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fdaa00/2, rc 0, transno 21474841224 00000100:00100000:0.0:1746142913.245673:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867841024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142913.245678:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd8380/2, rc 0, transno 21474841221 00000100:00100000:0.0:1746142913.245681:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867840384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142913.245686:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd9880/2, rc 0, transno 21474841222 00000100:00100000:0.0:1746142913.245688:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867840896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142913.245928:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd9500/2, rc 0, transno 21474841225 00000100:00100000:1.0:1746142913.245932:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840640:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142913.245938:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c5880/2, rc 0, transno 17179873967 00000100:00100000:1.0:1746142913.245940:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142913.245945:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746142913.245950:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.245967:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.245976:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142913.245985:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142913.245999:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840256 00000100:00100000:1.0:1746142913.246002:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840256 00000100:00100000:2.0:1746142913.246010:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867840768 00000100:00100000:2.0:1746142913.246014:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867840768 00000100:00100000:1.0:1746142913.246015:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14430 00000100:00100000:1.0:1746142913.246020:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867840256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142913.246030:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14431 00000100:00100000:2.0:1746142913.246034:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867840768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142913.246059:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142913.246061:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.246063:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.246064:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142913 -> 1746142913 00002000:00010000:1.0:1746142913.246066:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142913.246083:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3764:x1830962867840256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (115us total) trans 21474841226 rc 0/0 00000100:00100000:1.0:1746142913.246087:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14430 00000100:00100000:2.0:1746142913.246092:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3764:x1830962867840768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (104us total) trans 21474841227 rc 0/0 00000100:00100000:2.0:1746142913.246097:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14431 00000004:00080000:1.0:1746142913.246104:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd9180/2, rc 0, transno 21474841226 00000100:00100000:1.0:1746142913.246106:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840256:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142913.246111:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fd8700/2, rc 0, transno 21474841227 00000100:00100000:1.0:1746142913.246114:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867840768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142913.246125:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088fda300/2, rc 0, transno 21474841220 00000100:00100000:3.0:1746142913.246130:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867839104:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142913.246139:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c7800/2, rc 0, transno 17179873962 00000100:00100000:3.0:1746142913.246142:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867839744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142913.246210:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746142913.246218:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867841152:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746142913.246237:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.246239:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746142913.246248:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.246251:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746142913.246263:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067ccd5f4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 9 pid: 10924 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746142913.246278:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 8 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.246305:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.246307:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746142913.246309:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337bc00, rc 0) 00000100:00100000:3.0:1746142913.246348:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:32510:x1830962867447808:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 22008us (22145us total) trans 8589936628 rc 0/0 00000100:00100000:3.0:1746142913.246358:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14460 00000100:00100000:3.0:1746142913.246376:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867841152 00000100:00100000:3.0:1746142913.246378:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867841152 00000100:00100000:3.0:1746142913.246404:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14432 00000100:00100000:3.0:1746142913.246409:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3765:x1830962867841152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.246472:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3765:x1830962867841152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (232us total) trans 17179873968 rc 0/0 00000100:00100000:3.0:1746142913.246477:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14432 00000004:00080000:2.0:1746142913.246675:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800946c7480/2, rc 0, transno 17179873968 00000100:00100000:2.0:1746142913.246679:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867841152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142913.250872:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867448320:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 21252us (21878us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142913.250882:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4473 00002000:00100000:3.0:1746142913.250891:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800949d1180 x1830962867448320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.250915:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1180 with x1830962867448320 ext(2097152->4194303) 00002000:00010000:3.0:1746142913.250920:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d1180 00000100:00100000:0.0:1746142913.257118:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.258779:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449344 00000100:00100000:3.0:1746142913.258786:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449344 00000100:00100000:3.0:1746142913.258878:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14461 00000100:00100000:3.0:1746142913.258885:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+8:32512:x1830962867449344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.258923:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.258940:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d200/0x2fa243e067ccd602 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac23 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.258983:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d200/0x2fa243e067ccd602 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac23 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.258998:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d200/0x2fa243e067ccd602 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac23 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.259010:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.259013:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142913.259016:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710d200, rc 0) 00000100:00100000:3.0:1746142913.259063:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+9:32512:x1830962867449344:12345-192.168.204.50@tcp:101:cat.0 Request processed in 178us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.259068:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14461 00000100:00100000:0.0:1746142913.264836:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.265615:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449472 00000100:00100000:2.0:1746142913.265623:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449472 00000100:00100000:2.0:1746142913.265673:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14462 00000100:00100000:2.0:1746142913.265681:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32509:x1830962867449472:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142913.265701:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.265717:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac2a expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.265766:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.265777:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.265790:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.265792:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142913.265795:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670c00, rc 0) 00000100:00100000:2.0:1746142913.265831:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32509:x1830962867449472:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 151us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.265836:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14462 00000100:00100000:1.0:1746142913.266187:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2006:x1830962867449088:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28898us (29915us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142913.266195:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4475 00002000:00100000:1.0:1746142913.266202:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800949d0000 x1830962867449088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.266216:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0000 with x1830962867449088 ext(2097152->4194303) 00002000:00010000:1.0:1746142913.266220:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0000 00000100:00100000:0.0:1746142913.273884:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.274574:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867449216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 36337us (37701us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142913.274584:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4476 00002000:00100000:2.0:1746142913.274594:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088fd9f80 x1830962867449216/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.274603:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9f80 with x1830962867449216 ext(2097152->4194303) 00002000:00010000:2.0:1746142913.274607:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fd9f80 00000100:00100000:0.0:1746142913.275177:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.275233:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449728 00000100:00100000:3.0:1746142913.275239:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449728 00000100:00100000:3.0:1746142913.275265:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14463 00000100:00100000:3.0:1746142913.275271:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32513:x1830962867449728:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.275288:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.275304:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009710ce00/0x2fa243e067ccd610 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac31 expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.275356:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009710ce00/0x2fa243e067ccd610 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac31 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.275368:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710ce00/0x2fa243e067ccd610 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac31 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.275417:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449600 00000100:00100000:1.0:1746142913.275420:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449600 00000100:00100000:1.0:1746142913.275445:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 768 00000100:00100000:1.0:1746142913.275450:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867449600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142913.275458:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142913.275470:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d200/0x2fa243e067ccd602 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac23 expref: 9 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.275484:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142913.275487:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142913.275507:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867449600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 56us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.275512:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 768 00010000:00010000:3.0:1746142913.275780:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.275783:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142913.275785:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710ce00, rc 0) 00000100:00100000:3.0:1746142913.275817:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32513:x1830962867449728:12345-192.168.204.50@tcp:101:cat.0 Request processed in 545us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.275823:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14463 00000100:00100000:0.0:1746142913.280081:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.280355:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449856 00000100:00100000:2.0:1746142913.280363:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449856 00000100:00100000:2.0:1746142913.280412:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 769 00000100:00100000:2.0:1746142913.280419:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867449856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.280431:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.281064:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710ce00/0x2fa243e067ccd610 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac31 expref: 28 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.281083:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.281087:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.281123:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867449856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 704us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.281129:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 769 00000100:00100000:0.0:1746142913.289449:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.289487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.289554:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867449984 00000100:00100000:3.0:1746142913.289561:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867449984 00000100:00100000:3.0:1746142913.289597:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867450112 00000100:00100000:3.0:1746142913.289599:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867450112 00000100:00100000:3.0:1746142913.289611:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14433 00000100:00100000:3.0:1746142913.289617:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:32510:x1830962867449984:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.289631:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142913.289637:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14434 00010000:00010000:3.0:1746142913.289643:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac38 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.289645:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:32509:x1830962867450112:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142913.289653:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.289661:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac3f expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.289665:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.289672:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 58 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.289677:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.289677:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.289682:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.289683:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.289686:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [647168->1048575] (req 647168->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.289686:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.289693:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.289698:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.289700:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.289702:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2027519] (req 1048576->2027519) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.289707:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.289718:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.289719:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 26 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.289726:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 26 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.289729:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800946c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867841280:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.289734:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867841408:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.289811:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.289819:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.289827:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867841536:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.289851:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 12 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.289863:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 12 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746142913.289869:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867841664:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.289888:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00010000:00010000:3.0:1746142913.292257:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 58 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.292271:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 58 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.292280:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867841792:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.292451:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867841408:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142913.292473:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.292509:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867450368 00000100:00100000:2.0:1746142913.292514:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867450368 00002000:00100000:2.0:1746142913.292543:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009a28ca80 x1830962867450368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.292551:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ca80 with x1830962867450368 ext(2097152->4194303) 00002000:00010000:2.0:1746142913.292555:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28ca80 00000100:00100000:2.0:1746142913.292569:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4477 00000100:00100000:2.0:1746142913.292575:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867450368:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:3.0:1746142913.292626:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.292634:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746142913.292690:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867841536:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.293166:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867841920:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.293197:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.293380:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867841664:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.293407:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2027519] (req 1048576->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.293420:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6000, rc 0) 00000100:00100000:1.0:1746142913.293441:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32509:x1830962867450112:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3796us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.293447:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14434 00000100:00100000:0.0:1746142913.293478:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.293629:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867450624 00000100:00100000:1.0:1746142913.293633:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867450624 00000100:00100000:0.0:1746142913.293870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.293910:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.293923:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867450752 00000100:00100000:0.0:1746142913.293926:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867450752 00010000:00010000:0.0:1746142913.293941:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 28 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746142913.293957:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867451008 00000100:00100000:0.0:1746142913.293959:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867451008 00010000:00010000:0.0:1746142913.293966:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 13 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746142913.293977:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6508 00000100:00100000:0.0:1746142913.293982:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867450752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.293989:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.294004:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 28 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294012:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 28 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294028:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24600/0x2fa243e067ccd5ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf2 expref: 28 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294041:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142913.294059:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867450752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.294064:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6508 00000100:00100000:0.0:1746142913.294073:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6509 00000100:00100000:0.0:1746142913.294077:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867451008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.294083:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.294088:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 13 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.294095:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 13 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.294105:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2bc00/0x2fa243e067ccd4c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab90 expref: 13 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.294112:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142913.294125:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867451008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.294129:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6509 00000100:00100000:0.0:1746142913.294180:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.294190:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867450880 00000100:00100000:0.0:1746142913.294192:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867450880 00010000:00010000:0.0:1746142913.294200:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746142913.294212:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6510 00000100:00100000:0.0:1746142913.294216:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2004:x1830962867450880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.294221:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.294226:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294234:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294244:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccd5d1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abf9 expref: 58 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294251:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.294252:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.294257:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 57 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.294264:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 57 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.294281:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 57 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142913.294290:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a28d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867842048:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142913.294323:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.294356:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.294378:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.294428:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.294437:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867451648 00000100:00100000:0.0:1746142913.294440:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867451648 00010000:00010000:0.0:1746142913.294450:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 27 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746142913.294462:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6511 00000100:00100000:0.0:1746142913.294466:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867451648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.294471:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.294478:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 27 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294484:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 27 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.294493:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.294537:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867451392 00000100:00100000:3.0:1746142913.294540:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867451392 00002000:00100000:3.0:1746142913.294556:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a28c000 x1830962867451392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.294563:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c000 with x1830962867451392 ext(3145728->4194303) 00002000:00010000:3.0:1746142913.294567:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28c000 00000100:00100000:3.0:1746142913.294580:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867451520 00000100:00100000:3.0:1746142913.294583:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867451520 00002000:00100000:3.0:1746142913.294592:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009a28e300 x1830962867451520/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.294598:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28e300 with x1830962867451520 ext(2097152->4194303) 00002000:00010000:3.0:1746142913.294600:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28e300 00000100:00100000:3.0:1746142913.294609:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4478 00000100:00100000:3.0:1746142913.294613:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2006:x1830962867451392:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:1.0:1746142913.294844:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a28dc00 x1830962867450624/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.294852:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28dc00 with x1830962867450624 ext(3145728->4194303) 00002000:00010000:1.0:1746142913.294855:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28dc00 00000100:00100000:1.0:1746142913.294875:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4479 00000100:00100000:1.0:1746142913.294881:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867451520:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.295109:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4480 00000100:00100000:3.0:1746142913.295115:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867450624:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:3.0:1746142913.295402:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83400/0x2fa243e067ccd5a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abc8 expref: 28 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.295415:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800946c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867841280:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.295428:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867841792:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.295488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.295502:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867451776 00000100:00100000:3.0:1746142913.295505:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867451776 00010000:00010000:3.0:1746142913.295516:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 60 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.295530:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6512 00000100:00100000:3.0:1746142913.295535:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+60:2005:x1830962867451776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.295542:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142913.296178:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867451648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1709us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.296184:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6511 00000100:00100000:0.0:1746142913.296460:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142913.296538:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 60 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.296548:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 60 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.296561:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131e00/0x2fa243e067ccd5a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abcf expref: 60 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.296572:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.296591:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:2005:x1830962867451776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1055us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.296596:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6512 00000100:00100000:3.0:1746142913.296605:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867451904 00000100:00100000:3.0:1746142913.296610:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867451904 00010000:00010000:3.0:1746142913.296619:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.296640:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6513 00000100:00100000:3.0:1746142913.296645:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867451904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.296650:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.296657:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.296665:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.296676:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.296678:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.296682:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.296689:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.296708:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.296717:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867842176:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.296755:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746142913.296774:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccd4ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab7b expref: 12 pid: 1852 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.296782:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867841920:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.296801:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 26 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.296809:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710d400, rc 0) 00000100:00100000:3.0:1746142913.296826:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+26:32510:x1830962867449984:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7208us (7383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.296831:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14433 00000100:00100000:0.0:1746142913.303591:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.303695:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867452160 00000100:00100000:3.0:1746142913.303703:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867452160 00002000:00100000:3.0:1746142913.303739:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1052671) req@ffff88009a28d500 x1830962867452160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.303749:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d500 with x1830962867452160 ext(1048576->1052671) 00002000:00010000:3.0:1746142913.303754:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28d500 00000100:00100000:3.0:1746142913.303778:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4481 00000100:00100000:3.0:1746142913.303784:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:2005:x1830962867452160:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.303922:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:2005:x1830962867452160:12345-192.168.204.50@tcp:3:cat.0 Request processed in 137us (337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142913.303929:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4481 00002000:00100000:3.0:1746142913.303935:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1052671) req@ffff88009a28d500 x1830962867452160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.303941:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28d500 with x1830962867452160 ext(1048576->1052671) 00002000:00010000:3.0:1746142913.303944:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28d500 00000100:00100000:2.0:1746142913.304034:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a28d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867842048:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142913.304048:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.304081:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2004:x1830962867450880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9863us (9899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.304087:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6510 00000100:00100000:3.0:1746142913.308018:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2006:x1830962867451392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13396us (13653us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142913.308028:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4478 00002000:00100000:3.0:1746142913.308038:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a28c000 x1830962867451392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.308046:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28c000 with x1830962867451392 ext(3145728->4194303) 00002000:00010000:3.0:1746142913.308051:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28c000 00000100:00100000:0.0:1746142913.309302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.309734:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867452416 00000100:00100000:2.0:1746142913.309741:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867452416 00002000:00100000:2.0:1746142913.309770:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (647168->651263) req@ffff88009a28ce00 x1830962867452416/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.309779:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ce00 with x1830962867452416 ext(647168->651263) 00002000:00010000:2.0:1746142913.309783:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ce00 00000100:00100000:2.0:1746142913.309797:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4482 00000100:00100000:2.0:1746142913.309803:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867452416:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142913.309887:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867452416:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 83us (587us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142913.309892:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4482 00000100:00100000:3.0:1746142913.310142:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867842176:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.310155:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.310179:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867451904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 13533us (13718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.310186:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6513 00002000:00100000:2.0:1746142913.310680:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (647168->651263) req@ffff88009a28ce00 x1830962867452416/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.310689:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ce00 with x1830962867452416 ext(647168->651263) 00002000:00010000:2.0:1746142913.310692:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28ce00 00000100:00100000:3.0:1746142913.319954:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867450624:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 24831us (26467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142913.319964:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4480 00002000:00100000:3.0:1746142913.319974:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88009a28dc00 x1830962867450624/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.319982:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28dc00 with x1830962867450624 ext(3145728->4194303) 00002000:00010000:3.0:1746142913.319987:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a28dc00 00000100:00100000:2.0:1746142913.324811:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867450368:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 32227us (32330us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142913.324822:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4477 00002000:00100000:2.0:1746142913.324830:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009a28ca80 x1830962867450368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.324838:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28ca80 with x1830962867450368 ext(2097152->4194303) 00002000:00010000:2.0:1746142913.324843:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28ca80 00000100:00100000:1.0:1746142913.336811:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867451520:12345-192.168.204.50@tcp:3:cat.0 Request processed in 41922us (42424us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142913.336822:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4479 00002000:00100000:1.0:1746142913.336831:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009a28e300 x1830962867451520/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.336840:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a28e300 with x1830962867451520 ext(2097152->4194303) 00002000:00010000:1.0:1746142913.336844:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a28e300 00000100:00100000:0.0:1746142913.337324:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.337378:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.337431:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867452544 00000100:00100000:1.0:1746142913.337441:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867452544 00000100:00100000:1.0:1746142913.337478:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867452672 00000100:00100000:1.0:1746142913.337480:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867452672 00000100:00100000:1.0:1746142913.337492:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14435 00000100:00100000:1.0:1746142913.337498:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867452544:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.337511:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142913.337513:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14436 00000100:00100000:2.0:1746142913.337522:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:32510:x1830962867452672:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142913.337524:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097421600/0x2fa243e067ccd625 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac46 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337530:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.337539:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac4d expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337555:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 15 pid: 11421 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142913.337562:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867842304:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142913.337567:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 47 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337573:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337578:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.337580:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.337583:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1540095] (req 1048576->1540095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 35 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337601:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337613:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 35 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.337615:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.337621:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867842432:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.337648:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 47 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.337656:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 47 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.337662:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867842560:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.337682:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 15 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.337690:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 15 pid: 11421 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746142913.337697:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867842688:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.337712:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.339055:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.339081:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867842432:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.339102:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867452800 00000100:00100000:2.0:1746142913.339106:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867452800 00010000:00010000:2.0:1746142913.339126:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 36 pid: 1397 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.339145:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6514 00000100:00100000:2.0:1746142913.339150:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+36:2003:x1830962867452800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.339158:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.339172:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 36 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.339181:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 36 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.339194:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e800/0x2fa243e067ccd5ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abd6 expref: 36 pid: 1397 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.339212:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.339235:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+35:2003:x1830962867452800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.339241:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6514 00000100:00100000:1.0:1746142913.339259:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867842304:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.339280:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097421600/0x2fa243e067ccd625 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac46 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.339289:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097421600/0x2fa243e067ccd625 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac46 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.339452:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097421600, rc 0) 00000100:00100000:1.0:1746142913.339473:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867452544:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1975us (2158us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.339478:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14435 00000100:00100000:0.0:1746142913.340802:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.340817:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867842560:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.340826:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867842688:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142913.340835:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142913.340845:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1540095] (req 1048576->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 34 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.340855:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0600, rc 0) 00000100:00100000:2.0:1746142913.340890:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:32510:x1830962867452672:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3369us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.340893:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867452928 00000100:00100000:2.0:1746142913.340896:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14436 00000100:00100000:3.0:1746142913.340912:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867452928 00010000:00010000:3.0:1746142913.340929:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 48 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.340930:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867453056 00000100:00100000:2.0:1746142913.340933:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867453056 00010000:00010000:2.0:1746142913.340943:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 16 pid: 11421 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.341116:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6515 00000100:00100000:3.0:1746142913.341123:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867452928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142913.341128:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6516 00010000:00010000:3.0:1746142913.341131:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142913.341135:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867453056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.341141:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.341143:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 48 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.341153:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 48 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.341166:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067ccd5b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abdd expref: 48 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.341167:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 16 pid: 11421 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.341182:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 16 pid: 11421 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.341332:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009712ac00/0x2fa243e067ccd4b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab82 expref: 16 pid: 11421 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.341366:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.341369:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.341375:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.341382:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.341404:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.341415:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867842816:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.341507:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dc00 going to sleep for 11 seconds 00010000:00010000:2.0:1746142913.341577:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.341597:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867453056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 462us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.341603:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6516 00000100:00100000:3.0:1746142913.343422:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867842816:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.343435:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.344020:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867452928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2897us (3219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.344028:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6515 00000100:00100000:0.0:1746142913.344300:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.345053:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867453312 00000100:00100000:1.0:1746142913.345058:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867453312 00002000:00100000:1.0:1746142913.345089:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800949d3800 x1830962867453312/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.345098:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3800 with x1830962867453312 ext(4194304->5066751) 00002000:00010000:1.0:1746142913.345102:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d3800 00000100:00100000:1.0:1746142913.345128:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4483 00000100:00100000:1.0:1746142913.345134:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867453312:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.348778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.348815:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.348847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.348926:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867453568 00000100:00100000:3.0:1746142913.348933:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867453568 00002000:00100000:3.0:1746142913.348964:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (2023424->2027519) req@ffff88012e678380 x1830962867453568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.348973:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678380 with x1830962867453568 ext(2023424->2027519) 00002000:00010000:3.0:1746142913.348978:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e678380 00000100:00100000:0.0:1746142913.348991:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.348996:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867454080 00000100:00100000:3.0:1746142913.348999:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867454080 00002000:00100000:3.0:1746142913.349011:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1536000->1540095) req@ffff88012e679f80 x1830962867454080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.349018:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679f80 with x1830962867454080 ext(1536000->1540095) 00002000:00010000:3.0:1746142913.349020:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e679f80 00000100:00100000:3.0:1746142913.349033:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4484 00000100:00100000:3.0:1746142913.349038:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867453568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.349154:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867453568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 115us (306us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142913.349159:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4484 00002000:00100000:3.0:1746142913.349164:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x99:0x0] (2023424->2027519) req@ffff88012e678380 x1830962867453568/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.349169:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678380 with x1830962867453568 ext(2023424->2027519) 00002000:00010000:3.0:1746142913.349171:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e678380 00000100:00100000:3.0:1746142913.349182:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4485 00000100:00100000:3.0:1746142913.349186:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867454080:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.349227:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867454080:12345-192.168.204.50@tcp:3:cat.0 Request processed in 41us (237us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142913.349232:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4485 00002000:00100000:3.0:1746142913.349235:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1536000->1540095) req@ffff88012e679f80 x1830962867454080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.349240:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679f80 with x1830962867454080 ext(1536000->1540095) 00002000:00010000:3.0:1746142913.349243:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e679f80 00000100:00100000:2.0:1746142913.349348:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867453696 00000100:00100000:2.0:1746142913.349352:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867453696 00000100:00100000:2.0:1746142913.349376:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867453824 00000100:00100000:2.0:1746142913.349377:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867453824 00000100:00100000:2.0:1746142913.349389:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14437 00000100:00100000:2.0:1746142913.349394:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2006:x1830962867453696:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.349401:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.349417:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0e00/0x2fa243e067ccd633 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac54 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.349455:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867842944:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.349509:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.349523:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14438 00000100:00100000:2.0:1746142913.349658:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867453824:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.349665:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.349673:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccd63a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac5b expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.349816:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867843072:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.349846:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.352635:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867842944:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142913.352662:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0e00/0x2fa243e067ccd633 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac54 expref: 57 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.352674:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0e00/0x2fa243e067ccd633 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac54 expref: 57 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.352686:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0e00, rc 0) 00000100:00100000:2.0:1746142913.352715:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2006:x1830962867453696:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3320us (3943us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142913.352722:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14437 00000100:00100000:1.0:1746142913.352790:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867453312:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7650us (8483us total) trans 0 rc 872448/872448 00000100:00100000:1.0:1746142913.352798:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4483 00002000:00100000:1.0:1746142913.352805:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800949d3800 x1830962867453312/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.352813:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3800 with x1830962867453312 ext(4194304->5066751) 00002000:00010000:1.0:1746142913.352817:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d3800 00000100:00100000:0.0:1746142913.355953:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.355992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.356075:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867454336 00000100:00100000:1.0:1746142913.356083:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867454336 00000100:00100000:2.0:1746142913.356121:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867843072:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.356125:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867454592 00000100:00100000:1.0:1746142913.356128:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867454592 00000100:00100000:1.0:1746142913.356142:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5274 00010000:00010000:2.0:1746142913.356145:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccd63a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac5b expref: 48 pid: 1397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142913.356149:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32509:x1830962867454336:12345-192.168.204.50@tcp:35:multiop.0 00010000:00010000:2.0:1746142913.356158:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0400/0x2fa243e067ccd63a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac5b expref: 48 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.356167:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0400, rc 0) 00000100:00100000:2.0:1746142913.356187:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5275 00000100:00100000:2.0:1746142913.356193:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:32510:x1830962867454592:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142913.356303:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32509:x1830962867454336:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 153us (356us total) trans 8589936629 rc 0/0 00000100:00100000:1.0:1746142913.356309:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5274 00000100:00100000:2.0:1746142913.356358:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32510:x1830962867454592:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 165us (365us total) trans 8589936630 rc 0/0 00000100:00100000:2.0:1746142913.356364:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5275 00000100:00100000:2.0:1746142913.356385:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867453824:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6729us (7570us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142913.356391:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14438 00000100:00100000:1.0:1746142913.356476:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.356515:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867454720 00000100:00100000:2.0:1746142913.356518:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867454720 00000100:00100000:2.0:1746142913.356931:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14439 00000100:00100000:2.0:1746142913.356938:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867454720:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.356946:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.356957:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067ccd641 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac62 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.356992:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867843200:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.357053:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.359829:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867843200:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142913.359856:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067ccd641 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac62 expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.359867:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed1400/0x2fa243e067ccd641 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac62 expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.359877:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1400, rc 0) 00000100:00100000:2.0:1746142913.359929:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867454720:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2990us (3452us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142913.359935:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14439 00000100:00100000:0.0:1746142913.362587:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.362848:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867454976 00000100:00100000:1.0:1746142913.362855:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867454976 00002000:00100000:1.0:1746142913.362892:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012e67a680 x1830962867454976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.362932:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67a680 with x1830962867454976 ext(4194304->5066751) 00002000:00010000:1.0:1746142913.362936:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67a680 00000100:00100000:1.0:1746142913.362983:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4486 00000100:00100000:1.0:1746142913.362991:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867454976:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.364475:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.364525:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867455104 00000100:00100000:3.0:1746142913.364531:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867455104 00000100:00100000:3.0:1746142913.364564:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14440 00000100:00100000:3.0:1746142913.364570:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867455104:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.364579:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.364595:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f1200/0x2fa243e067ccd648 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac69 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.364633:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867843328:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142913.366102:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.367363:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867843328:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142913.367385:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f1200/0x2fa243e067ccd648 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac69 expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.367396:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1200/0x2fa243e067ccd648 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac69 expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.367421:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1200, rc 0) 00000100:00100000:3.0:1746142913.367541:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867455104:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2970us (3069us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.367541:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867454976:12345-192.168.204.50@tcp:3:cat.0 Request processed in 4550us (4958us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142913.367548:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14440 00000100:00100000:1.0:1746142913.367548:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4486 00002000:00100000:1.0:1746142913.367556:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012e67a680 x1830962867454976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.367563:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67a680 with x1830962867454976 ext(4194304->5066751) 00002000:00010000:1.0:1746142913.367567:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67a680 00000100:00100000:0.0:1746142913.370885:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.371340:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867455232 00000100:00100000:3.0:1746142913.371347:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867455232 00000100:00100000:0.0:1746142913.371359:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.371386:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.371963:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867455360 00000100:00100000:3.0:1746142913.371967:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867455360 00000100:00100000:2.0:1746142913.372036:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867455616 00000100:00100000:3.0:1746142913.372039:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14441 00000100:00100000:2.0:1746142913.372040:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867455616 00000100:00100000:3.0:1746142913.372046:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2006:x1830962867455232:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142913.372050:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14442 00000100:00100000:0.0:1746142913.372056:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867455360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.372061:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142913.372066:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5276 00000100:00100000:2.0:1746142913.372071:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32512:x1830962867455616:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:3.0:1746142913.372074:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f0400/0x2fa243e067ccd64f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac70 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.372111:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867843456:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142913.372163:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.372205:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:32512:x1830962867455616:12345-192.168.204.50@tcp:35:cat.0 Request processed in 133us (817us total) trans 8589936631 rc 0/0 00000100:00100000:2.0:1746142913.372212:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5276 00010000:00010000:0.0:1746142913.372263:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142913.372279:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf15c00/0x2fa243e067ccd656 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac77 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142913.372302:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867843584:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142913.372336:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.374186:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867843456:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.374186:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867843584:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142913.374207:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0400/0x2fa243e067ccd64f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac70 expref: 57 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.374207:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf15c00/0x2fa243e067ccd656 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac77 expref: 48 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.374222:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0400/0x2fa243e067ccd64f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac70 expref: 57 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.374222:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf15c00/0x2fa243e067ccd656 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac77 expref: 48 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.374230:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0400, rc 0) 00010000:00010000:1.0:1746142913.374233:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf15c00, rc 0) 00000100:00100000:3.0:1746142913.374267:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2006:x1830962867455232:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2222us (3389us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.374271:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867455360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2215us (2911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142913.374274:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14441 00000100:00100000:1.0:1746142913.374278:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14442 00000100:00100000:0.0:1746142913.377848:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.377886:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.377974:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867455744 00000100:00100000:3.0:1746142913.377976:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867455872 00000100:00100000:3.0:1746142913.377981:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867455872 00000100:00100000:1.0:1746142913.377981:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867455744 00000100:00100000:3.0:1746142913.378019:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14443 00000100:00100000:3.0:1746142913.378025:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867455872:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1746142913.378027:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14444 00000100:00100000:1.0:1746142913.378032:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867455744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.378040:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.378040:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.378052:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd65d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac7e expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.378053:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b05fa00/0x2fa243e067ccd664 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac85 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.378089:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867843840:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.378089:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867843712:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142913.378156:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.378245:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.379065:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867843840:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142913.379081:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b05fa00/0x2fa243e067ccd664 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac85 expref: 48 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.379091:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b05fa00/0x2fa243e067ccd664 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac85 expref: 48 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.379098:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b05fa00, rc 0) 00000100:00100000:3.0:1746142913.379121:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867455872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1096us (1233us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142913.379126:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14443 00000100:00100000:1.0:1746142913.379337:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867843712:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.379350:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd65d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac7e expref: 57 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.379358:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd65d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac7e expref: 57 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.379368:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710c200, rc 0) 00000100:00100000:1.0:1746142913.379387:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867455744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1355us (1546us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.379392:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14444 00000100:00100000:0.0:1746142913.381786:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.381838:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867456128 00000100:00100000:2.0:1746142913.381848:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867456128 00000100:00100000:2.0:1746142913.381891:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5277 00000100:00100000:2.0:1746142913.381919:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32513:x1830962867456128:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142913.382127:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32513:x1830962867456128:12345-192.168.204.50@tcp:35:cat.0 Request processed in 230us (347us total) trans 8589936632 rc 0/0 00000100:00100000:2.0:1746142913.382132:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5277 00000100:00100000:2.0:1746142913.392942:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867843968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746142913.392993:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142913.393068:0:3103:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867843968 00000100:00100000:3.0:1746142913.393074:0:3103:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867843968 00000100:00080000:0.0:1746142913.393114:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746142913.393119:0:3103:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1746142913.393125:0:3103:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830962867843968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746142913.393225:0:3103:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1312452288 pending 9019392 free 3908063232 avail 3676540928 00000100:00100000:3.0:1746142913.393259:0:3103:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3765:x1830962867843968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.393265:0:3103:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1746142913.393369:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867843968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746142913.494585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.494694:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867456384 00000100:00100000:3.0:1746142913.494701:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867456384 00000100:00100000:3.0:1746142913.495088:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14464 00000100:00100000:3.0:1746142913.495096:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:32520:x1830962867456384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.495118:0:10924:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.495143:0:10924:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1600/0x2fa243e067ccd66b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac8c expref: -99 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.495201:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495212:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495221:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495231:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495235:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495240:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495321:0:10924:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495328:0:10924:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495334:0:10924:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00000004:00200000:3.0:1746142913.495341:0:10924:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.495399:0:10924:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495405:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495413:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495419:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495423:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.495431:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495437:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495445:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142913.495448:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.495450:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495455:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1000/0x2fa243e067ccd672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495477:0:10924:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495482:0:10924:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495487:0:10924:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495490:0:10924:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.495492:0:10924:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495500:0:10924:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495507:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462800) 00010000:00010000:3.0:1746142913.495509:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.495511:0:10924:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495516:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10924 initiator: MDT0 00010000:00010000:3.0:1746142913.495544:0:10924:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1600/0x2fa243e067ccd66b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.495552:0:10924:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 12 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.495558:0:10924:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.495560:0:10924:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142913.495562:0:10924:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0e00, rc 0) 00000100:00100000:3.0:1746142913.495606:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:32520:x1830962867456384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 511us (1030us total) trans 8589936633 rc 0/0 00000100:00100000:3.0:1746142913.495612:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14464 00000100:00100000:0.0:1746142913.502214:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.502556:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867456512 00000100:00100000:1.0:1746142913.502563:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867456512 00000100:00100000:1.0:1746142913.502608:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14445 00000100:00100000:1.0:1746142913.502616:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867456512:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.502631:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.502646:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd68e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac93 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.502818:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867844096:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.503454:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.506432:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867844096:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.506457:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd68e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac93 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.506468:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd68e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac93 expref: 25 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.506479:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710cc00, rc 0) 00000100:00100000:1.0:1746142913.506523:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867456512:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3907us (4316us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.506532:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14445 00000100:00100000:0.0:1746142913.517569:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.517612:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.518183:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.518783:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867456768 00000100:00100000:1.0:1746142913.518791:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867456768 00002000:00100000:1.0:1746142913.518828:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->647167) req@ffff88012e67b800 x1830962867456768/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.518836:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67b800 with x1830962867456768 ext(0->647167) 00002000:00010000:1.0:1746142913.518840:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67b800 00000100:00100000:1.0:1746142913.518855:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867457024 00000100:00100000:1.0:1746142913.518857:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867457024 00002000:00100000:1.0:1746142913.518867:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1540096->2097151) req@ffff88012d4c2300 x1830962867457024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.518873:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2300 with x1830962867457024 ext(1540096->2097151) 00002000:00010000:1.0:1746142913.518875:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c2300 00000100:00100000:1.0:1746142913.518883:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867457280 00000100:00100000:1.0:1746142913.518885:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867457280 00002000:00100000:1.0:1746142913.518893:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012d4c3800 x1830962867457280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.518914:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c3800 with x1830962867457280 ext(1048576->2097151) 00002000:00010000:1.0:1746142913.518916:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c3800 00000100:00100000:1.0:1746142913.518933:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4487 00000100:00100000:1.0:1746142913.518939:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867456768:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.518991:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4488 00000100:00100000:3.0:1746142913.518999:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+35:2006:x1830962867457024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.519290:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4489 00000100:00100000:2.0:1746142913.519300:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+36:2006:x1830962867457280:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142913.527476:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867456768:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8528us (9905us total) trans 0 rc 647168/647168 00000100:00100000:1.0:1746142913.527487:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4487 00002000:00100000:1.0:1746142913.527498:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->647167) req@ffff88012e67b800 x1830962867456768/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 647168/647168 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.527507:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67b800 with x1830962867456768 ext(0->647167) 00002000:00010000:1.0:1746142913.527512:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67b800 00000100:00100000:3.0:1746142913.527809:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+36:2006:x1830962867457024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8810us (10195us total) trans 0 rc 557056/557056 00000100:00100000:3.0:1746142913.527816:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4488 00002000:00100000:3.0:1746142913.527822:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1540096->2097151) req@ffff88012d4c2300 x1830962867457024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 557056/557056 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.527829:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2300 with x1830962867457024 ext(1540096->2097151) 00002000:00010000:3.0:1746142913.527832:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c2300 00000100:00100000:2.0:1746142913.533794:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867457280:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14488us (15603us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.533805:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4489 00002000:00100000:2.0:1746142913.533816:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012d4c3800 x1830962867457280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.533825:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c3800 with x1830962867457280 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.533830:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c3800 00000100:00100000:0.0:1746142913.544298:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.544355:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867457408 00000100:00100000:1.0:1746142913.544363:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867457408 00000100:00100000:1.0:1746142913.544410:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14446 00000100:00100000:1.0:1746142913.544416:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:32520:x1830962867457408:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.544430:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.544445:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ac9a expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.544467:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 55 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.544474:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142913.544476:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142913.544479:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.544501:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 55 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.544511:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 55 pid: 1852 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.544521:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867844224:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.544600:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.546922:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.546939:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867844224:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.546961:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 25 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.546976:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710c200, rc 0) 00000100:00100000:1.0:1746142913.547007:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:32520:x1830962867457408:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2590us (2716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.547015:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14446 00000100:00100000:2.0:1746142913.547062:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867457536 00000100:00100000:2.0:1746142913.547067:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867457536 00002000:00100000:2.0:1746142913.547102:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2027519) req@ffff88012d4c0000 x1830962867457536/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.547110:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0000 with x1830962867457536 ext(1048576->2027519) 00010000:00010000:2.0:1746142913.547116:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 56 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.547127:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 56 pid: 1852 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746142913.547133:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d4c0000 00000100:00100000:2.0:1746142913.547753:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1390 00000100:00100000:2.0:1746142913.547760:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867457536:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142913.554964:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2005:x1830962867457536:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7195us (8039us total) trans 21474841228 rc 0/0 00000100:00100000:2.0:1746142913.554974:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1390 00002000:00100000:2.0:1746142913.554984:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2027519) req@ffff88012d4c0000 x1830962867457536/t21474841228(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.554993:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c0000 with x1830962867457536 ext(1048576->2027519) 00010000:00010000:2.0:1746142913.555002:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.555016:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746142913.555022:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d4c0000 00000100:00100000:0.0:1746142913.558426:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.558487:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867457664 00000100:00100000:3.0:1746142913.558495:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867457664 00010000:00010000:3.0:1746142913.558524:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.558561:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6517 00000100:00100000:3.0:1746142913.558568:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2003:x1830962867457664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.558578:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.558593:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.558603:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.558621:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6000/0x2fa243e067ccd61e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2027519) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac3f expref: 58 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.558647:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.558650:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.558655:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.558663:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.558694:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 24 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.558704:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867844352:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.558780:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.560938:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867844352:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.560952:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.561589:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2003:x1830962867457664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3019us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.561598:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6517 00000100:00100000:0.0:1746142913.562567:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.562629:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867457920 00000100:00100000:2.0:1746142913.562635:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867457920 00002000:00100000:2.0:1746142913.562665:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012d4c2a00 x1830962867457920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.562675:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2a00 with x1830962867457920 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.562679:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c2a00 00000100:00100000:2.0:1746142913.562708:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4490 00000100:00100000:2.0:1746142913.562715:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867457920:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.568042:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867457920:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5319us (5470us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.568052:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4490 00002000:00100000:2.0:1746142913.568062:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012d4c2a00 x1830962867457920/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.568071:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2a00 with x1830962867457920 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.568076:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c2a00 00000100:00100000:0.0:1746142913.576291:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.576379:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867458176 00000100:00100000:2.0:1746142913.576386:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867458176 00002000:00100000:2.0:1746142913.576426:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012d4c2d80 x1830962867458176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.576440:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2d80 with x1830962867458176 ext(2097152->3145727) 00002000:00010000:2.0:1746142913.576445:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c2d80 00000100:00100000:2.0:1746142913.576473:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4491 00000100:00100000:2.0:1746142913.576481:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867458176:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.583268:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.583453:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.583610:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867458432 00000100:00100000:3.0:1746142913.583618:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867458432 00000100:00100000:3.0:1746142913.583662:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867458688 00000100:00100000:3.0:1746142913.583665:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867458688 00000100:00100000:3.0:1746142913.583691:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14465 00000100:00100000:3.0:1746142913.583698:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:32523:x1830962867458432:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.583718:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.583732:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6800/0x2fa243e067ccd69c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aca1 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.583758:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867458176:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7277us (7472us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.583766:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4491 00002000:00100000:2.0:1746142913.583775:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012d4c2d80 x1830962867458176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746142913.583775:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14466 00002000:00100000:2.0:1746142913.583782:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2d80 with x1830962867458176 ext(2097152->3145727) 00000100:00100000:1.0:1746142913.583784:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32524:x1830962867458688:12345-192.168.204.50@tcp:101:multiop.0 00002000:00010000:2.0:1746142913.583787:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d4c2d80 00010000:00010000:1.0:1746142913.583794:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.583801:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d200/0x2fa243e067ccd6a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aca8 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.583808:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.583819:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.583829:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142913.583838:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.583846:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.583851:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.583855:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.583860:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 13 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.583865:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142913.583870:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867844480:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.583870:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.583879:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142913.583949:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864db40 going to sleep for 11 seconds 00010000:00010000:1.0:1746142913.583961:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.583968:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.583974:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142913.583980:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142913.584036:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584042:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584047:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584051:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009710cc00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142913.584054:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584060:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584069:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142913.584071:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142913.584074:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584157:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710cc00/0x2fa243e067ccd6b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584243:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584248:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584253:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584257:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009710d600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142913.584260:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584264:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584271:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009713a200) 00010000:00010000:1.0:1746142913.584273:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142913.584275:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584280:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d600/0x2fa243e067ccd6b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.584557:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009710d200/0x2fa243e067ccd6a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 32 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.584568:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 31 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.584578:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142913.584580:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142913.584582:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf15c00, rc 0) 00000100:00100000:1.0:1746142913.584603:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32524:x1830962867458688:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 821us (1150us total) trans 8589936634 rc 0/0 00000100:00100000:1.0:1746142913.584609:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14466 00000100:00100000:0.0:1746142913.585658:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.585825:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867844480:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.585840:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142913.586370:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867458816 00000100:00100000:2.0:1746142913.586376:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867458816 00010000:00010000:2.0:1746142913.586396:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 14 pid: 10924 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.586536:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6518 00000100:00100000:2.0:1746142913.586542:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867458816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.586551:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.586555:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 14 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.586563:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 14 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.586581:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd680 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac8c expref: 14 pid: 10924 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.586604:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.586608:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142913.586621:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142913.586625:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142913.586642:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.586667:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867458816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 125us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.586672:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6518 00010000:00010000:3.0:1746142913.586816:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.586823:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142913.586836:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.587168:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6800/0x2fa243e067ccd69c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 14 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.587194:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.587200:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.587202:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142913.587204:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e7e00, rc 0) 00000100:00100000:3.0:1746142913.587271:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:32523:x1830962867458432:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3572us (4011us total) trans 8589936635 rc 0/0 00000100:00100000:3.0:1746142913.587278:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14465 00000100:00100000:1.0:1746142913.591011:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.591054:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.591066:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867458944 00000100:00100000:2.0:1746142913.591074:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867458944 00000100:00100000:2.0:1746142913.591118:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867459072 00000100:00100000:2.0:1746142913.591121:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867459072 00000100:00100000:2.0:1746142913.591142:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14447 00000100:00100000:2.0:1746142913.591149:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:32523:x1830962867458944:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142913.591163:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142913.591168:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14448 00010000:00010000:2.0:1746142913.591177:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acaf expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.591201:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.591214:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 46 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.591220:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.591226:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.591228:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746142913.591229:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:32524:x1830962867459072:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142913.591232:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3739648->3813375] (req 3739648->3813375) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.591237:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142913.591246:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acb6 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.591256:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142913.591261:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.591266:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.591266:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142913.591267:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142913.591270:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [937984->1048575] (req 937984->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 58 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.591275:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867844608:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142913.591285:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.591294:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 24 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746142913.591319:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867844736:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.591359:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 46 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142913.591359:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433240 going to sleep for 11 seconds 00010000:00010000:2.0:1746142913.591366:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 46 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746142913.591372:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867844864:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.591400:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.591406:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 14 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746142913.591412:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867844992:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.591422:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.591426:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.591497:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867459328 00000100:00100000:2.0:1746142913.591500:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867459328 00000100:00100000:2.0:1746142913.591529:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5278 00000100:00100000:2.0:1746142913.591534:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:32520:x1830962867459328:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142913.591709:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:32520:x1830962867459328:12345-192.168.204.50@tcp:35:cat.0 Request processed in 173us (286us total) trans 8589936636 rc 0/0 00000100:00100000:2.0:1746142913.591715:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5278 00000100:00100000:0.0:1746142913.594571:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.594594:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d4c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867844736:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.594614:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [937984->1048575] (req 937984->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 58 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.594625:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3b4000, rc 0) 00000100:00100000:2.0:1746142913.594631:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867844608:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.594637:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867844864:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.594641:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867844992:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.594654:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3739648->3813375] (req 3739648->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.595011:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1000, rc 0) 00000100:00100000:2.0:1746142913.595038:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+35:32523:x1830962867458944:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3889us (4034us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.595041:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32524:x1830962867459072:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3865us (3986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.595047:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14447 00000100:00100000:0.0:1746142913.595069:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.595094:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14448 00000100:00100000:3.0:1746142913.595098:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867459456 00000100:00100000:3.0:1746142913.595103:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867459456 00002000:00100000:3.0:1746142913.595131:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (647168->1048575) req@ffff88012d4c1500 x1830962867459456/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.595139:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c1500 with x1830962867459456 ext(647168->1048575) 00010000:00010000:3.0:1746142913.595144:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.595153:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.595153:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867459712 00000100:00100000:1.0:1746142913.595156:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867459712 00002000:00010000:3.0:1746142913.595158:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d4c1500 00010000:00010000:1.0:1746142913.595172:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 15 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746142913.595202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.595341:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1391 00000100:00100000:3.0:1746142913.595347:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:2004:x1830962867459456:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142913.595397:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867459584 00000100:00100000:1.0:1746142913.595400:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867459584 00000100:00100000:2.0:1746142913.595402:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6519 00000100:00100000:2.0:1746142913.595407:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867459712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142913.595411:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746142913.595412:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142913.595417:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142913.595429:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867459840 00000100:00100000:1.0:1746142913.595431:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867459840 00010000:00010000:2.0:1746142913.595434:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 15 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746142913.595439:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 47 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:1.0:1746142913.595450:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6520 00000100:00100000:1.0:1746142913.595455:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+35:2003:x1830962867459584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142913.595461:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142913.595467:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6521 00010000:00010000:1.0:1746142913.595469:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.595472:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 15 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.595473:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867459840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.595479:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142913.595535:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.595544:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 47 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:1.0:1746142913.595554:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715e00/0x2fa243e067ccd5df lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac07 expref: 35 pid: 1852 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.595559:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 47 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.595559:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800923f2a00/0x2fa243e067ccd4c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab9e expref: 15 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.595569:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.595570:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4c000/0x2fa243e067ccd5ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac15 expref: 47 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.595571:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.595576:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.595583:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.595590:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142913.595590:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142913.595604:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.595608:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867459840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 136us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.595608:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867459584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 152us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.595612:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6521 00000100:00100000:2.0:1746142913.595613:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867845120:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142913.595616:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6520 00000100:00100000:2.0:1746142913.595649:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.597788:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.598116:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867460096 00000100:00100000:2.0:1746142913.598122:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867460096 00002000:00100000:2.0:1746142913.598147:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (3739648->3743743) req@ffff88012d4c2680 x1830962867460096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.598156:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2680 with x1830962867460096 ext(3739648->3743743) 00002000:00010000:2.0:1746142913.598160:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c2680 00000100:00100000:2.0:1746142913.598182:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4492 00000100:00100000:2.0:1746142913.598189:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867460096:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142913.598281:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867460096:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 93us (497us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142913.598287:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4492 00002000:00100000:2.0:1746142913.598292:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (3739648->3743743) req@ffff88012d4c2680 x1830962867460096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.598299:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c2680 with x1830962867460096 ext(3739648->3743743) 00002000:00010000:2.0:1746142913.598301:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d4c2680 00000100:00100000:2.0:1746142913.598341:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867845120:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142913.598352:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.598381:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867459712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2974us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.598387:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6519 00000100:00100000:0.0:1746142913.599754:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867459456:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4404us (5184us total) trans 21474841229 rc 0/0 00000100:00100000:0.0:1746142913.599762:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1391 00002000:00100000:0.0:1746142913.599768:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (647168->1048575) req@ffff88012d4c1500 x1830962867459456/t21474841229(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142913.599775:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d4c1500 with x1830962867459456 ext(647168->1048575) 00010000:00010000:0.0:1746142913.599782:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 27 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.599795:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 27 pid: 11943 timeout: 787 lvb_type: 0 00002000:00010000:0.0:1746142913.599801:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d4c1500 00000100:00100000:1.0:1746142913.599824:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.600009:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867460352 00000100:00100000:3.0:1746142913.600014:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867460352 00000100:00100000:3.0:1746142913.600037:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14467 00000100:00100000:3.0:1746142913.600042:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32528:x1830962867460352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142913.600054:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.600066:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6e00/0x2fa243e067ccd6e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acbd expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.600119:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600129:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600138:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600147:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600152:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600161:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600224:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7200/0x2fa243e067ccd6f7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600232:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7200/0x2fa243e067ccd6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600237:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7200/0x2fa243e067ccd6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142913.600244:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.600284:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600290:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600295:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600300:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600305:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6e6600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.600321:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600328:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600336:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142913.600338:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.600342:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600347:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6600/0x2fa243e067ccd6e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600355:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600359:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600364:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600368:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6e6200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.600370:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600374:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600379:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a3878e00) 00010000:00010000:3.0:1746142913.600381:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.600383:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600388:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6200/0x2fa243e067ccd6f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.600414:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e6e00/0x2fa243e067ccd6e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acbd expref: 34 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.600423:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7200/0x2fa243e067ccd6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acbd expref: 33 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.600429:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.600431:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142913.600433:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e7200, rc 0) 00000100:00100000:3.0:1746142913.600455:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32528:x1830962867460352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 413us (633us total) trans 8589936637 rc 0/0 00000100:00100000:3.0:1746142913.600461:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14467 00000001:00080000:1.0:1746142913.602101:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841229 is committed 00000001:00080000:1.0:1746142913.602111:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841228 is committed 00000001:00080000:1.0:1746142913.602116:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841227 is committed 00000001:00080000:1.0:1746142913.602138:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841211 is committed 00000100:00100000:0.0:1746142913.602174:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.602209:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.602236:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867460608 00000100:00100000:0.0:1746142913.602241:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867460608 00000100:00100000:2.0:1746142913.602247:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867460736 00000100:00100000:2.0:1746142913.602250:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867460736 00002000:00100000:0.0:1746142913.602266:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3809280->3813375) req@ffff880088f19f80 x1830962867460608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746142913.602272:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 770 00002000:00100000:0.0:1746142913.602275:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f19f80 with x1830962867460608 ext(3809280->3813375) 00000100:00100000:2.0:1746142913.602276:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867460736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1746142913.602278:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f19f80 00010000:00010000:2.0:1746142913.602282:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142913.602290:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4493 00010000:00010000:2.0:1746142913.602294:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7200/0x2fa243e067ccd6f7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acbd expref: 33 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142913.602295:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867460608:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:2.0:1746142913.602301:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.602304:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.602343:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867460736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.602349:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 770 00000100:00100000:0.0:1746142913.602389:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867460608:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 93us (218us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142913.602395:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4493 00002000:00100000:0.0:1746142913.602399:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3809280->3813375) req@ffff880088f19f80 x1830962867460608/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142913.602405:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f19f80 with x1830962867460608 ext(3809280->3813375) 00002000:00010000:0.0:1746142913.602408:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f19f80 00000100:00100000:0.0:1746142913.602813:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.602869:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867460864 00000100:00100000:3.0:1746142913.602873:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867460864 00010000:00010000:3.0:1746142913.602887:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 8 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.602928:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6522 00000100:00100000:3.0:1746142913.602934:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867460864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.602941:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142913.602951:0:7218:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142913 -> 1746142914 00010000:00010000:3.0:1746142913.602956:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 8 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.602965:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 8 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.602979:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009710d400/0x2fa243e067ccd617 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 647168->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac38 expref: 8 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.602988:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.602990:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.602996:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 21 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.603002:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 21 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.603025:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 21 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.603035:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867845248:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.603096:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.603225:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.603246:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867460992 00000100:00100000:1.0:1746142913.603249:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867460992 00000100:00100000:1.0:1746142913.603270:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14449 00000100:00100000:1.0:1746142913.603275:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2006:x1830962867460992:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.603283:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.603291:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f0600/0x2fa243e067ccd705 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acc4 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.603328:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867845376:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.603353:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.603734:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.603759:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.603785:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.603800:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867461248 00000100:00100000:2.0:1746142913.603803:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867461248 00000100:00100000:3.0:1746142913.603807:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867461120 00000100:00100000:3.0:1746142913.603810:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867461120 00000100:00100000:2.0:1746142913.603822:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867461376 00000100:00100000:2.0:1746142913.603824:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867461376 00000100:00100000:2.0:1746142913.603838:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14450 00000100:00100000:2.0:1746142913.603842:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867461248:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142913.603844:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14451 00010000:00010000:2.0:1746142913.603848:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142913.603850:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867461120:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.603854:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acd2 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.603857:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.603863:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.603864:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.603868:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7800/0x2fa243e067ccd713 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8accb expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.603868:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 25 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.603877:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 25 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.603884:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc29c00, rc 0) 00000100:00100000:3.0:1746142913.603890:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867845504:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.603916:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867461248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.603921:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14450 00000100:00100000:1.0:1746142913.603926:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14452 00000100:00100000:1.0:1746142913.603931:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867461376:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142913.603932:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d300 going to sleep for 11 seconds 00010000:00010000:1.0:1746142913.603938:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.603944:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccd71a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acd9 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.603963:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867845632:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.603985:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.604876:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867845376:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.604893:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0600/0x2fa243e067ccd705 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acc4 expref: 24 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.604919:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0600/0x2fa243e067ccd705 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acc4 expref: 24 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.604933:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0600, rc 0) 00000100:00100000:3.0:1746142913.604941:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867845248:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.604950:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142913.604951:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867460992:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1676us (1727us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.604956:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14449 00000100:00100000:3.0:1746142913.604962:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867460864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2029us (2150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.604967:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6522 00002000:00010000:2.0:1746142913.605132:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142913 -> 1746142914 00002000:00010000:2.0:1746142913.605135:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142913 -> 1746142914 00002000:00010000:2.0:1746142913.605137:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142913 -> 1746142914 00000100:00100000:2.0:1746142913.605146:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867845504:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142913.605161:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7800/0x2fa243e067ccd713 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8accb expref: 49 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.605168:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7800/0x2fa243e067ccd713 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8accb expref: 49 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.605175:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e6e7800, rc 0) 00000100:00100000:2.0:1746142913.605187:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867461120:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1338us (1429us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142913.605191:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14451 00002000:00010000:1.0:1746142913.605241:0:11421:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142913 -> 1746142914 00002000:00010000:1.0:1746142913.605243:0:11421:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142913 -> 1746142914 00002000:00010000:1.0:1746142913.605245:0:11421:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142913 -> 1746142914 00000100:00100000:1.0:1746142913.605252:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867845632:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.605267:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccd71a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd9 expref: 47 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.605274:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccd71a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd9 expref: 47 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.605280:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0400, rc 0) 00000100:00100000:1.0:1746142913.605295:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867461376:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1364us (1509us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.605300:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14452 00000100:00100000:0.0:1746142913.611064:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.611151:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867461632 00000100:00100000:2.0:1746142913.611159:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867461632 00002000:00100000:2.0:1746142913.611203:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (937984->942079) req@ffff880088f1b100 x1830962867461632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.611212:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1b100 with x1830962867461632 ext(937984->942079) 00002000:00010000:2.0:1746142913.611217:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f1b100 00000100:00100000:2.0:1746142913.611235:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4494 00000100:00100000:2.0:1746142913.611243:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867461632:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142913.611620:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867461632:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 377us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142913.611626:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4494 00002000:00100000:2.0:1746142913.611631:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (937984->942079) req@ffff880088f1b100 x1830962867461632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.611638:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1b100 with x1830962867461632 ext(937984->942079) 00002000:00010000:2.0:1746142913.611640:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f1b100 00000100:00100000:0.0:1746142913.613202:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.613270:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867461888 00000100:00100000:2.0:1746142913.613275:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867461888 00002000:00100000:2.0:1746142913.613294:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880088f18380 x1830962867461888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 504/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.613387:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18380 with x1830962867461888 ext(0->1048575) 00002000:00010000:2.0:1746142913.613390:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18380 00000100:00100000:2.0:1746142913.613564:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4495 00000100:00100000:2.0:1746142913.613570:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867461888:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.620186:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867461888:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6609us (6979us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746142913.620196:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4495 00002000:00100000:2.0:1746142913.620205:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880088f18380 x1830962867461888/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 504/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.620214:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18380 with x1830962867461888 ext(0->1048575) 00002000:00010000:2.0:1746142913.620219:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18380 00000100:00100000:0.0:1746142913.624686:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.624984:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867462016 00000100:00100000:1.0:1746142913.624992:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867462016 00000100:00100000:1.0:1746142913.625031:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14453 00000100:00100000:1.0:1746142913.625038:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32524:x1830962867462016:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142913.625052:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.625065:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ace0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.625089:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.625095:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142913.625097:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142913.625100:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->1122303] (req 1048576->1122303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 47 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.625123:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.625133:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 33 pid: 11421 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.625143:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867845760:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.625807:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.626419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.626630:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867462144 00000100:00100000:2.0:1746142913.626638:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867462144 00000100:00100000:2.0:1746142913.626922:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14454 00000100:00100000:2.0:1746142913.626930:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32528:x1830962867462144:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.626940:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.626951:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ace7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.626966:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142913.626970:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1122303] (req 1048576->1122303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 49 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.626976:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746142913.626979:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 49 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.627001:0:1854:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->1122303] (req 1048576->1122303) gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 49 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.627011:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 49 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.627061:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867845760:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.627077:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1122303] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 49 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.627086:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1c00, rc 0) 00000100:00100000:1.0:1746142913.627113:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32524:x1830962867462016:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2075us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.627118:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14453 00010000:00010000:2.0:1746142913.627164:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc29000, rc 0) 00000100:00100000:2.0:1746142913.627180:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32528:x1830962867462144:12345-192.168.204.50@tcp:101:cat.0 Request processed in 251us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.627184:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14454 00000100:00100000:0.0:1746142913.627631:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.627676:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867462272 00000100:00100000:2.0:1746142913.627679:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867462272 00002000:00100000:2.0:1746142913.627699:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1540095) req@ffff880088f1b480 x1830962867462272/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.627707:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1b480 with x1830962867462272 ext(1048576->1540095) 00010000:00010000:2.0:1746142913.627712:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 34 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.627722:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 34 pid: 11421 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746142913.627727:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088f1b480 00000100:00100000:2.0:1746142913.627749:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1392 00000100:00100000:2.0:1746142913.627754:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867462272:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142913.630941:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+36:2005:x1830962867462272:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 3179us (3302us total) trans 17179873969 rc 0/0 00000100:00100000:0.0:1746142913.630951:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1392 00002000:00100000:0.0:1746142913.630961:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1540095) req@ffff880088f1b480 x1830962867462272/t17179873969(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142913.630969:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1b480 with x1830962867462272 ext(1048576->1540095) 00010000:00010000:0.0:1746142913.630977:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 36 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.630988:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 36 pid: 11421 timeout: 787 lvb_type: 0 00002000:00010000:0.0:1746142913.630998:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088f1b480 00000001:00080000:0.0:1746142913.631247:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873969 is committed 00000001:00080000:0.0:1746142913.631253:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873968 is committed 00000001:00080000:0.0:1746142913.631276:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873950 is committed 00000001:00080000:0.0:1746142913.631295:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873935 is committed 00000100:00100000:0.0:1746142913.634083:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.634152:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867462400 00000100:00100000:3.0:1746142913.634160:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867462400 00010000:00010000:3.0:1746142913.634188:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 8 pid: 11421 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.634227:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6523 00000100:00100000:3.0:1746142913.634233:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867462400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.634246:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.634261:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 8 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.634272:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 8 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.634291:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed0600/0x2fa243e067ccd62c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac4d expref: 8 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.634323:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.634325:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.634331:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.634338:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.634366:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 25 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.634381:0:7218:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 25 pid: 11421 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.634391:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867846016:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.635509:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.638571:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867846016:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.638590:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.638627:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867462400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4392us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.638636:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6523 00000100:00100000:0.0:1746142913.639032:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.639168:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867462656 00000100:00100000:1.0:1746142913.639174:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867462656 00002000:00100000:1.0:1746142913.639204:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1118208->1122303) req@ffff880088f18e00 x1830962867462656/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.639213:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18e00 with x1830962867462656 ext(1118208->1122303) 00010000:00010000:1.0:1746142913.639220:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 26 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.639230:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 26 pid: 11421 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.639236:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088f18e00 00000100:00100000:1.0:1746142913.639248:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1393 00000100:00100000:1.0:1746142913.639254:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867462656:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142913.639363:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867462656:12345-192.168.204.50@tcp:3:cat.0 Request processed in 109us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142913.639368:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1393 00002000:00100000:1.0:1746142913.639373:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1118208->1122303) req@ffff880088f18e00 x1830962867462656/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.639379:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18e00 with x1830962867462656 ext(1118208->1122303) 00010000:00010000:1.0:1746142913.639383:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 26 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.639391:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 26 pid: 11421 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.639396:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088f18e00 00000100:00100000:0.0:1746142913.648097:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.648177:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867463168 00000100:00100000:3.0:1746142913.648185:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867463168 00000100:00100000:0.0:1746142913.648190:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.648228:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5279 00000100:00100000:3.0:1746142913.648235:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4850050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32524:x1830962867463168:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142913.648410:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867462912 00000100:00100000:1.0:1746142913.648414:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867462912 00002000:00100000:1.0:1746142913.648439:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1122303) req@ffff880088f19180 x1830962867462912/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.648452:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f19180 with x1830962867462912 ext(1048576->1122303) 00010000:00010000:1.0:1746142913.648462:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 26 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.648477:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 26 pid: 11421 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.648485:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088f19180 00000100:00100000:1.0:1746142913.648498:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1394 00000100:00100000:1.0:1746142913.648503:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867462912:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142913.649814:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4850050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32524:x1830962867463168:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 1574us (1718us total) trans 8589936638 rc 0/0 00000100:00100000:3.0:1746142913.649823:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5279 00000100:00100000:1.0:1746142913.658765:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867462912:12345-192.168.204.50@tcp:4:cat.0 Request processed in 10253us (10566us total) trans 17179873970 rc 0/0 00000100:00100000:1.0:1746142913.658776:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1394 00002000:00100000:1.0:1746142913.658787:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1122303) req@ffff880088f19180 x1830962867462912/t17179873970(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.658795:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f19180 with x1830962867462912 ext(1048576->1122303) 00010000:00010000:1.0:1746142913.658804:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 28 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.658816:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 28 pid: 11421 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.658828:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880088f19180 00000100:00100000:0.0:1746142913.661136:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.663140:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867463296 00000100:00100000:3.0:1746142913.663151:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867463296 00010000:00010000:3.0:1746142913.663185:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 28 pid: 11421 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.663542:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6524 00000100:00100000:3.0:1746142913.663549:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867463296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.663561:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.663577:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 28 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.663587:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 28 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.663604:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccd721 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1122303) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace0 expref: 28 pid: 11421 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.664146:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.664149:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.664155:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.664163:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.664191:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.664201:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867846144:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.664772:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.665438:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867846144:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.665449:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.665472:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867463296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1924us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.665479:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6524 00000100:00100000:0.0:1746142913.675522:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.675558:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.675593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.675689:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867463808 00000100:00100000:1.0:1746142913.675697:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867463808 00002000:00100000:1.0:1746142913.675732:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088f18700 x1830962867463808/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.675741:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18700 with x1830962867463808 ext(1048576->2097151) 00002000:00010000:1.0:1746142913.675746:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18700 00000100:00100000:1.0:1746142913.675759:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867463680 00000100:00100000:1.0:1746142913.675761:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867463680 00002000:00100000:1.0:1746142913.675770:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880088f1ad80 x1830962867463680/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.675776:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1ad80 with x1830962867463680 ext(1048576->2097151) 00002000:00010000:1.0:1746142913.675779:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f1ad80 00000100:00100000:1.0:1746142913.675785:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867463936 00000100:00100000:1.0:1746142913.675787:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867463936 00002000:00100000:1.0:1746142913.675793:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088f19c00 x1830962867463936/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.675799:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f19c00 with x1830962867463936 ext(1048576->2097151) 00002000:00010000:1.0:1746142913.675801:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f19c00 00000100:00100000:1.0:1746142913.675825:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4496 00000100:00100000:1.0:1746142913.675832:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867463808:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142913.675881:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4497 00000100:00100000:2.0:1746142913.675888:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867463680:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.676450:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4498 00000100:00100000:3.0:1746142913.676456:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867463936:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.685145:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867463680:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9249us (9577us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142913.685155:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4497 00002000:00100000:3.0:1746142913.685165:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880088f1ad80 x1830962867463680/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.685173:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f1ad80 with x1830962867463680 ext(1048576->2097151) 00002000:00010000:3.0:1746142913.685178:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f1ad80 00000100:00100000:1.0:1746142913.697499:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867463808:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21658us (21974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142913.697510:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4496 00002000:00100000:1.0:1746142913.697521:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880088f18700 x1830962867463808/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.697531:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18700 with x1830962867463808 ext(1048576->2097151) 00002000:00010000:1.0:1746142913.697536:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18700 00000100:00100000:2.0:1746142913.698444:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867463936:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21986us (22848us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142913.698451:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4498 00002000:00100000:2.0:1746142913.698456:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880088f19c00 x1830962867463936/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.698464:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f19c00 with x1830962867463936 ext(1048576->2097151) 00002000:00010000:2.0:1746142913.698467:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088f19c00 00000100:00100000:0.0:1746142913.718609:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.718697:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867464320 00000100:00100000:2.0:1746142913.718705:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867464320 00002000:00100000:2.0:1746142913.718741:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880088f18000 x1830962867464320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.718755:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18000 with x1830962867464320 ext(2097152->3145727) 00002000:00010000:2.0:1746142913.718760:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18000 00000100:00100000:1.0:1746142913.719047:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4499 00000100:00100000:1.0:1746142913.719056:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867464320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142913.730502:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867464320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11440us (11891us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142913.730512:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4499 00002000:00100000:1.0:1746142913.730522:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880088f18000 x1830962867464320/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.730531:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088f18000 with x1830962867464320 ext(2097152->3145727) 00002000:00010000:1.0:1746142913.730536:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088f18000 00000100:00100000:0.0:1746142913.736394:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.736482:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867464448 00000100:00100000:2.0:1746142913.736490:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867464448 00000100:00100000:2.0:1746142913.736733:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14455 00000100:00100000:2.0:1746142913.736741:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32528:x1830962867464448:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.736757:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.736771:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acee expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.736795:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 6 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.736802:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142913.736804:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142913.736807:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.736830:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 6 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.736840:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 6 pid: 1852 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.736850:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867846272:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.738757:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.739207:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867846272:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.739229:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.739242:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe5600, rc 0) 00000100:00100000:0.0:1746142913.739801:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.739824:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088f19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32528:x1830962867464448:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3083us (3436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.739831:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14455 00000100:00100000:1.0:1746142913.740229:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867464576 00000100:00100000:1.0:1746142913.740235:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867464576 00002000:00100000:1.0:1746142913.740266:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3739648->3813375) req@ffff880096097b80 x1830962867464576/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.740274:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096097b80 with x1830962867464576 ext(3739648->3813375) 00010000:00010000:1.0:1746142913.740281:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 7 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.740292:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 7 pid: 1852 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.740297:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096097b80 00000100:00100000:1.0:1746142913.740329:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1395 00000100:00100000:1.0:1746142913.740336:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867464576:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142913.742391:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867464576:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 2051us (2587us total) trans 17179873971 rc 0/0 00000100:00100000:1.0:1746142913.742398:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1395 00002000:00100000:1.0:1746142913.742405:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3739648->3813375) req@ffff880096097b80 x1830962867464576/t17179873971(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.742413:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096097b80 with x1830962867464576 ext(3739648->3813375) 00010000:00010000:1.0:1746142913.742419:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 9 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.742430:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 9 pid: 1852 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.742437:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096097b80 00000100:00100000:0.0:1746142913.747623:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.748438:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867464704 00000100:00100000:3.0:1746142913.748446:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867464704 00010000:00010000:3.0:1746142913.748475:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 9 pid: 1852 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.748512:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6525 00000100:00100000:3.0:1746142913.748519:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867464704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.748530:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.748546:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 9 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.748558:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 9 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.748582:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ed1000/0x2fa243e067ccd6d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3739648->3813375) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acaf expref: 9 pid: 1852 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.748775:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.748778:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.748785:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.748792:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.748818:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.748829:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867846400:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.748914:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.752388:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867846400:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.752404:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.752454:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867464704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3934us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.752462:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6525 00000100:00100000:0.0:1746142913.754503:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.754554:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867464960 00000100:00100000:1.0:1746142913.754561:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867464960 00002000:00100000:1.0:1746142913.754589:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096095f80 x1830962867464960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.754596:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096095f80 with x1830962867464960 ext(2097152->4194303) 00002000:00010000:1.0:1746142913.754599:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096095f80 00000100:00100000:1.0:1746142913.754621:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4500 00000100:00100000:1.0:1746142913.754625:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867464960:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142913.765045:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867464960:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10409us (10537us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142913.765056:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4500 00002000:00100000:1.0:1746142913.765065:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096095f80 x1830962867464960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.765073:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096095f80 with x1830962867464960 ext(2097152->4194303) 00002000:00010000:1.0:1746142913.765078:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096095f80 00000100:00100000:0.0:1746142913.772932:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.773136:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867465216 00000100:00100000:1.0:1746142913.773149:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867465216 00000100:00100000:1.0:1746142913.773196:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14468 00000100:00100000:1.0:1746142913.773202:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32533:x1830962867465216:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142913.773220:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.773237:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acf5 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.773293:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773315:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773325:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773335:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773340:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773345:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773418:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd74b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773427:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd74b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.773432:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd74b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142913.773439:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142913.774646:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774654:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774659:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774663:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142913.774666:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774670:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774679:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142913.774681:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142913.774684:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774688:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0c00/0x2fa243e067ccd73d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774715:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774719:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774722:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774726:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142913.774728:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774731:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774736:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a7619300) 00010000:00010000:1.0:1746142913.774738:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142913.774739:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774743:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.774773:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acf5 expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.774781:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd74b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acf5 expref: 35 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.774786:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142913.774788:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142913.774790:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0a00, rc 0) 00000100:00100000:1.0:1746142913.774829:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32533:x1830962867465216:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1626us (1935us total) trans 8589936639 rc 0/0 00000100:00100000:1.0:1746142913.774835:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14468 00000100:00100000:0.0:1746142913.775499:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.775538:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867465472 00000100:00100000:3.0:1746142913.775545:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867465472 00000100:00100000:3.0:1746142913.775572:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5280 00000100:00100000:3.0:1746142913.775578:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32528:x1830962867465472:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142913.775711:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32528:x1830962867465472:12345-192.168.204.50@tcp:35:cat.0 Request processed in 132us (213us total) trans 8589936640 rc 0/0 00000100:00100000:3.0:1746142913.775716:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5280 00000100:00100000:0.0:1746142913.777568:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.777681:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867465600 00000100:00100000:3.0:1746142913.777688:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867465600 00000100:00100000:2.0:1746142913.777755:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 771 00000100:00100000:2.0:1746142913.777763:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867465600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.777776:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.777799:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd74b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acf5 expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.777832:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.777836:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.777869:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2003:x1830962867465600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.777880:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 771 00000100:00100000:0.0:1746142913.791451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.791817:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867465728 00000100:00100000:1.0:1746142913.791825:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867465728 00000100:00100000:1.0:1746142913.792369:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14469 00000100:00100000:1.0:1746142913.792377:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+6:32534:x1830962867465728:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142913.792395:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.792412:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccd759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8acfc expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.792458:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792467:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792475:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792484:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792488:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792492:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792540:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792549:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.792554:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142913.792576:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.792585:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 13 pid: 7232 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.792593:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867846528:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.794128:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.803276:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.803396:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867465984 00000100:00100000:2.0:1746142913.803407:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867465984 00000100:00100000:2.0:1746142913.803476:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5281 00000100:00100000:2.0:1746142913.803484:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:16318:x1830962867465984:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142913.803666:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:16318:x1830962867465984:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 184us (400us total) trans 8589936641 rc 0/0 00000100:00100000:2.0:1746142913.803676:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5281 00000100:00100000:1.0:1746142913.803881:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867846528:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.803935:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142913.807844:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.807938:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867466112 00000100:00100000:3.0:1746142913.807948:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867466112 00010000:00010000:3.0:1746142913.807982:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 15 pid: 7232 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.808019:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6526 00000100:00100000:3.0:1746142913.808027:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867466112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.808040:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.808046:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 15 pid: 7232 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.808057:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 15 pid: 7232 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.808078:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e6e7e00/0x2fa243e067ccd6aa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca1 expref: 15 pid: 7232 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.808100:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.808105:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.808114:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.808124:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.808144:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.808180:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867466112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 153us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.808185:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6526 00010000:00010000:0.0:1746142913.808546:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808554:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142913.808608:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:0.0:1746142913.808613:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142913.808630:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808640:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808649:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808655:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808660:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808664:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142913.808667:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808673:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808682:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142913.808685:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142913.808688:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808692:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0a00/0x2fa243e067ccd760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808708:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808713:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808717:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808720:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142913.808722:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808726:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808731:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800a7619300) 00010000:00010000:0.0:1746142913.808733:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142913.808735:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808738:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1e00/0x2fa243e067ccd767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.808769:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067ccd759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.808780:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.808786:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142913.808788:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142913.808790:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0e00, rc 0) 00000100:00100000:0.0:1746142913.808827:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:32534:x1830962867465728:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 16451us (17384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.808834:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14469 00000100:00100000:3.0:1746142913.811735:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.811763:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.811777:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.811796:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867466240 00000100:00100000:3.0:1746142913.811804:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867466240 00000100:00100000:0.0:1746142913.812427:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867466368 00000100:00100000:0.0:1746142913.812437:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867466368 00000100:00100000:3.0:1746142913.812451:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867466496 00000100:00100000:3.0:1746142913.812455:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867466496 00000100:00100000:2.0:1746142913.812466:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14456 00000100:00100000:2.0:1746142913.812484:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867466240:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142913.812499:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.812514:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccd775 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad03 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.812557:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867846656:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.812673:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.812692:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867466624 00000100:00100000:2.0:1746142913.812695:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867466624 00000100:00100000:1.0:1746142913.812822:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.812927:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14457 00000100:00100000:0.0:1746142913.812933:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867466368:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142913.812941:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142913.812944:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14458 00010000:00010000:0.0:1746142913.812950:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad0a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.812953:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867466496:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142913.812962:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.812964:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.812966:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142913.812971:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.812979:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad11 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.812984:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142913.812993:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a0600, rc 0) 00010000:00010000:3.0:1746142913.812999:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142913.812999:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14459 00010000:00010000:3.0:1746142913.813001:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142913.813005:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867466624:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142913.813008:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.813012:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142913.813014:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867466368:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 81us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.813020:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14457 00010000:00010000:3.0:1746142913.813022:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.813022:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad18 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.813032:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.813033:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.813036:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fac00, rc 0) 00010000:00010000:2.0:1746142913.813037:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.813046:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142913.813068:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867466496:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 116us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.813074:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14458 00010000:00010000:2.0:1746142913.813221:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe4400, rc 0) 00000100:00100000:2.0:1746142913.813241:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867466624:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 236us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.813246:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14459 00000100:00100000:0.0:1746142913.813939:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.814005:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867466880 00000100:00100000:2.0:1746142913.814009:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867466880 00000100:00100000:2.0:1746142913.814034:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14470 00000100:00100000:2.0:1746142913.814039:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:32539:x1830962867466880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.814050:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.814059:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4200/0x2fa243e067ccd791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad1f expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.814106:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814271:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814279:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814290:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814296:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814301:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00002000:00010000:1.0:1746142913.814314:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746142913 -> 1746142914 00002000:00010000:1.0:1746142913.814318:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746142913 -> 1746142914 00000100:00100000:1.0:1746142913.814331:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867846656:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.814349:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccd775 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad03 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.814359:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe5a00/0x2fa243e067ccd775 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad03 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.814375:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe5a00, rc 0) 00010000:00010000:2.0:1746142913.814384:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814392:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142913.814396:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867466240:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1923us (2670us total) trans 0 rc 301/301 00010000:00010000:2.0:1746142913.814398:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142913.814402:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14456 00000004:00200000:2.0:1746142913.814405:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142913.814449:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814455:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814460:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814465:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe4800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142913.814468:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814473:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814481:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142913.814483:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142913.814486:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814490:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4800/0x2fa243e067ccd798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814534:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814539:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814547:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814551:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097fb8a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142913.814553:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814557:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814563:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdc00) 00010000:00010000:2.0:1746142913.814564:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142913.814566:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814570:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb8a00/0x2fa243e067ccd79f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.814594:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe4200/0x2fa243e067ccd791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.814602:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 16 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.814608:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.814609:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142913.814611:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097fb9800, rc 0) 00000100:00100000:2.0:1746142913.814641:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:32539:x1830962867466880:12345-192.168.204.50@tcp:101:cat.0 Request processed in 601us (703us total) trans 8589936642 rc 0/0 00000100:00100000:2.0:1746142913.814646:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14470 00000100:00100000:0.0:1746142913.816055:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.816171:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467136 00000100:00100000:2.0:1746142913.816176:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467136 00000100:00100000:2.0:1746142913.816204:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14471 00000100:00100000:2.0:1746142913.816209:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:32534:x1830962867467136:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142913.816219:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.816229:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067ccd7b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad26 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.816279:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.816289:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.816296:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.816302:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.816340:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.816351:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 15 pid: 13326 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.816361:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867846784:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.816436:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.816448:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 8 pid: 13326 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.816455:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867846912:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.816479:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.817078:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.817106:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.817160:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467264 00000100:00100000:2.0:1746142913.817378:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467264 00000100:00100000:2.0:1746142913.817408:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467392 00000100:00100000:2.0:1746142913.817410:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467392 00000100:00100000:2.0:1746142913.817425:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14460 00000100:00100000:2.0:1746142913.817430:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962867467264:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.817438:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.817448:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093af9400/0x2fa243e067ccd7c2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad2d expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.817475:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847040:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.817513:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142913.817528:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14461 00000100:00100000:2.0:1746142913.817534:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+8:2004:x1830962867467392:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142913.817541:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.817549:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad34 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.817560:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.817561:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.817568:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 9 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.817578:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 9 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.817586:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093af8800, rc 0) 00000100:00100000:2.0:1746142913.817603:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867467392:12345-192.168.204.50@tcp:101:cat.0 Request processed in 70us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.817609:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14461 00000100:00100000:0.0:1746142913.817957:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.817990:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467520 00000100:00100000:1.0:1746142913.817994:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467520 00000100:00100000:0.0:1746142913.818003:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.818012:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14462 00000100:00100000:1.0:1746142913.818017:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867467520:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.818024:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.818030:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad3b expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.818041:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.818042:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142913.818046:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.818055:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.818063:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1400, rc 0) 00000100:00100000:0.0:1746142913.818133:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.818194:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867467520:12345-192.168.204.50@tcp:101:cat.0 Request processed in 176us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.818200:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14462 00000100:00100000:3.0:1746142913.818209:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467648 00000100:00100000:3.0:1746142913.818219:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467648 00000100:00100000:2.0:1746142913.818219:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867846784:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.818228:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867846912:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.818241:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.818250:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 16 pid: 13326 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.818263:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467776 00000100:00100000:2.0:1746142913.818265:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467776 00000100:00100000:3.0:1746142913.818278:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6527 00010000:00010000:2.0:1746142913.818278:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 9 pid: 13326 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.818285:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867467648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142913.818294:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6528 00010000:00010000:3.0:1746142913.818298:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142913.818298:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867467776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.818315:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 16 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.818318:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.818322:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 9 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.818326:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 16 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.818335:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 9 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.818353:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097fb9800/0x2fa243e067ccd7a6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad1f expref: 16 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.818360:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccd76e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acfc expref: 9 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.818371:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142913.818374:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.818381:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.818387:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.818394:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.818398:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142913.818411:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142913.818430:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142913.818436:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142913.818439:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867467776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.818440:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867467648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 155us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.818444:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6528 00000004:00200000:0.0:1746142913.818446:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000100:00100000:3.0:1746142913.818448:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6527 00010000:00010000:0.0:1746142913.818525:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067ccd7b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.818548:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.818554:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142913.818556:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142913.818558:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebce00, rc 0) 00000100:00100000:0.0:1746142913.818589:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32534:x1830962867467136:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2379us (2537us total) trans 8589936643 rc 0/0 00000100:00100000:0.0:1746142913.818595:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14471 00000100:00100000:2.0:1746142913.819823:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847040:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142913.819839:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093af9400/0x2fa243e067ccd7c2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad2d expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.819849:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093af9400/0x2fa243e067ccd7c2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad2d expref: 8 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.819856:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093af9400, rc 0) 00000100:00100000:2.0:1746142913.820110:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:2004:x1830962867467264:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2678us (3031us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142913.820116:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14460 00000100:00100000:0.0:1746142913.821027:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.821548:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867467904 00000100:00100000:2.0:1746142913.821554:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867467904 00000100:00100000:2.0:1746142913.821585:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14472 00000100:00100000:2.0:1746142913.821590:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32534:x1830962867467904:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142913.821604:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.821615:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093af8e00/0x2fa243e067ccd7de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad42 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.821669:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.821679:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.821684:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.821704:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.821713:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 9 pid: 13326 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.821722:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867847168:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.822668:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.824100:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.824153:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867847168:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.824172:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142913.824186:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867468160 00000100:00100000:3.0:1746142913.824190:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867468160 00000100:00100000:3.0:1746142913.824228:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14473 00000100:00100000:3.0:1746142913.824234:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:32540:x1830962867468160:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.824246:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.824258:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4faa00/0x2fa243e067ccd7ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad49 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.824319:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824328:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824336:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824346:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824351:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824356:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824422:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824430:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824435:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142913.824445:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142913.824498:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824503:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824508:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824513:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824517:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fb600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.824520:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824525:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824533:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142913.824536:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.824539:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824543:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd7f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824551:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824554:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824562:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824565:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fa600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.824567:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824571:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824576:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880099e6bf00) 00010000:00010000:3.0:1746142913.824577:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142913.824579:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824582:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa600/0x2fa243e067ccd7fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142913.824609:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4faa00/0x2fa243e067ccd7ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 18 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.824618:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 17 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.824623:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.824625:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142913.824628:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.824632:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.824639:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fb200, rc 0) 00000100:00100000:3.0:1746142913.824670:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32540:x1830962867468160:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 436us (572us total) trans 8589936644 rc 0/0 00000100:00100000:3.0:1746142913.824676:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14473 00000100:00100000:1.0:1746142913.824691:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.824712:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867468288 00000100:00100000:3.0:1746142913.824715:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867468288 00010000:00010000:3.0:1746142913.824727:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 10 pid: 13326 timeout: 787 lvb_type: 0 00000100:00100000:0.0:1746142913.824866:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.824918:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6529 00000100:00100000:3.0:1746142913.824931:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867468288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.824938:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.824942:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 10 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.824951:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 10 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.824961:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebce00/0x2fa243e067ccd7bb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad26 expref: 10 pid: 13326 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.824969:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.824972:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.824978:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.824985:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.824999:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.825117:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867468416 00000100:00100000:2.0:1746142913.825121:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867468416 00000100:00100000:2.0:1746142913.825140:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14463 00000100:00100000:2.0:1746142913.825145:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+7:32539:x1830962867468416:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142913.825150:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867468288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 223us (459us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142913.825152:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142913.825156:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6529 00010000:00010000:2.0:1746142913.825161:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad50 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.825172:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.825177:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142913.825177:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.825184:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142913.825185:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142913.825188:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746142913.825196:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142913.825199:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1746142913.825202:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 22 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.825209:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 22 pid: 11943 timeout: 787 lvb_type: 0 00000004:00010000:3.0:1746142913.825211:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142913.825215:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847296:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.825229:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093af8e00/0x2fa243e067ccd7de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.825238:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.825241:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd30c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746142913.825244:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.825246:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142913.825247:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093af9800, rc 0) 00000100:00100000:3.0:1746142913.825266:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32534:x1830962867467904:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3676us (4239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.825271:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14472 00000100:00100000:0.0:1746142913.826241:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.826301:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.826339:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867468544 00000100:00100000:1.0:1746142913.826343:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867468544 00002000:00100000:1.0:1746142913.826365:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (937984->1048575) req@ffff880096094380 x1830962867468544/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.826373:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096094380 with x1830962867468544 ext(937984->1048575) 00000100:00100000:2.0:1746142913.826374:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847296:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.826379:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 23 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.826388:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 8 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.826388:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 23 pid: 11943 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.826394:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096094380 00010000:00010000:2.0:1746142913.826402:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093af8c00, rc 0) 00000100:00100000:1.0:1746142913.826419:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1396 00000100:00100000:2.0:1746142913.826422:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:32539:x1830962867468416:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1277us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.826425:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962867468544:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142913.826427:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14463 00000100:00100000:2.0:1746142913.826437:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867468672 00000100:00100000:2.0:1746142913.826440:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867468672 00000100:00100000:2.0:1746142913.826460:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14464 00000100:00100000:2.0:1746142913.826464:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867468672:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142913.826470:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.826476:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccd816 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad57 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.826498:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847424:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142913.826522:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.828765:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847424:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142913.828788:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccd816 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad57 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.828798:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ebd200/0x2fa243e067ccd816 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad57 expref: 9 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.828806:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebd200, rc 0) 00000100:00100000:3.0:1746142913.828846:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867468672:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2380us (2616us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142913.828852:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14464 00000100:00100000:1.0:1746142913.829346:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867468544:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2919us (3042us total) trans 21474841230 rc 0/0 00000100:00100000:1.0:1746142913.829353:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1396 00002000:00100000:1.0:1746142913.829360:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (937984->1048575) req@ffff880096094380 x1830962867468544/t21474841230(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.829368:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096094380 with x1830962867468544 ext(937984->1048575) 00010000:00010000:1.0:1746142913.829374:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:1.0:1746142913.829383:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00002000:00010000:1.0:1746142913.829389:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096094380 00000100:00100000:0.0:1746142913.831280:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.831333:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867468928 00000100:00100000:3.0:1746142913.831340:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867468928 00000100:00100000:3.0:1746142913.831380:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14474 00000100:00100000:3.0:1746142913.831387:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32534:x1830962867468928:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142913.831403:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.831416:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccd81d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad5e expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.831483:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831495:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831504:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831514:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831519:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831524:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831529:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fa200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142913.831532:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831537:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831545:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142913.831548:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142913.831551:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831555:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd824 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142913.831575:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccd81d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad5e expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.831581:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fba00/0x2fa243e067ccd81d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad5e expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.831587:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fba00, rc 0) 00000100:00100000:3.0:1746142913.831627:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32534:x1830962867468928:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 240us (351us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142913.831633:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14474 00000100:00100000:0.0:1746142913.832076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.832133:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867469056 00000100:00100000:3.0:1746142913.832137:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867469056 00010000:00010000:3.0:1746142913.832151:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.832246:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6530 00000100:00100000:3.0:1746142913.832253:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867469056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.832262:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.832274:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.832283:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.832296:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a3b4000/0x2fa243e067ccd6db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 937984->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acb6 expref: 25 pid: 11943 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.832317:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.832318:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.832324:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.832331:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.832354:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 7 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.832368:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867847552:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.832644:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.833032:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.833133:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867469312 00000100:00100000:3.0:1746142913.833137:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867469312 00000100:00100000:3.0:1746142913.833158:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5282 00000100:00100000:3.0:1746142913.833162:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32534:x1830962867469312:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1746142913.833263:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:32534:x1830962867469312:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 100us (231us total) trans 8589936645 rc 0/0 00000100:00100000:3.0:1746142913.833269:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5282 00000100:00100000:3.0:1746142913.834503:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867847552:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.834518:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.834543:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962867469056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2290us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.834549:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6530 00000100:00100000:0.0:1746142913.838494:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.838544:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.838616:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867469568 00000100:00100000:1.0:1746142913.838623:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867469568 00002000:00100000:1.0:1746142913.838659:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8801355d1880 x1830962867469568/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.838668:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d1880 with x1830962867469568 ext(0->1048575) 00002000:00010000:1.0:1746142913.838671:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d1880 00000100:00100000:1.0:1746142913.838700:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867469824 00000100:00100000:1.0:1746142913.838703:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867469824 00002000:00100000:1.0:1746142913.838715:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8801355d0000 x1830962867469824/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.838722:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0000 with x1830962867469824 ext(1048576->2097151) 00002000:00010000:1.0:1746142913.838725:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d0000 00000100:00100000:1.0:1746142913.838734:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4501 00000100:00100000:1.0:1746142913.838740:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867469568:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142913.838984:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4502 00000100:00100000:3.0:1746142913.838992:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867469824:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142913.846338:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867469568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7592us (7845us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142913.846346:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4501 00002000:00100000:1.0:1746142913.846355:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8801355d1880 x1830962867469568/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142913.846361:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d1880 with x1830962867469568 ext(0->1048575) 00002000:00010000:1.0:1746142913.846365:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d1880 00000100:00100000:3.0:1746142913.847715:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867469824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8720us (9166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142913.847722:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4502 00002000:00100000:3.0:1746142913.847728:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8801355d0000 x1830962867469824/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.847736:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0000 with x1830962867469824 ext(1048576->2097151) 00002000:00010000:3.0:1746142913.847740:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d0000 00000100:00100000:0.0:1746142913.860986:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.861069:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470080 00000100:00100000:3.0:1746142913.861080:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470080 00002000:00100000:3.0:1746142913.861123:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8801355d2300 x1830962867470080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.861133:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d2300 with x1830962867470080 ext(2097152->4194303) 00002000:00010000:3.0:1746142913.861138:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d2300 00000100:00100000:3.0:1746142913.861186:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4503 00000100:00100000:3.0:1746142913.861195:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867470080:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142913.871883:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.872743:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470464 00000100:00100000:3.0:1746142913.872753:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470464 00000100:00100000:3.0:1746142913.872809:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 890 00000100:00100000:3.0:1746142913.872818:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+5:2006:x1830962867470464:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:3.0:1746142913.872927:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+5:2006:x1830962867470464:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 108us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.872933:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 890 00000100:00080000:3.0:1746142913.872973:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746142913.873005:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.873277:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.873321:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.873330:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470592 00000100:00100000:2.0:1746142913.873334:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470592 00000100:00080000:2.0:1746142913.873346:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746142913.873365:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470336 00000100:00100000:2.0:1746142913.873367:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470336 00000100:00100000:2.0:1746142913.873383:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 891 00000100:00100000:2.0:1746142913.873387:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+5:2006:x1830962867470592:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142913.873413:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+5:2006:x1830962867470592:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.873417:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 891 00000100:00100000:2.0:1746142913.873426:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 892 00000100:00100000:2.0:1746142913.873430:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962867470336:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:2.0:1746142913.873448:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962867470336:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 17us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.873452:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 892 00000100:00080000:2.0:1746142913.873461:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746142913.873476:0:8097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470208 00000100:00100000:2.0:1746142913.873478:0:8097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470208 00000100:00100000:2.0:1746142913.873494:0:8097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 185 00000100:00100000:2.0:1746142913.873497:0:8097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9590e9a3-538a-49d5-a431-e1408ed78761+15:2005:x1830962867470208:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142913.873502:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867470080:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12307us (12522us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142913.873509:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4503 00000100:00100000:2.0:1746142913.873515:0:8097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130dda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9590e9a3-538a-49d5-a431-e1408ed78761+15:2005:x1830962867470208:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 17us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.873519:0:8097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 185 00002000:00100000:0.0:1746142913.873520:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8801355d2300 x1830962867470080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/440 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142913.873529:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d2300 with x1830962867470080 ext(2097152->4194303) 00002000:00010000:0.0:1746142913.873534:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d2300 00000100:00100000:0.0:1746142913.882686:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.882786:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470720 00000100:00100000:3.0:1746142913.882794:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470720 00000100:00100000:3.0:1746142913.882846:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14465 00000100:00100000:3.0:1746142913.882854:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:32533:x1830962867470720:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142913.882870:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142913.882886:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad65 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.882977:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 7 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.882987:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.882993:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 7 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.882999:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.883000:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.883003:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3166208->4079615] (req 3166208->4079615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.883030:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 7 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.883041:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 7 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.883051:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847680:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.883143:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.883151:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 25 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.883158:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.883184:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 7 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142913.883191:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 7 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.883197:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847936:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.883211:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.886504:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.886712:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470848 00000100:00100000:2.0:1746142913.886720:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470848 00010000:00010000:2.0:1746142913.886748:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 8 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746142913.886777:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6531 00000100:00100000:2.0:1746142913.886782:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867470848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.886791:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.886806:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 8 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.886815:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 8 pid: 12211 timeout: 787 lvb_type: 1 00010000:00010000:2.0:1746142913.886838:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.886878:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867470848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 96us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.886883:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6531 00000100:00100000:0.0:1746142913.888290:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.888319:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.888334:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867471104 00000100:00100000:0.0:1746142913.888339:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867471104 00010000:00010000:0.0:1746142913.888358:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 8 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746142913.888393:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6532 00000100:00100000:0.0:1746142913.888399:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867471104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.888407:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.888416:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 8 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.888424:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 8 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.888437:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142913.888459:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867471104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.888465:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6532 00000100:00100000:0.0:1746142913.888523:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.888556:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867471232 00000100:00100000:0.0:1746142913.888560:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867471232 00010000:00010000:0.0:1746142913.888570:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 26 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746142913.888586:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6533 00000100:00100000:0.0:1746142913.888591:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867471232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.888597:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142913.888604:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 26 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.888616:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 26 pid: 11943 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.888627:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.888628:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142913.888634:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.888641:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142913.888670:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142913.888680:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801355d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867848064:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142913.888737:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.889149:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867470976 00000100:00100000:1.0:1746142913.889153:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867470976 00000100:00100000:1.0:1746142913.889179:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14466 00000100:00100000:1.0:1746142913.889184:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867470976:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.889195:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.889202:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccd832 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad6c expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142913.889223:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867848192:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142913.889255:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00010000:00010000:3.0:1746142913.890118:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067ccd5d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac00 expref: 9 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.890144:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847680:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.890156:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82c00/0x2fa243e067ccd5e6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac0e expref: 26 pid: 11943 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.890163:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.890173:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25200/0x2fa243e067ccd4dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab97 expref: 7 pid: 12211 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.890180:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867847936:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142913.890198:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 25 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.890205:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fbc00, rc 0) 00000100:00100000:3.0:1746142913.890235:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32533:x1830962867470720:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7382us (7557us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.890242:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14465 00000100:00100000:2.0:1746142913.894438:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801355d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867848064:192.168.204.50@tcp:105: 00002000:00010000:1.0:1746142913.894438:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142913 -> 1746142914 00002000:00010000:1.0:1746142913.894443:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142913 -> 1746142914 00002000:00010000:1.0:1746142913.894445:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142913 -> 1746142914 00010000:00010000:2.0:1746142913.894457:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142913.894461:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867848192:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142913.894482:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccd832 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad6c expref: 8 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142913.894495:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed1600/0x2fa243e067ccd832 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad6c expref: 8 pid: 1397 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142913.894505:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2004:x1830962867471232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5912us (5980us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142913.894509:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1600, rc 0) 00000100:00100000:2.0:1746142913.894514:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6533 00000100:00100000:1.0:1746142913.894530:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:2006:x1830962867470976:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5346us (6242us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142913.894537:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14466 00000100:00100000:0.0:1746142913.896241:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142913.896299:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867471360 00000100:00100000:1.0:1746142913.896314:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867471360 00000100:00100000:1.0:1746142913.896353:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14467 00000100:00100000:1.0:1746142913.896359:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:32539:x1830962867471360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142913.896376:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142913.896387:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad73 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.896407:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.896416:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142913.896418:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142913.896421:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [5062656->5242879] (req 5062656->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.896441:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 23 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.896449:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 23 pid: 1854 timeout: 787 lvb_type: 0 00000100:00100000:1.0:1746142913.896458:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867848320:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142913.896521:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.898314:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867848320:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142913.898332:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [5062656->5242879] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142913.898341:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed0a00, rc 0) 00000100:00100000:1.0:1746142913.898362:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:32539:x1830962867471360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2004us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142913.898368:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14467 00000100:00100000:0.0:1746142913.900817:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.901149:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867471616 00000100:00100000:2.0:1746142913.901157:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867471616 00002000:00100000:2.0:1746142913.901190:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4075520->4079615) req@ffff8801355d3100 x1830962867471616/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.901198:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d3100 with x1830962867471616 ext(4075520->4079615) 00010000:00010000:2.0:1746142913.901206:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 24 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.901218:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 24 pid: 1854 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746142913.901224:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801355d3100 00000100:00100000:2.0:1746142913.901250:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1397 00000100:00100000:2.0:1746142913.901256:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867471616:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142913.901367:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867471616:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 110us (555us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142913.901373:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1397 00002000:00100000:2.0:1746142913.901377:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4075520->4079615) req@ffff8801355d3100 x1830962867471616/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.901384:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d3100 with x1830962867471616 ext(4075520->4079615) 00010000:00010000:2.0:1746142913.901387:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 24 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.901398:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 24 pid: 1854 timeout: 787 lvb_type: 0 00002000:00010000:2.0:1746142913.901406:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801355d3100 00000100:00100000:0.0:1746142913.907044:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.907128:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867472000 00000100:00100000:2.0:1746142913.907137:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867472000 00000100:00100000:2.0:1746142913.907184:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5283 00000100:00100000:2.0:1746142913.907191:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32533:x1830962867472000:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142913.909142:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32533:x1830962867472000:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 1946us (2100us total) trans 8589936646 rc 0/0 00000100:00100000:2.0:1746142913.909152:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5283 00000100:00100000:2.0:1746142913.909214:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.909289:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867472128 00000100:00100000:0.0:1746142913.909295:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867472128 00002000:00100000:0.0:1746142913.909330:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3166208->4079615) req@ffff880091de1c00 x1830962867472128/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142913.909340:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1c00 with x1830962867472128 ext(3166208->4079615) 00010000:00010000:0.0:1746142913.909347:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 24 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.909359:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 24 pid: 1854 timeout: 787 lvb_type: 0 00002000:00010000:0.0:1746142913.909365:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de1c00 00000100:00100000:0.0:1746142913.909389:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1398 00000100:00100000:0.0:1746142913.909396:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2004:x1830962867472128:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142913.912431:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.912491:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867472256 00000100:00100000:2.0:1746142913.912499:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867472256 00000100:00100000:2.0:1746142913.912533:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14468 00000100:00100000:2.0:1746142913.912540:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:32540:x1830962867472256:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142913.912555:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.912568:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad7a expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.912593:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.912599:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.912600:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.912604:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [1003520->1048575] (req 1003520->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.912627:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.912637:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.912647:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867848448:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.912720:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.917330:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867472128:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 7927us (8107us total) trans 21474841231 rc 0/0 00000100:00100000:1.0:1746142913.917333:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.917340:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867848448:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142913.917341:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1398 00002000:00100000:3.0:1746142913.917350:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3166208->4079615) req@ffff880091de1c00 x1830962867472128/t21474841231(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:64/0 lens 488/448 e 0 to 0 dl 1746142924 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.917359:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1c00 with x1830962867472128 ext(3166208->4079615) 00010000:00010000:2.0:1746142913.917364:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [1003520->1048575] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.917367:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.917376:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.917377:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebc600, rc 0) 00002000:00010000:3.0:1746142913.917382:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de1c00 00000100:00100000:2.0:1746142913.917411:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:32540:x1830962867472256:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4871us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.917413:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867472384 00000100:00100000:2.0:1746142913.917417:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14468 00000100:00100000:3.0:1746142913.917419:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867472384 00010000:00010000:3.0:1746142913.917437:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.917455:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6534 00000100:00100000:3.0:1746142913.917461:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867472384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142913.917470:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.917484:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.917496:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.917515:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093af8c00/0x2fa243e067ccd80f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad50 expref: 9 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:3.0:1746142913.917649:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.917651:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.917657:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.917665:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.917687:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 8 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.917697:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867848576:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.917753:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.919625:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.919646:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867848576:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.919658:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.919690:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867472512 00000100:00100000:2.0:1746142913.919695:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867472512 00010000:00010000:2.0:1746142913.919716:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.919717:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867472384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2255us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.919724:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6534 00000100:00100000:2.0:1746142913.919736:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6535 00000100:00100000:2.0:1746142913.919741:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867472512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142913.919749:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142913.919761:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.919776:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.919791:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd82b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3166208->4079615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad65 expref: 26 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:2.0:1746142913.919803:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.919805:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.919809:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.919815:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.919836:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142913.919849:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867848704:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142913.919926:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142913.920052:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.920093:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867472768 00000100:00100000:3.0:1746142913.920101:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867472768 00002000:00100000:3.0:1746142913.920124:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (1003520->1007615) req@ffff880130120a80 x1830962867472768/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.920131:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120a80 with x1830962867472768 ext(1003520->1007615) 00002000:00010000:3.0:1746142913.920135:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120a80 00000100:00100000:3.0:1746142913.920158:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4504 00000100:00100000:3.0:1746142913.920164:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867472768:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142913.920391:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867472768:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 226us (339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142913.920397:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4504 00002000:00100000:3.0:1746142913.920402:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (1003520->1007615) req@ffff880130120a80 x1830962867472768/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.920409:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120a80 with x1830962867472768 ext(1003520->1007615) 00002000:00010000:3.0:1746142913.920411:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120a80 00000100:00100000:2.0:1746142913.921211:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867848704:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142913.921222:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142913.921255:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867472512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1513us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.921262:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6535 00000100:00100000:0.0:1746142913.923557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142913.923629:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.923691:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867473152 00000100:00100000:2.0:1746142913.923698:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867473152 00000100:00100000:2.0:1746142913.923728:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14469 00000100:00100000:2.0:1746142913.923734:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:32540:x1830962867473152:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142913.923746:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142913.923760:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad81 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.923782:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.923789:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.923795:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 11 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.923804:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.923806:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142913.923809:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1806335] (req 1048576->1806335) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 11 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.923830:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 11 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.923841:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 11 pid: 9580 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746142913.923851:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867848832:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.923937:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142913.923945:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 787 lvb_type: 1 00000100:00100000:2.0:1746142913.923952:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867848960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.923973:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.923980:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 27 pid: 1854 timeout: 787 lvb_type: 0 00000100:00100000:2.0:1746142913.923991:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867849088:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.924004:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142913.924343:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867473024 00000100:00100000:3.0:1746142913.924347:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867473024 00002000:00100000:3.0:1746142913.924367:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff8801355d1180 x1830962867473024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.924374:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d1180 with x1830962867473024 ext(5062656->5066751) 00002000:00010000:3.0:1746142913.924377:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d1180 00000100:00100000:3.0:1746142913.924441:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4505 00000100:00100000:3.0:1746142913.924447:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867473024:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142913.924588:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867473024:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 140us (1035us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142913.924596:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4505 00002000:00100000:3.0:1746142913.924602:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff8801355d1180 x1830962867473024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142913.924608:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d1180 with x1830962867473024 ext(5062656->5066751) 00002000:00010000:3.0:1746142913.924611:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801355d1180 00000100:00100000:0.0:1746142913.925930:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.926884:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867848832:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.926894:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867848960:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142913.926929:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867849088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142913.926953:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1806335] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 11 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142913.926967:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebc800, rc 0) 00000100:00100000:2.0:1746142913.927002:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:32540:x1830962867473152:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3267us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142913.927009:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14469 00000100:00100000:0.0:1746142913.927142:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.927183:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867473280 00000100:00100000:0.0:1746142913.927187:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.927189:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867473280 00010000:00010000:3.0:1746142913.927210:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 12 pid: 9580 timeout: 787 lvb_type: 1 00000100:00100000:3.0:1746142913.927231:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867473408 00000100:00100000:3.0:1746142913.927233:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867473408 00000100:00100000:0.0:1746142913.927239:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867473536 00010000:00010000:3.0:1746142913.927241:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 787 lvb_type: 1 00000100:00100000:0.0:1746142913.927241:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867473536 00010000:00010000:0.0:1746142913.927251:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 28 pid: 1854 timeout: 787 lvb_type: 0 00000100:00100000:3.0:1746142913.927253:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6536 00000100:00100000:3.0:1746142913.927258:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867473280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142913.927269:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6537 00000100:00100000:3.0:1746142913.927273:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6538 00000100:00100000:0.0:1746142913.927273:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2004:x1830962867473408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142913.927277:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867473536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142913.927280:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.927281:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.927293:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 28 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.927293:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 787 lvb_type: 1 00010000:00010000:0.0:1746142913.927301:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.927464:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 28 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.927485:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093af8800/0x2fa243e067ccd7c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad34 expref: 11 pid: 9578 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.927488:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bc29000/0x2fa243e067ccd728 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ace7 expref: 28 pid: 1854 timeout: 787 lvb_type: 0 00010000:00010000:0.0:1746142913.927506:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142913.927525:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867473408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 251us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142913.927530:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6537 00010000:00010000:3.0:1746142913.927611:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.927639:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867473536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 361us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.927644:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6538 00010000:00010000:3.0:1746142913.927656:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142913.927664:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 12 pid: 9580 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.927671:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 12 pid: 9580 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.927682:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a0600/0x2fa243e067ccd77c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad0a expref: 12 pid: 9580 timeout: 787 lvb_type: 1 00010000:00010000:3.0:1746142913.927690:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.927692:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142913.927697:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.927704:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142913.927726:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142913.927735:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867849216:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142913.927778:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142913.929228:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.929475:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867849216:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142913.929486:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142913.929507:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867473280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2249us (3608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142913.929513:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6536 00000100:00100000:2.0:1746142913.929717:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867473792 00000100:00100000:2.0:1746142913.929722:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867473792 00000100:00100000:2.0:1746142913.929744:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5284 00000100:00100000:2.0:1746142913.929749:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32539:x1830962867473792:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142913.929873:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32539:x1830962867473792:12345-192.168.204.50@tcp:35:cat.0 Request processed in 123us (648us total) trans 8589936647 rc 0/0 00000100:00100000:2.0:1746142913.929879:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5284 00000100:00100000:0.0:1746142913.934584:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142913.934625:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867474048 00000100:00100000:2.0:1746142913.934633:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867474048 00002000:00100000:2.0:1746142913.934674:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1802240->1806335) req@ffff8801355d0a80 x1830962867474048/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/0 e 0 to 0 dl 1746142924 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.934689:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0a80 with x1830962867474048 ext(1802240->1806335) 00002000:00010000:2.0:1746142913.934694:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d0a80 00000100:00100000:2.0:1746142913.934722:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4506 00000100:00100000:2.0:1746142913.934728:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867474048:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142913.934853:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867474048:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 125us (275us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142913.934862:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4506 00002000:00100000:2.0:1746142913.934868:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1802240->1806335) req@ffff8801355d0a80 x1830962867474048/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:64/0 lens 488/4536 e 0 to 0 dl 1746142924 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142913.934877:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801355d0a80 with x1830962867474048 ext(1802240->1806335) 00002000:00010000:2.0:1746142913.934880:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801355d0a80 00000100:00100000:0.0:1746142913.937521:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142913.937680:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867474304 00000100:00100000:3.0:1746142913.937686:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867474304 00000100:00100000:3.0:1746142913.937891:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5285 00000100:00100000:3.0:1746142913.937965:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:32540:x1830962867474304:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142913.938365:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+19:32540:x1830962867474304:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 466us (850us total) trans 8589936648 rc 0/0 00000100:00100000:3.0:1746142913.938372:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5285 00000100:00100000:0.0:1746142914.002709:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.002786:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867474560 00000100:00100000:3.0:1746142914.002794:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867474560 00000100:00100000:3.0:1746142914.002848:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14475 00000100:00100000:3.0:1746142914.002856:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32547:x1830962867474560:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.002875:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.002890:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb000/0x2fa243e067ccd84e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad88 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.002982:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.002995:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003007:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003017:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003022:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003026:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003100:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003108:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003114:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142914.003120:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142914.003180:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003185:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003190:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003194:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003200:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fb600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.003203:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003209:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003217:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142914.003220:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.003223:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003227:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb600/0x2fa243e067ccd855 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003253:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003258:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003262:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003265:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c4fbc00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.003267:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003272:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003277:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880099e6bd00) 00010000:00010000:3.0:1746142914.003279:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.003281:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003284:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fbc00/0x2fa243e067ccd85c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.003324:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb000/0x2fa243e067ccd84e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 39 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.003335:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 38 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.003343:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142914.003345:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142914.003347:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fa200, rc 0) 00000100:00100000:3.0:1746142914.003397:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32547:x1830962867474560:12345-192.168.204.50@tcp:101:cat.0 Request processed in 542us (693us total) trans 8589936649 rc 0/0 00000100:00100000:3.0:1746142914.003403:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14475 00000100:00100000:0.0:1746142914.005559:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.005592:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.005969:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.006188:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867474688 00000100:00100000:2.0:1746142914.006195:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867474688 00000100:00100000:2.0:1746142914.006225:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867474816 00000100:00100000:2.0:1746142914.006227:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867474816 00000100:00100000:2.0:1746142914.006243:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867474944 00000100:00100000:2.0:1746142914.006244:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867474944 00000100:00100000:2.0:1746142914.006257:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14470 00000100:00100000:2.0:1746142914.006263:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867474688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.006277:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.006290:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d950400/0x2fa243e067ccd871 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad8f expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.006344:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867849344:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142914.006434:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14471 00000100:00100000:3.0:1746142914.006440:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867474816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.006447:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.006456:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4faa00/0x2fa243e067ccd878 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad96 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.006477:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867849472:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142914.006515:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14472 00000100:00100000:0.0:1746142914.006521:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867474944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.006527:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142914.006533:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ad9d expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.006543:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.006545:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.006551:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.006565:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.006574:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebea00, rc 0) 00000100:00100000:2.0:1746142914.007234:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.007336:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.009712:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867474944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3182us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.009721:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14472 00000100:00100000:3.0:1746142914.012578:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867849472:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142914.012605:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4faa00/0x2fa243e067ccd878 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad96 expref: 28 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.012618:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4faa00/0x2fa243e067ccd878 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad96 expref: 28 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.012642:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4faa00, rc 0) 00000100:00100000:3.0:1746142914.012679:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867474816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6239us (7086us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142914.012686:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14471 00000100:00100000:2.0:1746142914.013331:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867849344:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142914.013350:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d950400/0x2fa243e067ccd871 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad8f expref: 27 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.013363:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d950400/0x2fa243e067ccd871 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad8f expref: 27 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.013385:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950400, rc 0) 00000100:00100000:2.0:1746142914.013519:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867474688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7255us (7963us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.013524:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14470 00000100:00100000:0.0:1746142914.016867:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.017098:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867475072 00000100:00100000:2.0:1746142914.017106:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867475072 00000100:00100000:2.0:1746142914.017212:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14473 00000100:00100000:2.0:1746142914.017219:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32547:x1830962867475072:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.017233:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.017247:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ada4 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.017269:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.017276:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.017278:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.017281:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.017564:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.017574:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 7 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.017584:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867849600:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.017832:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.019329:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867849600:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.019351:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.019364:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d951c00, rc 0) 00000100:00100000:2.0:1746142914.019460:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32547:x1830962867475072:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2241us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.019468:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14473 00000100:00100000:0.0:1746142914.020270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.020342:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867475200 00000100:00100000:2.0:1746142914.020348:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867475200 00002000:00100000:2.0:1746142914.020376:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (1003520->1048575) req@ffff88012dbf5180 x1830962867475200/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.020385:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5180 with x1830962867475200 ext(1003520->1048575) 00010000:00010000:2.0:1746142914.020391:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 8 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.020407:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 8 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.020412:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf5180 00000100:00100000:2.0:1746142914.020438:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1399 00000100:00100000:2.0:1746142914.020445:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867475200:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142914.023581:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867475200:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 3128us (3304us total) trans 21474841232 rc 0/0 00000100:00100000:2.0:1746142914.023590:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1399 00002000:00100000:2.0:1746142914.023600:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (1003520->1048575) req@ffff88012dbf5180 x1830962867475200/t21474841232(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.023608:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5180 with x1830962867475200 ext(1003520->1048575) 00010000:00010000:2.0:1746142914.023616:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.023628:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.023635:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf5180 00000100:00100000:0.0:1746142914.026211:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.026350:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867475328 00000100:00100000:3.0:1746142914.026357:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867475328 00010000:00010000:3.0:1746142914.026382:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.026404:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6539 00000100:00100000:3.0:1746142914.026410:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867475328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.026419:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.026435:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.026444:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.026461:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd840 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1003520->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad7a expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.026490:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.026492:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.026499:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.026506:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.026531:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.026541:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867849728:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.026606:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.029672:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867849728:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142914.029688:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.029722:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867475328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3310us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.029730:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6539 00000100:00100000:0.0:1746142914.032430:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.032629:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867475584 00000100:00100000:2.0:1746142914.032642:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867475584 00002000:00100000:2.0:1746142914.032675:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012dbf5f80 x1830962867475584/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.032684:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5f80 with x1830962867475584 ext(0->1048575) 00002000:00010000:2.0:1746142914.032689:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf5f80 00000100:00100000:2.0:1746142914.032718:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4507 00000100:00100000:2.0:1746142914.032725:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867475584:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.042089:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867475584:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9356us (9656us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.042099:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4507 00002000:00100000:2.0:1746142914.042108:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012dbf5f80 x1830962867475584/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.042117:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5f80 with x1830962867475584 ext(0->1048575) 00002000:00010000:2.0:1746142914.042122:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf5f80 00000100:00100000:0.0:1746142914.051177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.051288:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867475712 00000100:00100000:2.0:1746142914.051297:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867475712 00000100:00100000:2.0:1746142914.052772:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14474 00000100:00100000:2.0:1746142914.052784:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32547:x1830962867475712:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.052801:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.052817:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adab expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.052841:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.052846:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.052847:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.052850:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.052877:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.052888:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 9 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.052897:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867849856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.052995:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.053192:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.053390:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867475968 00000100:00100000:2.0:1746142914.053394:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867475968 00000100:00100000:2.0:1746142914.053424:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14476 00000100:00100000:2.0:1746142914.053430:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+19:32551:x1830962867475968:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.053440:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.053450:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951400/0x2fa243e067ccd894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adb2 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.053502:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053511:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053520:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053529:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053537:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053542:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053612:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053620:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053625:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142914.053633:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.053690:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053696:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053700:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053705:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053710:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d950800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.053713:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053718:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053729:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142914.053731:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.053734:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.053738:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950800/0x2fa243e067ccd89b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054495:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054501:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054505:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054509:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d951800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.054511:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054515:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054521:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdd00) 00010000:00010000:2.0:1746142914.054523:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.054524:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054528:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951800/0x2fa243e067ccd8a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.054561:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951400/0x2fa243e067ccd894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 22 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.054571:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.054576:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.054578:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142914.054580:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebc600, rc 0) 00000100:00100000:2.0:1746142914.054614:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:32551:x1830962867475968:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1183us (1421us total) trans 8589936650 rc 0/0 00000100:00100000:2.0:1746142914.054620:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14476 00000100:00100000:2.0:1746142914.055368:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867849856:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.055387:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.055396:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d951e00, rc 0) 00000100:00100000:2.0:1746142914.056067:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32547:x1830962867475712:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3284us (4897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.056073:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14474 00000100:00100000:0.0:1746142914.057741:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.058965:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476096 00000100:00100000:2.0:1746142914.058973:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476096 00002000:00100000:2.0:1746142914.059009:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1806335) req@ffff88012dbf7b80 x1830962867476096/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.059017:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7b80 with x1830962867476096 ext(1048576->1806335) 00010000:00010000:2.0:1746142914.059025:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.059041:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 10 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.059047:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbf7b80 00000100:00100000:0.0:1746142914.059445:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.059469:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.060278:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1400 00000100:00100000:3.0:1746142914.060288:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867476096:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142914.060810:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476224 00000100:00100000:2.0:1746142914.060815:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476224 00000100:00100000:2.0:1746142914.060844:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476352 00000100:00100000:2.0:1746142914.060847:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476352 00000100:00100000:2.0:1746142914.060859:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14475 00000100:00100000:2.0:1746142914.060864:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867476224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.060873:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.060886:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adb9 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.060919:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.060921:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.060928:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.060940:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.060949:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950800, rc 0) 00000100:00100000:3.0:1746142914.061054:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14476 00000100:00100000:3.0:1746142914.061061:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867476352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.061067:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.061075:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4fbe00/0x2fa243e067ccd8be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adc0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.061108:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867849984:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142914.061338:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867476224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 473us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.061344:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14475 00000100:00100000:3.0:1746142914.061594:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.065850:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867849984:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142914.065876:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4fbe00/0x2fa243e067ccd8be lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc0 expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.065890:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4fbe00/0x2fa243e067ccd8be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc0 expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.065928:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fbe00, rc 0) 00000100:00100000:3.0:1746142914.065973:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867476352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4912us (6501us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142914.065979:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14476 00000100:00100000:0.0:1746142914.070363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.070408:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476608 00000100:00100000:2.0:1746142914.070415:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476608 00000100:00100000:3.0:1746142914.070448:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867476096:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 10160us (12709us total) trans 17179873972 rc 0/0 00000100:00100000:3.0:1746142914.070457:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1400 00002000:00100000:3.0:1746142914.070465:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1806335) req@ffff88012dbf7b80 x1830962867476096/t17179873972(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.070471:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7b80 with x1830962867476096 ext(1048576->1806335) 00010000:00010000:3.0:1746142914.070478:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 12 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.070490:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 12 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.070495:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbf7b80 00000100:00100000:2.0:1746142914.070646:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14477 00000100:00100000:2.0:1746142914.070653:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:32552:x1830962867476608:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.070668:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.070680:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccd8c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adc7 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.070743:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.070754:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.070760:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 37 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.070765:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 22 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.070771:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.070791:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 22 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.070798:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 22 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.070806:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867850112:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.071627:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 37 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.071636:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 37 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.071644:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867850240:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.071968:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.072185:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 8 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.072192:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.072194:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867850368:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.072236:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.072247:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476736 00000100:00100000:3.0:1746142914.072251:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476736 00010000:00010000:3.0:1746142914.072268:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 12 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.072294:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6540 00000100:00100000:3.0:1746142914.072313:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867476736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.072322:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.072335:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 12 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.072345:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 12 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.072583:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebc800/0x2fa243e067ccd847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad81 expref: 12 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.072599:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.072601:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.072607:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.072613:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.072634:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.072647:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867850496:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.072671:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.073375:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867850112:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.073389:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867850240:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142914.076219:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.076251:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.076348:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476864 00000100:00100000:2.0:1746142914.076355:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476864 00010000:00010000:2.0:1746142914.076379:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 38 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.076405:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867476992 00000100:00100000:2.0:1746142914.076408:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867476992 00010000:00010000:2.0:1746142914.076418:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 23 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.076432:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6541 00000100:00100000:2.0:1746142914.076437:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6542 00000100:00100000:1.0:1746142914.076442:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867476864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142914.076443:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867476992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.076451:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.076451:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.076456:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 23 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.076456:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 38 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.076464:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 38 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.076475:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 23 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.076496:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebc600/0x2fa243e067ccd8a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb2 expref: 23 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.076507:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fa200/0x2fa243e067ccd863 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad88 expref: 38 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.076510:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.076514:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.076521:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.076526:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142914.076527:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.076530:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142914.076536:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142914.076540:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.076558:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867476992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.076558:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867476864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.076563:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6541 00000100:00100000:2.0:1746142914.076566:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6542 00000100:00100000:2.0:1746142914.078604:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.078686:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867477120 00000100:00100000:3.0:1746142914.078691:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867477120 00010000:00010000:3.0:1746142914.078741:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 9 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.078768:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6543 00000100:00100000:3.0:1746142914.078774:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867477120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.078783:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.078786:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 9 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.078795:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 9 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.078808:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142914.078811:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.078817:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.078822:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142914.078834:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.078858:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867477120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.078864:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6543 00010000:00010000:0.0:1746142914.078883:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093af9800/0x2fa243e067ccd7e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad42 expref: 8 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.078891:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867850496:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142914.078916:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867850368:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142914.078919:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.078934:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867476736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6634us (6743us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142914.078936:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:3.0:1746142914.078939:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6540 00010000:00010000:0.0:1746142914.078942:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142914.078951:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:0.0:1746142914.078964:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142914.079051:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951200/0x2fa243e067ccd8c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 23 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.079061:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 22 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.079068:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.079070:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142914.079072:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d950e00, rc 0) 00000100:00100000:0.0:1746142914.079098:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:32552:x1830962867476608:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8445us (8741us total) trans 8589936651 rc 0/0 00000100:00100000:0.0:1746142914.079103:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14477 00000100:00080000:2.0:1746142914.079243:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142914.081629:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.081665:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.081765:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867477376 00000100:00100000:3.0:1746142914.081771:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867477376 00002000:00100000:3.0:1746142914.081803:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012dbf5c00 x1830962867477376/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.081812:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5c00 with x1830962867477376 ext(0->1048575) 00002000:00010000:3.0:1746142914.081816:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf5c00 00000100:00100000:3.0:1746142914.081828:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867477632 00000100:00100000:3.0:1746142914.081830:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867477632 00002000:00100000:3.0:1746142914.081840:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dbf7480 x1830962867477632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.081846:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7480 with x1830962867477632 ext(1048576->2097151) 00002000:00010000:3.0:1746142914.081849:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7480 00000100:00100000:3.0:1746142914.081860:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4508 00000100:00100000:3.0:1746142914.081867:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867477376:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.082472:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4509 00000100:00100000:2.0:1746142914.082480:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867477632:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.092861:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867477376:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10985us (11227us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142914.092872:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4508 00002000:00100000:0.0:1746142914.092881:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012dbf5c00 x1830962867477376/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.092890:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5c00 with x1830962867477376 ext(0->1048575) 00002000:00010000:0.0:1746142914.092895:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf5c00 00000100:00100000:2.0:1746142914.096869:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867477632:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14382us (15194us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.096879:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4509 00002000:00100000:2.0:1746142914.096889:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dbf7480 x1830962867477632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.096916:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7480 with x1830962867477632 ext(1048576->2097151) 00002000:00010000:2.0:1746142914.096922:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7480 00000100:00100000:0.0:1746142914.114752:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.114815:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867477760 00000100:00100000:3.0:1746142914.114823:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867477760 00000100:00100000:3.0:1746142914.114995:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14477 00000100:00100000:3.0:1746142914.115004:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+11:32551:x1830962867477760:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.115021:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.115036:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adce expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.115057:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.115059:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.115065:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.115077:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 12 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.115086:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881e00, rc 0) 00000100:00100000:3.0:1746142914.115128:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:32551:x1830962867477760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 126us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.115133:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14477 00010000:00010000:3.0:1746142914.116813:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142914.118854:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.118936:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867478016 00000100:00100000:2.0:1746142914.118945:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867478016 00002000:00100000:2.0:1746142914.118983:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012dbf7100 x1830962867478016/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.118991:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7100 with x1830962867478016 ext(2097152->4194303) 00002000:00010000:2.0:1746142914.118995:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf7100 00000100:00100000:2.0:1746142914.119016:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4510 00000100:00100000:2.0:1746142914.119023:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867478016:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.121086:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.121289:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867478272 00000100:00100000:1.0:1746142914.121306:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867478272 00002000:00100000:1.0:1746142914.121342:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dbf7800 x1830962867478272/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.121351:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7800 with x1830962867478272 ext(1048576->2097151) 00002000:00010000:1.0:1746142914.121356:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7800 00000100:00100000:1.0:1746142914.121372:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4511 00000100:00100000:1.0:1746142914.121378:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867478272:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.127139:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.127825:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867478528 00000100:00100000:2.0:1746142914.127834:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867478528 00000100:00100000:2.0:1746142914.127885:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14478 00000100:00100000:2.0:1746142914.127892:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32554:x1830962867478528:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.127941:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.127957:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd8e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8add5 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.128015:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128025:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128034:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128045:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128050:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128054:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128125:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd8f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128133:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128138:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd8f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142914.128145:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.128195:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128201:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128206:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128211:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128216:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cde00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.128219:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128224:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128232:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142914.128234:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.128237:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128242:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd8e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128274:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128279:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128283:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128287:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cce00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.128289:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128293:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128311:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdd00) 00010000:00010000:2.0:1746142914.128314:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.128317:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128321:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd8ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.128350:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd8e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8add5 expref: 40 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.128359:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd8f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8add5 expref: 39 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.128365:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.128366:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746142914.128368:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cc600, rc 0) 00000100:00100000:2.0:1746142914.128407:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32554:x1830962867478528:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 515us (1275us total) trans 8589936652 rc 0/0 00000100:00100000:2.0:1746142914.128412:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14478 00000100:00100000:2.0:1746142914.134810:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867478016:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15780us (15954us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142914.134821:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4510 00002000:00100000:2.0:1746142914.134829:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88012dbf7100 x1830962867478016/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.134838:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7100 with x1830962867478016 ext(2097152->4194303) 00002000:00010000:2.0:1746142914.134842:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf7100 00000100:00100000:1.0:1746142914.137275:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867478272:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15890us (16187us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142914.137285:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4511 00002000:00100000:1.0:1746142914.137293:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012dbf7800 x1830962867478272/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.137312:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf7800 with x1830962867478272 ext(1048576->2097151) 00002000:00010000:1.0:1746142914.137316:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dbf7800 00000100:00100000:0.0:1746142914.137487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.137572:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867478656 00000100:00100000:1.0:1746142914.137578:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867478656 00000100:00100000:1.0:1746142914.137626:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 772 00000100:00100000:1.0:1746142914.137634:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867478656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.137646:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.137666:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd8f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8add5 expref: 39 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.137694:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.137698:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.137718:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867478656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.137724:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 772 00000100:00100000:1.0:1746142914.145091:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.146734:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867478912 00000100:00100000:2.0:1746142914.146745:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867478912 00002000:00100000:2.0:1746142914.146783:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880130123100 x1830962867478912/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.146798:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123100 with x1830962867478912 ext(4194304->5066751) 00002000:00010000:2.0:1746142914.146803:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130123100 00000100:00100000:2.0:1746142914.146836:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4512 00000100:00100000:2.0:1746142914.146843:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867478912:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.152322:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.152445:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867479168 00000100:00100000:2.0:1746142914.152453:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867479168 00002000:00100000:2.0:1746142914.152488:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880088d7e680 x1830962867479168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.152497:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7e680 with x1830962867479168 ext(2097152->4194303) 00002000:00010000:2.0:1746142914.152502:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7e680 00000100:00100000:2.0:1746142914.152532:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4513 00000100:00100000:2.0:1746142914.152539:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867479168:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142914.156930:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867478912:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10054us (11813us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142914.156939:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4512 00002000:00100000:3.0:1746142914.156949:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880130123100 x1830962867478912/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.156957:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123100 with x1830962867478912 ext(4194304->5066751) 00002000:00010000:3.0:1746142914.156962:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130123100 00000100:00100000:0.0:1746142914.162177:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867850624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746142914.162241:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142914.162729:0:13943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867850624 00000100:00100000:2.0:1746142914.162738:0:13943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867850624 00000100:00100000:2.0:1746142914.162793:0:13943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1746142914.162803:0:13943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830962867850624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746142914.162825:0:13943:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1183267648 pending 1142784 free 3906605056 avail 3665219584 00000100:00100000:2.0:1746142914.162866:0:13943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830962867850624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.162872:0:13943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00080000:2.0:1746142914.162894:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746142914.163888:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867850624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746142914.165583:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.165636:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867479424 00000100:00100000:3.0:1746142914.165643:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867479424 00000100:00100000:3.0:1746142914.165688:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5286 00000100:00100000:3.0:1746142914.165694:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32547:x1830962867479424:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142914.166231:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32547:x1830962867479424:12345-192.168.204.50@tcp:35:cat.0 Request processed in 535us (651us total) trans 8589936653 rc 0/0 00000100:00100000:3.0:1746142914.166239:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5286 00000100:00100000:2.0:1746142914.170060:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867479168:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17513us (17737us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142914.170070:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4513 00002000:00100000:2.0:1746142914.170080:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880088d7e680 x1830962867479168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.170089:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7e680 with x1830962867479168 ext(2097152->4194303) 00002000:00010000:2.0:1746142914.170094:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7e680 00000100:00100000:0.0:1746142914.180289:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.181383:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867479680 00000100:00100000:2.0:1746142914.181393:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867479680 00002000:00100000:2.0:1746142914.181434:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5062655) req@ffff880088d7c000 x1830962867479680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.181444:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c000 with x1830962867479680 ext(4194304->5062655) 00002000:00010000:2.0:1746142914.181449:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7c000 00000100:00100000:2.0:1746142914.181482:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4514 00000100:00100000:2.0:1746142914.181489:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867479680:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.189646:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867479680:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8149us (9357us total) trans 0 rc 868352/868352 00000100:00100000:2.0:1746142914.189657:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4514 00002000:00100000:2.0:1746142914.189667:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5062655) req@ffff880088d7c000 x1830962867479680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 868352/868352 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.189675:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c000 with x1830962867479680 ext(4194304->5062655) 00002000:00010000:2.0:1746142914.189681:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7c000 00000100:00100000:0.0:1746142914.197424:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.197499:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867479808 00000100:00100000:2.0:1746142914.197507:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867479808 00000100:00100000:2.0:1746142914.197557:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14478 00000100:00100000:2.0:1746142914.197564:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32554:x1830962867479808:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.197580:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.197594:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8addc expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.197619:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.197626:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.197632:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.197634:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.197637:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2392064->2895871] (req 2392064->2895871) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.197663:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.197675:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.197686:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867850752:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.197789:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 9 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.197797:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 9 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.197804:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867850880:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.197823:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.201602:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.201664:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867479936 00000100:00100000:3.0:1746142914.201672:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867479936 00000100:00100000:3.0:1746142914.201715:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14479 00000100:00100000:3.0:1746142914.201722:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+10:32552:x1830962867479936:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142914.201736:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.201749:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ade3 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.201770:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.201775:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2392064->2895871] (req 2392064->2895871) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.201780:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142914.201783:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2609152->3145727] (req 2609152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.201808:0:1852:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2392064->2895871] (req 2392064->2895871) gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.201816:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2609152->3145727] (req 2609152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 11 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.201828:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881000, rc 0) 00000100:00100000:3.0:1746142914.201870:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+11:32552:x1830962867479936:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 149us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.201875:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14479 00000100:00100000:2.0:1746142914.202668:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867850752:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.202677:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867850880:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.202693:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2392064->2895871] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 28 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.202703:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cd200, rc 0) 00000100:00100000:2.0:1746142914.202724:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32554:x1830962867479808:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5161us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.202730:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14478 00000100:00100000:0.0:1746142914.205390:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.205433:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.205547:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867480320 00000100:00100000:2.0:1746142914.205554:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867480320 00010000:00010000:2.0:1746142914.205583:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746142914.205927:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867480192 00000100:00100000:3.0:1746142914.205931:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867480192 00000100:00100000:3.0:1746142914.205961:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5287 00000100:00100000:3.0:1746142914.205967:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:32551:x1830962867480192:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142914.206027:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.206125:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:32551:x1830962867480192:12345-192.168.204.50@tcp:35:cat.0 Request processed in 156us (740us total) trans 8589936654 rc 0/0 00000100:00100000:3.0:1746142914.206131:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5287 00000100:00100000:2.0:1746142914.206325:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867480448 00000100:00100000:2.0:1746142914.206328:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867480448 00010000:00010000:2.0:1746142914.206343:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 11 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.206363:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6544 00000100:00100000:2.0:1746142914.206368:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867480320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.206377:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.206392:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.206406:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.206423:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ebea00/0x2fa243e067ccd87f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad9d expref: 28 pid: 11943 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.206436:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.206455:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867480320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.206460:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6544 00000100:00100000:2.0:1746142914.206471:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6545 00000100:00100000:2.0:1746142914.206475:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867480448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.206482:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.206487:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 11 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.206495:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 11 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.206505:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ed0a00/0x2fa243e067ccd839 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad73 expref: 11 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.206513:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.206514:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.206519:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.206527:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.206550:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 26 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.206560:0:7218:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 26 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.206570:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867851136:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142914.206604:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.208069:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.208154:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867851136:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142914.208165:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.208294:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867480704 00000100:00100000:3.0:1746142914.208308:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867480704 00002000:00100000:3.0:1746142914.208340:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2392064->2396159) req@ffff880088d7e300 x1830962867480704/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.208349:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7e300 with x1830962867480704 ext(2392064->2396159) 00010000:00010000:3.0:1746142914.208355:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.208365:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.208370:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7e300 00000100:00100000:3.0:1746142914.208385:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1401 00000100:00100000:3.0:1746142914.208391:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867480704:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142914.208517:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867480448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2040us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.208524:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6545 00000100:00100000:3.0:1746142914.209925:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867480704:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1530us (1857us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142914.209932:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1401 00002000:00100000:3.0:1746142914.209939:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2392064->2396159) req@ffff880088d7e300 x1830962867480704/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.209946:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7e300 with x1830962867480704 ext(2392064->2396159) 00010000:00010000:3.0:1746142914.209952:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.209963:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.209968:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7e300 00000100:00100000:0.0:1746142914.216870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.217006:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867480960 00000100:00100000:3.0:1746142914.217015:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867480960 00002000:00100000:3.0:1746142914.217053:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2891776->2895871) req@ffff880088d7c380 x1830962867480960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.217062:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c380 with x1830962867480960 ext(2891776->2895871) 00010000:00010000:3.0:1746142914.217070:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.217082:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.217088:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7c380 00000100:00100000:3.0:1746142914.217119:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1402 00000100:00100000:3.0:1746142914.217126:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867480960:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142914.217240:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867480960:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 114us (376us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142914.217247:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1402 00002000:00100000:3.0:1746142914.217252:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2891776->2895871) req@ffff880088d7c380 x1830962867480960/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.217259:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c380 with x1830962867480960 ext(2891776->2895871) 00010000:00010000:3.0:1746142914.217264:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.217272:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.217277:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7c380 00000100:00100000:2.0:1746142914.238529:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.238573:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.238610:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867481216 00000100:00100000:0.0:1746142914.238611:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867481472 00000100:00100000:3.0:1746142914.238617:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867481216 00000100:00100000:0.0:1746142914.238617:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867481472 00002000:00100000:3.0:1746142914.238644:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2392064->2895871) req@ffff880091de2680 x1830962867481216/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746142914.238645:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5288 00002000:00100000:3.0:1746142914.238650:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2680 with x1830962867481216 ext(2392064->2895871) 00000100:00100000:0.0:1746142914.238650:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32554:x1830962867481472:12345-192.168.204.50@tcp:35:multiop.0 00010000:00010000:3.0:1746142914.238656:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.238665:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.238673:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de2680 00000100:00100000:3.0:1746142914.238682:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1403 00000100:00100000:3.0:1746142914.238685:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867481216:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142914.238768:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32554:x1830962867481472:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 118us (247us total) trans 8589936655 rc 0/0 00000100:00100000:0.0:1746142914.238773:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5288 00000100:00100000:3.0:1746142914.248402:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867481216:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 9705us (9819us total) trans 21474841233 rc 0/0 00000100:00100000:3.0:1746142914.248412:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1403 00002000:00100000:3.0:1746142914.248459:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2392064->2895871) req@ffff880091de2680 x1830962867481216/t21474841233(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.248468:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de2680 with x1830962867481216 ext(2392064->2895871) 00010000:00010000:3.0:1746142914.248476:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 29 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.248489:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 29 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.248495:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091de2680 00000100:00100000:0.0:1746142914.251449:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.251544:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867481600 00000100:00100000:2.0:1746142914.251552:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867481600 00010000:00010000:2.0:1746142914.251580:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 29 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.251617:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6546 00000100:00100000:2.0:1746142914.251624:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867481600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.251635:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.251650:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 29 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.251660:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 29 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.251679:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd904 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2392064->2895871) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8addc expref: 29 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.251702:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.251704:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.251710:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.251717:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.251741:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.251750:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867851264:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142914.252023:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.254496:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867851264:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142914.254512:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.254551:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867481600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2926us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.254559:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6546 00000100:00100000:0.0:1746142914.260292:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.261550:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867481728 00000100:00100000:2.0:1746142914.261559:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867481728 00000100:00100000:2.0:1746142914.262111:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14480 00000100:00100000:2.0:1746142914.262120:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:32552:x1830962867481728:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.263456:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.263476:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adea expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.263503:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.263511:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.263517:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.263523:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.263524:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.263527:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->2330623] (req 2097152->2330623) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.263552:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.263563:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 10 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.263573:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867851392:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.263680:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.263688:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.263700:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867851520:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.263731:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.263739:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 27 pid: 1854 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.263746:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867851648:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.263764:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.265443:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867851392:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.265453:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867851520:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.265460:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867851648:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.265482:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2097152->2330623] (req 2097152->2330623) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.265500:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:2.0:1746142914.265531:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:32552:x1830962867481728:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3411us (5245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.265537:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14480 00000100:00100000:0.0:1746142914.267763:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.267817:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.267856:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.268015:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867481856 00000100:00100000:1.0:1746142914.268015:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867481984 00000100:00100000:3.0:1746142914.268021:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867481856 00000100:00100000:1.0:1746142914.268022:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867481984 00000100:00100000:2.0:1746142914.268042:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867482112 00010000:00010000:3.0:1746142914.268045:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 11 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.268045:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.268047:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867482112 00010000:00010000:2.0:1746142914.268062:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 28 pid: 1854 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.268066:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6547 00000100:00100000:3.0:1746142914.268072:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6548 00000100:00100000:1.0:1746142914.268072:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867481984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142914.268076:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867481856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.268084:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.268086:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142914.268087:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6549 00000100:00100000:2.0:1746142914.268092:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867482112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.268098:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.268098:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746142914.268099:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 11 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.268105:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 28 pid: 1854 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.268107:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746142914.268116:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 11 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.268181:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 28 pid: 1854 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.268198:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f1400/0x2fa243e067ccd7d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad3b expref: 13 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746142914.268205:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4400/0x2fa243e067ccd78a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad18 expref: 11 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.268210:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5600/0x2fa243e067ccd72f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acee expref: 28 pid: 1854 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.268221:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.268223:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.268228:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.268235:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.268244:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142914.268259:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.268269:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867851776:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.268275:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867481856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 197us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.268281:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6548 00010000:00010000:2.0:1746142914.268312:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.268313:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.268332:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867482112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 239us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.268338:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6549 00000100:00100000:1.0:1746142914.273721:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867851776:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142914.273945:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142914.274115:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.274162:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867481984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6088us (6405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.274172:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6547 00000100:00100000:3.0:1746142914.274214:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867482368 00000100:00100000:3.0:1746142914.274221:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867482368 00002000:00100000:3.0:1746142914.274252:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2326528->2330623) req@ffff880088d7c700 x1830962867482368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.274261:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c700 with x1830962867482368 ext(2326528->2330623) 00002000:00010000:3.0:1746142914.274265:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7c700 00000100:00100000:3.0:1746142914.274292:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4515 00000100:00100000:3.0:1746142914.274308:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867482368:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142914.274402:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867482368:12345-192.168.204.50@tcp:3:cat.0 Request processed in 104us (457us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142914.274408:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4515 00002000:00100000:3.0:1746142914.274413:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2326528->2330623) req@ffff880088d7c700 x1830962867482368/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.274420:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7c700 with x1830962867482368 ext(2326528->2330623) 00002000:00010000:3.0:1746142914.274422:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7c700 00000100:00100000:3.0:1746142914.289604:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.289646:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867482624 00000100:00100000:1.0:1746142914.289654:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867482624 00000100:00100000:1.0:1746142914.289704:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14479 00000100:00100000:1.0:1746142914.289711:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32562:x1830962867482624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.289729:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.289743:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7200/0x2fa243e067ccd919 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adf1 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.289797:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289806:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289814:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289827:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289831:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289836:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289929:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7400/0x2fa243e067ccd92e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289936:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7400/0x2fa243e067ccd92e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.289940:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7400/0x2fa243e067ccd92e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142914.289946:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142914.289998:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290003:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290007:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290012:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe6400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142914.290015:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290020:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290029:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142914.290031:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142914.290034:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290039:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067ccd920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290056:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290060:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290063:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290067:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe6200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142914.290069:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290072:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290077:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9e7b00) 00010000:00010000:1.0:1746142914.290078:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142914.290080:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290084:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccd927 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.290111:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7200/0x2fa243e067ccd919 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adf1 expref: 43 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.290122:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7400/0x2fa243e067ccd92e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adf1 expref: 42 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.290127:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.290128:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142914.290130:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe7400, rc 0) 00000100:00100000:1.0:1746142914.290179:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32562:x1830962867482624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 467us (582us total) trans 8589936656 rc 0/0 00000100:00100000:1.0:1746142914.290184:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14479 00000100:00100000:0.0:1746142914.291637:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.291992:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.292041:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.292055:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867482880 00000100:00100000:0.0:1746142914.292060:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867482880 00000100:00100000:0.0:1746142914.292087:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483008 00000100:00100000:0.0:1746142914.292088:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483008 00000100:00100000:0.0:1746142914.292104:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14481 00000100:00100000:0.0:1746142914.292109:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867482880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.292118:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142914.292129:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14482 00010000:00010000:0.0:1746142914.292129:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067ccd93c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adf8 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.292137:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867483008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.292145:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.292154:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880400/0x2fa243e067ccd943 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8adff expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.292170:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867851904:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142914.292177:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867852032:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142914.292183:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867482752 00000100:00100000:1.0:1746142914.292188:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867482752 00000100:00100000:1.0:1746142914.292211:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 773 00000100:00100000:1.0:1746142914.292215:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867482752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.292224:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142914.292228:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746142914.292236:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7400/0x2fa243e067ccd92e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adf1 expref: 42 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.292248:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.292251:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.292268:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867482752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 52us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.292272:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 773 00000100:00100000:0.0:1746142914.292764:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.293949:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867852032:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142914.293967:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c880400/0x2fa243e067ccd943 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adff expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.293977:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c880400/0x2fa243e067ccd943 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adff expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.293997:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880400, rc 0) 00000100:00100000:3.0:1746142914.294021:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867483008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1885us (1979us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142914.294026:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14482 00000100:00100000:1.0:1746142914.294231:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867851904:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142914.294244:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067ccd93c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adf8 expref: 29 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.294254:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097107800/0x2fa243e067ccd93c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adf8 expref: 29 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.294259:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097107800, rc 0) 00000100:00100000:1.0:1746142914.294273:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867482880:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2164us (2282us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142914.294277:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14481 00000100:00100000:0.0:1746142914.301524:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.301574:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.301656:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483136 00000100:00100000:1.0:1746142914.301664:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483136 00000100:00100000:1.0:1746142914.301710:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483264 00000100:00100000:1.0:1746142914.301712:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483264 00000100:00100000:3.0:1746142914.301720:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14483 00000100:00100000:3.0:1746142914.301729:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867483136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.301743:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.301756:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccd94a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae06 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.301798:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867852160:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142914.301836:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14484 00000100:00100000:1.0:1746142914.301842:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867483264:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142914.301868:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746142914.302043:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.302053:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6a00/0x2fa243e067ccd951 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae0d expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.302079:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867852288:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142914.302129:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.304414:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867852160:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142914.304437:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccd94a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae06 expref: 29 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.304448:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880a00/0x2fa243e067ccd94a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae06 expref: 29 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.304461:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880a00, rc 0) 00000100:00100000:3.0:1746142914.304488:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867483136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2761us (2971us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142914.304495:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14483 00000100:00100000:1.0:1746142914.304539:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867852288:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142914.304558:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6a00/0x2fa243e067ccd951 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae0d expref: 28 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.304567:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6a00/0x2fa243e067ccd951 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae0d expref: 28 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.304578:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6a00, rc 0) 00000100:00100000:1.0:1746142914.304594:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867483264:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2753us (3020us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142914.304599:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14484 00000100:00100000:3.0:1746142914.309749:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.309837:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483392 00000100:00100000:1.0:1746142914.309845:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483392 00000100:00100000:1.0:1746142914.309961:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14485 00000100:00100000:1.0:1746142914.309970:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32562:x1830962867483392:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.309996:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.310020:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae14 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.310055:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.310062:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.310063:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.310066:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 29 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.310118:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 9 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.310128:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 9 pid: 1852 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.310153:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867852416:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.310805:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.313801:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867852416:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.313829:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 29 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.313845:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6600, rc 0) 00000100:00100000:0.0:1746142914.313950:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.313999:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32562:x1830962867483392:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4029us (4255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.314002:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483520 00000100:00100000:1.0:1746142914.314006:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14485 00000100:00100000:3.0:1746142914.314007:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483520 00002000:00100000:3.0:1746142914.314036:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2609152->3145727) req@ffff88012b1a3480 x1830962867483520/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.314045:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a3480 with x1830962867483520 ext(2609152->3145727) 00010000:00010000:3.0:1746142914.314050:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 10 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.314061:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 10 pid: 1852 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.314067:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1a3480 00000100:00100000:3.0:1746142914.314081:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1404 00000100:00100000:3.0:1746142914.314087:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867483520:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142914.324786:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867483520:12345-192.168.204.50@tcp:4:cat.0 Request processed in 10691us (10829us total) trans 21474841234 rc 0/0 00000100:00100000:3.0:1746142914.324795:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1404 00002000:00100000:3.0:1746142914.324805:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2609152->3145727) req@ffff88012b1a3480 x1830962867483520/t21474841234(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.324814:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a3480 with x1830962867483520 ext(2609152->3145727) 00010000:00010000:3.0:1746142914.324823:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 12 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.324837:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 12 pid: 1852 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.324843:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b1a3480 00000100:00100000:0.0:1746142914.327009:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.327071:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483648 00000100:00100000:1.0:1746142914.327078:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483648 00010000:00010000:1.0:1746142914.327104:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 12 pid: 1852 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.327135:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6550 00000100:00100000:1.0:1746142914.327146:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867483648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.327157:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.327172:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 12 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.327181:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 12 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.327200:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c881000/0x2fa243e067ccd90b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2609152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ade3 expref: 12 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.327217:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.327219:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.327225:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.327232:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.327258:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.327268:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867852544:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142914.327335:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.328251:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867852544:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142914.328384:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.328421:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2004:x1830962867483648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1278us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.328549:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6550 00000100:00100000:2.0:1746142914.330686:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.330760:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867483904 00000100:00100000:3.0:1746142914.330767:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867483904 00002000:00100000:3.0:1746142914.330800:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880091de1f80 x1830962867483904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.330808:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1f80 with x1830962867483904 ext(2097152->3145727) 00002000:00010000:3.0:1746142914.330813:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de1f80 00000100:00100000:3.0:1746142914.330839:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4516 00000100:00100000:3.0:1746142914.330846:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867483904:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.338611:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867483904:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7757us (7920us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.338621:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4516 00002000:00100000:2.0:1746142914.338631:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880091de1f80 x1830962867483904/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.338641:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091de1f80 with x1830962867483904 ext(2097152->3145727) 00002000:00010000:2.0:1746142914.338646:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091de1f80 00000100:00100000:0.0:1746142914.341769:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.341825:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867484032 00000100:00100000:1.0:1746142914.341834:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867484032 00000100:00100000:1.0:1746142914.341881:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14486 00000100:00100000:1.0:1746142914.341888:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32562:x1830962867484032:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.341931:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.341946:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae1b expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.341969:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.341975:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.341977:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.341980:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.342003:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 11 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.342019:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 11 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.342029:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867852672:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.342116:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.344211:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.344265:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867484160 00000100:00100000:2.0:1746142914.344272:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867484160 00002000:00100000:2.0:1746142914.344313:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2330623) req@ffff88012b1a1c00 x1830962867484160/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746142914.344315:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867852672:192.168.204.50@tcp:104: 00002000:00100000:2.0:1746142914.344322:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1c00 with x1830962867484160 ext(2097152->2330623) 00010000:00010000:2.0:1746142914.344329:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 12 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.344339:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.344341:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 12 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.344348:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1a1c00 00010000:00010000:1.0:1746142914.344351:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1c00, rc 0) 00000100:00100000:2.0:1746142914.344364:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1405 00000100:00100000:2.0:1746142914.344370:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867484160:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142914.344380:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32562:x1830962867484032:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2492us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.344387:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14486 00000100:00100000:2.0:1746142914.348051:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867484160:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3672us (3838us total) trans 17179873973 rc 0/0 00000100:00100000:2.0:1746142914.348061:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1405 00002000:00100000:2.0:1746142914.348072:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2330623) req@ffff88012b1a1c00 x1830962867484160/t17179873973(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.348080:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1c00 with x1830962867484160 ext(2097152->2330623) 00010000:00010000:2.0:1746142914.348090:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.348102:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.348109:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b1a1c00 00000100:00100000:0.0:1746142914.350256:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.351247:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867484288 00000100:00100000:1.0:1746142914.351254:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867484288 00010000:00010000:1.0:1746142914.351283:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.351321:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6551 00000100:00100000:1.0:1746142914.351327:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867484288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.351338:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.351352:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.351362:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.351381:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968cde00/0x2fa243e067ccd912 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adea expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.351400:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.351402:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.351408:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 27 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.351415:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 27 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.351441:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 27 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.351452:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867852800:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142914.351519:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cfb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.358132:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867852800:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142914.358153:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.358197:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867484288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6868us (7945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.358206:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6551 00000100:00100000:0.0:1746142914.359700:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.360227:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867484800 00000100:00100000:2.0:1746142914.360235:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867484800 00002000:00100000:2.0:1746142914.360272:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88012b1a2300 x1830962867484800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.360281:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a2300 with x1830962867484800 ext(3145728->4194303) 00002000:00010000:2.0:1746142914.360285:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a2300 00000100:00100000:2.0:1746142914.360316:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4517 00000100:00100000:2.0:1746142914.360323:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867484800:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.360980:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.361026:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867484672 00000100:00100000:0.0:1746142914.361031:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867484672 00002000:00100000:0.0:1746142914.361050:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880130122d80 x1830962867484672/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.361058:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130122d80 with x1830962867484672 ext(2097152->4194303) 00002000:00010000:0.0:1746142914.361062:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130122d80 00000100:00100000:0.0:1746142914.361087:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4518 00000100:00100000:0.0:1746142914.361093:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867484672:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.374211:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867484800:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13721us (14348us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142914.374220:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4517 00002000:00100000:0.0:1746142914.374231:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88012b1a2300 x1830962867484800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.374239:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a2300 with x1830962867484800 ext(3145728->4194303) 00002000:00010000:0.0:1746142914.374245:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a2300 00000100:00100000:0.0:1746142914.382860:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867484672:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21759us (21872us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142914.382870:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4518 00002000:00100000:0.0:1746142914.382879:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880130122d80 x1830962867484672/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.382887:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130122d80 with x1830962867484672 ext(2097152->4194303) 00002000:00010000:0.0:1746142914.382892:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130122d80 00000100:00100000:0.0:1746142914.390415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.390474:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867485056 00000100:00100000:2.0:1746142914.390481:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867485056 00002000:00100000:2.0:1746142914.390524:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012b1a1500 x1830962867485056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.390534:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1500 with x1830962867485056 ext(4194304->5066751) 00002000:00010000:2.0:1746142914.390539:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a1500 00000100:00100000:2.0:1746142914.390567:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4519 00000100:00100000:2.0:1746142914.390575:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867485056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.397023:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.397051:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867485312 00000100:00100000:2.0:1746142914.397058:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867485312 00000100:00100000:2.0:1746142914.397109:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14480 00000100:00100000:3.0:1746142914.397219:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867485056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6643us (6810us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142914.397227:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4519 00002000:00100000:3.0:1746142914.397236:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012b1a1500 x1830962867485056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.397245:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1500 with x1830962867485056 ext(4194304->5066751) 00002000:00010000:3.0:1746142914.397249:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a1500 00000100:00100000:2.0:1746142914.397306:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:32564:x1830962867485312:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.397323:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.397336:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae22 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.397391:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397400:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397408:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397416:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397421:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397426:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397497:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd97b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397505:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd97b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397511:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd97b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142914.397517:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.397573:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397578:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397582:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397587:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397591:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cc600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.397594:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397599:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397607:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142914.397609:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.397612:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397616:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067ccd96d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397639:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397647:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397651:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397654:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cd200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.397656:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397660:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397665:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdd00) 00010000:00010000:2.0:1746142914.397667:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.397668:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397672:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067ccd974 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142914.397699:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067ccd966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae22 expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.397710:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd97b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae22 expref: 25 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.397715:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.397716:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746142914.397718:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:2.0:1746142914.397738:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:32564:x1830962867485312:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 448us (722us total) trans 8589936657 rc 0/0 00000100:00100000:2.0:1746142914.397744:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14480 00000100:00100000:0.0:1746142914.402027:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.402068:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.402113:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867485696 00000100:00100000:2.0:1746142914.402121:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867485696 00000100:00100000:2.0:1746142914.402169:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5289 00000100:00100000:2.0:1746142914.402177:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:32564:x1830962867485696:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142914.402210:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867485440 00000100:00100000:1.0:1746142914.402214:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867485440 00000100:00100000:1.0:1746142914.402239:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 774 00000100:00100000:1.0:1746142914.402243:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867485440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.402250:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.402269:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067ccd97b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae22 expref: 26 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.402282:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.402285:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.402384:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867485440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.402389:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 774 00000100:00100000:2.0:1746142914.403406:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:32564:x1830962867485696:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 152us (259us total) trans 8589936658 rc 0/0 00000100:00100000:2.0:1746142914.403413:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5289 00000100:00100000:2.0:1746142914.406993:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.407073:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867485952 00000100:00100000:0.0:1746142914.407083:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867485952 00000100:00100000:0.0:1746142914.407131:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5290 00000100:00100000:0.0:1746142914.407140:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32562:x1830962867485952:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142914.407387:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32562:x1830962867485952:12345-192.168.204.50@tcp:35:cat.0 Request processed in 246us (397us total) trans 8589936659 rc 0/0 00000100:00100000:0.0:1746142914.407395:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5290 00000100:00100000:1.0:1746142914.416716:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867852928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1746142914.416783:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142914.416996:0:7235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867852928 00000100:00100000:2.0:1746142914.417004:0:7235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867852928 00000100:00100000:2.0:1746142914.417037:0:7235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1746142914.417043:0:7235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3763:x1830962867852928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1746142914.417073:0:7235:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445654528 avail 1316192256 00000100:00100000:2.0:1746142914.417105:0:7235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3763:x1830962867852928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.417111:0:7235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1746142914.417872:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867852928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746142914.426655:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.426748:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867486208 00000100:00100000:1.0:1746142914.426757:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867486208 00000100:00100000:1.0:1746142914.426811:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14481 00000100:00100000:1.0:1746142914.426819:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+25:32568:x1830962867486208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.426838:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.426853:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccd989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae29 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.426935:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.426945:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.426954:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.426965:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.426970:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.426974:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427047:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccd99e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427056:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccd99e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427062:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccd99e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142914.427069:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142914.427130:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427136:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427141:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427145:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd8fa00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142914.427148:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427154:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427162:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142914.427164:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142914.427167:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427171:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccd990 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427186:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427190:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427195:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427202:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd8ec00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142914.427204:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427208:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427213:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9e7400) 00010000:00010000:1.0:1746142914.427215:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142914.427217:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427221:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067ccd997 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.427249:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccd989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae29 expref: 28 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.427258:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccd99e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae29 expref: 27 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.427262:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.427264:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746142914.427266:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8f000, rc 0) 00000100:00100000:1.0:1746142914.428000:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:32568:x1830962867486208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1180us (1350us total) trans 8589936660 rc 0/0 00000100:00100000:1.0:1746142914.428007:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14481 00000100:00100000:0.0:1746142914.431151:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.431735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.432206:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.432258:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867486336 00000100:00100000:2.0:1746142914.432266:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867486336 00000100:00100000:2.0:1746142914.432325:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 775 00000100:00100000:2.0:1746142914.432332:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867486336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.432344:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.432363:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccd99e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae29 expref: 27 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.432384:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.432388:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.432419:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867486336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.432420:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3764:1830962867853056:0@lo:400:kworker.0 00000100:00100000:2.0:1746142914.432424:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 775 00000100:00100000:2.0:1746142914.432439:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867853184:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432450:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142914.432459:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.432489:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3764:1830962867853568:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432506:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.432518:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867854080:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432530:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.432554:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867486464 00000100:00100000:1.0:1746142914.432557:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867486464 00000100:00100000:1.0:1746142914.432574:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867486592 00000100:00100000:1.0:1746142914.432575:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867486592 00000100:00100000:1.0:1746142914.432585:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867854080 00000100:00100000:1.0:1746142914.432586:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867854080 00000100:00100000:1.0:1746142914.432603:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1746142914.432607:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867854080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432635:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867854080:12345-0@lo:400:kworker.0 Request processed in 28us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.432640:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1746142914.432649:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14487 00000100:00100000:1.0:1746142914.432653:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867486464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.432661:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.432670:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae30 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.432684:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.432685:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.432691:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.432701:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.432714:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8e600, rc 0) 00000100:00100000:1.0:1746142914.432726:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867486464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.432730:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14487 00000100:00100000:1.0:1746142914.432738:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14488 00000100:00100000:1.0:1746142914.432741:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867486592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.432747:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.432753:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae37 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.432761:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.432762:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.432766:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.432774:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.432779:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8e200, rc 0) 00000100:00100000:1.0:1746142914.432790:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867486592:12345-192.168.204.50@tcp:101:cat.0 Request processed in 48us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.432794:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14488 00000100:00080000:1.0:1746142914.432807:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746142914.432826:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841227 gen 2 00000004:00080000:1.0:1746142914.432831:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809ce00, transno 21474841200 00000004:00080000:1.0:1746142914.432836:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809e300, transno 21474841201 00000004:00080000:1.0:1746142914.432839:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809dc00, transno 21474841202 00000004:00080000:1.0:1746142914.432840:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809f800, transno 21474841203 00000004:00080000:1.0:1746142914.432843:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809c380, transno 21474841204 00000004:00080000:1.0:1746142914.432844:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809d500, transno 21474841205 00000004:00080000:1.0:1746142914.432846:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809f480, transno 21474841206 00000004:00080000:1.0:1746142914.432848:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809fb80, transno 21474841207 00000004:00080000:1.0:1746142914.432850:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d62d80, transno 21474841212 00000004:00080000:1.0:1746142914.432852:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d62680, transno 21474841213 00000004:00080000:1.0:1746142914.432854:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60e00, transno 21474841214 00000004:00080000:1.0:1746142914.432856:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d60a80, transno 21474841215 00000004:00080000:1.0:1746142914.432858:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61c00, transno 21474841216 00000004:00080000:1.0:1746142914.432860:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d62a00, transno 21474841217 00000004:00080000:1.0:1746142914.432862:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61180, transno 21474841218 00000004:00080000:1.0:1746142914.432863:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d61f80, transno 21474841219 00000004:00080000:1.0:1746142914.432865:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fda300, transno 21474841220 00000004:00080000:1.0:1746142914.432866:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd8380, transno 21474841221 00000004:00080000:1.0:1746142914.432868:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd9880, transno 21474841222 00000004:00080000:1.0:1746142914.432870:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fdbb80, transno 21474841223 00000004:00080000:1.0:1746142914.432871:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fdaa00, transno 21474841224 00000004:00080000:1.0:1746142914.432873:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd9500, transno 21474841225 00000004:00080000:1.0:1746142914.432874:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd9180, transno 21474841226 00000004:00080000:1.0:1746142914.432876:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088fd8700, transno 21474841227 00000100:00100000:1.0:1746142914.432880:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867854080:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432894:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867853440:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432937:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.432949:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3763:1830962867853952:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432961:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.432972:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746142914.432976:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3763:1830962867853312:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.432988:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.432997:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3763:1830962867853824:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433008:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.433017:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3763:1830962867854336:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433028:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142914.433044:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853568 00000100:00100000:1.0:1746142914.433046:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853568 00000100:00100000:1.0:1746142914.433066:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853952 00000100:00100000:1.0:1746142914.433068:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853952 00000100:00100000:1.0:1746142914.433077:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853312 00000100:00100000:1.0:1746142914.433078:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853312 00000100:00100000:1.0:1746142914.433083:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853824 00000100:00100000:1.0:1746142914.433085:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853824 00000100:00100000:1.0:1746142914.433091:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867854336 00000100:00100000:1.0:1746142914.433093:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867854336 00000100:00100000:1.0:1746142914.433099:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1746142914.433104:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830962867853568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433125:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3764:x1830962867853568:12345-0@lo:400:kworker.0 Request processed in 21us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.433130:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1746142914.433137:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1746142914.433141:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3763:x1830962867853952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433159:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3763:x1830962867853952:12345-0@lo:400:kworker.0 Request processed in 18us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.433163:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:1.0:1746142914.433169:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1746142914.433173:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3763:x1830962867853312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433189:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3763:x1830962867853312:12345-0@lo:400:kworker.0 Request processed in 16us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.433193:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:1.0:1746142914.433199:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1746142914.433202:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3763:x1830962867853824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433217:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3763:x1830962867853824:12345-0@lo:400:kworker.0 Request processed in 14us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.433221:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1746142914.433227:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1746142914.433230:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3763:x1830962867854336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433244:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3763:x1830962867854336:12345-0@lo:400:kworker.0 Request processed in 13us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.433248:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1746142914.433263:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853440 00000100:00100000:1.0:1746142914.433265:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853440 00000100:00100000:1.0:1746142914.433276:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1746142914.433280:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3763:x1830962867853440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433312:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3763:x1830962867853440:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.433316:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00080000:1.0:1746142914.433326:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746142914.433328:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746142914.433340:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3764:1830962867853568:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433357:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130122300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3763:1830962867853312:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433366:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3763:1830962867853824:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433372:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088fd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3763:1830962867854336:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433378:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867853440:0@lo:400:kworker.0 00000100:00100000:1.0:1746142914.433383:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3763:1830962867853952:0@lo:400:kworker.0 00000004:00080000:0.0:1746142914.433815:0:8109:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 24 done 00000100:00100000:0.0:1746142914.433868:0:8100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853056 00000100:00100000:0.0:1746142914.433871:0:8100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853056 00000100:00100000:0.0:1746142914.433892:0:8100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746142914.433897:0:8100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11bfc4f8-19ff-4a85-a693-c4a0691b96f7+23:3764:x1830962867853056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142914.433947:0:8100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130dd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11bfc4f8-19ff-4a85-a693-c4a0691b96f7+23:3764:x1830962867853056:12345-0@lo:400:kworker.0 Request processed in 51us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.433953:0:8100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1746142914.434696:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130120380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3764:1830962867853056:0@lo:400:kworker.0 00000100:00100000:2.0:1746142914.434713:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3765:1830962867853696:0@lo:400:kworker.0 00000100:00100000:2.0:1746142914.434739:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142914.434758:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867854208:0@lo:400:kworker.0 00000100:00100000:2.0:1746142914.434778:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142914.434785:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853696 00000100:00100000:0.0:1746142914.434788:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853696 00000100:00100000:2.0:1746142914.434801:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867854208 00000100:00100000:2.0:1746142914.434804:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867854208 00000100:00100000:2.0:1746142914.434819:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1746142914.434819:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1746142914.434823:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3765:x1830962867854208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142914.434823:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830962867853696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746142914.434846:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3765:x1830962867854208:12345-0@lo:400:kworker.0 Request processed in 22us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.434846:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3765:x1830962867853696:12345-0@lo:400:kworker.0 Request processed in 24us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.434851:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1746142914.434851:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1746142914.434867:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3765:1830962867853696:0@lo:400:kworker.0 00000100:00100000:2.0:1746142914.434873:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873968 gen 2 00000004:00080000:2.0:1746142914.434875:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1f80, transno 17179873938 00000004:00080000:2.0:1746142914.434881:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af3b80, transno 17179873939 00000004:00080000:2.0:1746142914.434883:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1500, transno 17179873940 00000004:00080000:2.0:1746142914.434885:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af2d80, transno 17179873941 00000004:00080000:2.0:1746142914.434888:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1180, transno 17179873942 00000004:00080000:2.0:1746142914.434890:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0700, transno 17179873943 00000004:00080000:2.0:1746142914.434892:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0a80, transno 17179873944 00000004:00080000:2.0:1746142914.434894:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de2a00, transno 17179873945 00000004:00080000:2.0:1746142914.434896:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af2680, transno 17179873946 00000004:00080000:2.0:1746142914.434910:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af3480, transno 17179873951 00000100:00080000:1.0:1746142914.434910:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746142914.434912:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0e00, transno 17179873952 00000100:00080000:1.0:1746142914.434913:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1746142914.434914:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0380, transno 17179873953 00000004:00080000:2.0:1746142914.434916:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1880, transno 17179873954 00000004:00080000:2.0:1746142914.434918:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af3100, transno 17179873955 00000004:00080000:2.0:1746142914.434920:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af2a00, transno 17179873956 00000004:00080000:2.0:1746142914.434922:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af3800, transno 17179873957 00000004:00080000:2.0:1746142914.434924:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0000, transno 17179873958 00000004:00080000:2.0:1746142914.434926:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c7100, transno 17179873959 00000100:00100000:3.0:1746142914.434959:0:9266:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867853184 00000100:00100000:3.0:1746142914.434962:0:9266:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867853184 00000100:00100000:3.0:1746142914.434991:0:9266:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1746142914.434996:0:9266:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3765:x1830962867853184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746142914.435022:0:9266:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3765:x1830962867853184:12345-0@lo:400:kworker.0 Request processed in 26us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.435026:0:9266:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000004:00080000:2.0:1746142914.435242:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c7b80, transno 17179873960 00000004:00080000:2.0:1746142914.435245:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c6a00, transno 17179873961 00000004:00080000:2.0:1746142914.435247:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c7800, transno 17179873962 00000004:00080000:2.0:1746142914.435249:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c4a80, transno 17179873963 00000004:00080000:2.0:1746142914.435251:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c6680, transno 17179873964 00000004:00080000:2.0:1746142914.435253:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c5c00, transno 17179873965 00000004:00080000:2.0:1746142914.435255:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c4e00, transno 17179873966 00000004:00080000:2.0:1746142914.435256:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c5880, transno 17179873967 00000004:00080000:2.0:1746142914.435258:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800946c7480, transno 17179873968 00000100:00100000:2.0:1746142914.435262:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867854208:0@lo:400:kworker.0 00000004:00080000:3.0:1746142914.435379:0:8111:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 10 in progress, 0 in flight, 17 done 00000004:00080000:3.0:1746142914.435420:0:8111:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 10 done 00000100:00100000:2.0:1746142914.435475:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130121f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3765:1830962867853184:0@lo:400:kworker.0 00000100:00100000:0.0:1746142914.455100:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.458994:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867486720 00000100:00100000:1.0:1746142914.459005:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867486720 00000100:00100000:1.0:1746142914.459053:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14482 00000100:00100000:1.0:1746142914.459060:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32569:x1830962867486720:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142914.459080:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.459093:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccd9ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae3e expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.459141:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459152:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459160:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459171:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459176:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459181:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459235:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459244:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 25 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.459250:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.459276:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 25 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.459288:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 25 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.459308:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867854464:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.459391:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.465102:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.465180:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.465237:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.465258:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487360 00000100:00100000:0.0:1746142914.465264:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487360 00010000:00010000:0.0:1746142914.465308:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 26 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.465342:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6552 00000100:00100000:0.0:1746142914.465349:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867487360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.465361:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.465367:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 26 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.465376:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 26 pid: 7230 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.465395:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.465399:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465408:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465414:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465427:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142914.465455:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867487360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.465461:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6552 00010000:00010000:0.0:1746142914.465574:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d950e00/0x2fa243e067ccd8cc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adc7 expref: 25 pid: 7230 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.465589:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867854464:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142914.465602:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465625:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465630:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142914.465669:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:0.0:1746142914.465673:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142914.465687:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465696:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465704:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465709:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465714:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465731:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d2a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142914.465734:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465743:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465750:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142914.465752:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142914.465755:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465759:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccd9c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465768:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465772:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465777:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465781:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974d3000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142914.465783:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465787:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465791:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091eb9a00) 00010000:00010000:0.0:1746142914.465793:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142914.465795:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465799:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3000/0x2fa243e067ccd9c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.465824:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccd9ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.465833:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.465839:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.465840:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142914.465842:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3600, rc 0) 00000100:00100000:0.0:1746142914.465873:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32569:x1830962867486720:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 6814us (10779us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.465879:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14482 00000100:00100000:3.0:1746142914.465934:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487104 00000100:00100000:3.0:1746142914.465938:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487104 00002000:00100000:3.0:1746142914.465961:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880099e89180 x1830962867487104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.465974:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89180 with x1830962867487104 ext(2097152->4194303) 00002000:00010000:3.0:1746142914.465978:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89180 00000100:00100000:3.0:1746142914.465988:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487232 00000100:00100000:3.0:1746142914.465990:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487232 00002000:00100000:3.0:1746142914.465999:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880099e89f80 x1830962867487232/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.466006:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89f80 with x1830962867487232 ext(2097152->4194303) 00002000:00010000:3.0:1746142914.466008:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e89f80 00000100:00100000:3.0:1746142914.466016:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4520 00000100:00100000:3.0:1746142914.466020:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867487104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.466129:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4521 00000100:00100000:2.0:1746142914.466137:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867487232:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.483594:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867854592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746142914.483647:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142914.483800:0:7235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867854592 00000100:00100000:2.0:1746142914.483806:0:7235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867854592 00000100:00100000:2.0:1746142914.483868:0:7235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1746142914.483875:0:7235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3763:x1830962867854592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746142914.483912:0:7235:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445634048 avail 1316171776 00000100:00100000:2.0:1746142914.483940:0:7235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3763:x1830962867854592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.483945:0:7235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1746142914.483980:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.484030:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867854592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746142914.484047:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487488 00000100:00100000:0.0:1746142914.484051:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487488 00000100:00100000:1.0:1746142914.484065:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.484101:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487744 00000100:00100000:0.0:1746142914.484103:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487744 00000100:00100000:1.0:1746142914.484107:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14489 00000100:00100000:1.0:1746142914.484112:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867487488:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:0.0:1746142914.484117:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14490 00010000:00010000:1.0:1746142914.484120:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142914.484122:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867487744:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142914.484128:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.484133:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae45 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.484134:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae53 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.484148:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.484148:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.484149:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.484149:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.484155:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.484155:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.484167:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 10 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.484172:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.484175:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3a00, rc 0) 00010000:00010000:0.0:1746142914.484179:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4a00, rc 0) 00000100:00100000:1.0:1746142914.484197:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867487488:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 85us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.484197:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867487744:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 75us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.484201:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14490 00000100:00100000:1.0:1746142914.484204:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14489 00000100:00100000:1.0:1746142914.484228:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.484231:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.484237:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487616 00000100:00100000:1.0:1746142914.484239:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487616 00000100:00100000:0.0:1746142914.484244:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867488128 00000100:00100000:0.0:1746142914.484246:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867488128 00000100:00100000:1.0:1746142914.484252:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14491 00000100:00100000:1.0:1746142914.484255:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867487616:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142914.484262:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142914.484266:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14483 00010000:00010000:1.0:1746142914.484269:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae4c expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.484270:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32571:x1830962867488128:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142914.484277:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.484278:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.484279:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.484282:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.484287:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5c00/0x2fa243e067ccd9eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae61 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.484305:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.484311:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3e00, rc 0) 00000100:00100000:1.0:1746142914.484323:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867487616:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 67us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.484327:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14491 00010000:00010000:0.0:1746142914.484339:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484347:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484354:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:1.0:1746142914.484359:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142914.484362:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00000100:00100000:1.0:1746142914.484366:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867487872 00010000:00010000:0.0:1746142914.484366:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00000100:00100000:1.0:1746142914.484368:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867487872 00010000:00010000:0.0:1746142914.484370:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:1.0:1746142914.484377:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14492 00000100:00100000:1.0:1746142914.484381:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867487872:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142914.484386:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.484391:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae5a expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.484399:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.484400:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.484404:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.484412:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 12 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.484417:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3000, rc 0) 00000100:00100000:1.0:1746142914.484428:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867487872:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 46us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.484432:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14492 00010000:00010000:0.0:1746142914.484451:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484458:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484464:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142914.484470:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142914.484522:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484528:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484532:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484537:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484542:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c4200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142914.484545:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484550:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484558:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142914.484561:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142914.484564:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484572:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067ccd9f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484594:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484599:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484603:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484607:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c4600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142914.484609:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484613:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484618:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736300) 00010000:00010000:0.0:1746142914.484620:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142914.484622:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142914.484626:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067ccd9f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00000100:00100000:3.0:1746142914.484634:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867487104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18613us (19582us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142914.484641:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4520 00002000:00100000:3.0:1746142914.484648:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880099e89180 x1830962867487104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746142914.484651:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5c00/0x2fa243e067ccd9eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 45 pid: 7232 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746142914.484656:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89180 with x1830962867487104 ext(2097152->4194303) 00010000:00010000:0.0:1746142914.484659:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 44 pid: 7232 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142914.484660:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e89180 00010000:00010000:0.0:1746142914.484669:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.484671:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142914.484672:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5200, rc 0) 00000100:00100000:0.0:1746142914.485603:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32571:x1830962867488128:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1327us (1366us total) trans 8589936661 rc 0/0 00000100:00100000:0.0:1746142914.485609:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14483 00000100:00100000:0.0:1746142914.499989:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.500019:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.500161:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867487232:12345-192.168.204.50@tcp:3:cat.0 Request processed in 34024us (34980us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746142914.500170:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4521 00002000:00100000:0.0:1746142914.500179:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880099e89f80 x1830962867487232/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.500187:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89f80 with x1830962867487232 ext(2097152->4194303) 00002000:00010000:0.0:1746142914.500192:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e89f80 00000100:00100000:0.0:1746142914.500209:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867488640 00000100:00100000:0.0:1746142914.500214:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867488640 00002000:00100000:0.0:1746142914.500236:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880099e8ad80 x1830962867488640/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.500242:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8ad80 with x1830962867488640 ext(4194304->5066751) 00002000:00010000:0.0:1746142914.500244:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e8ad80 00000100:00100000:0.0:1746142914.500256:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4522 00000100:00100000:0.0:1746142914.500261:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867488640:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.500598:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867488384 00000100:00100000:1.0:1746142914.500602:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867488384 00000100:00100000:1.0:1746142914.500627:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14484 00000100:00100000:1.0:1746142914.500632:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32569:x1830962867488384:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142914.500642:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.500655:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccda15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae68 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.500726:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.500738:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.500743:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 43 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.500749:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.500772:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 43 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.500781:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 43 pid: 7232 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.500790:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867854720:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.500850:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.500857:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 10 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.500863:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867854848:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.500880:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.505336:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.505398:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867488768 00000100:00100000:3.0:1746142914.505406:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867488768 00000100:00100000:3.0:1746142914.505454:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14493 00000100:00100000:3.0:1746142914.505462:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32571:x1830962867488768:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142914.505475:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.505491:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae6f expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.505513:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.505525:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 8 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.505531:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.505536:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.505538:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.505540:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [233472->290815] (req 233472->290815) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 30 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.505565:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.505575:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 13 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746142914.505584:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867854976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142914.505679:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 8 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.505687:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 8 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746142914.505695:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867855104:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142914.505719:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 30 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.505725:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 30 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.505732:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867855232:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142914.505746:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.509944:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.510074:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867488640:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9811us (10053us total) trans 0 rc 872448/872448 00000100:00100000:0.0:1746142914.510083:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4522 00002000:00100000:0.0:1746142914.510094:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880099e8ad80 x1830962867488640/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.510101:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e8ad80 with x1830962867488640 ext(4194304->5066751) 00002000:00010000:0.0:1746142914.510106:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e8ad80 00000100:00100000:0.0:1746142914.510191:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.510231:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.510245:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489152 00000100:00100000:0.0:1746142914.510251:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489152 00010000:00010000:0.0:1746142914.510272:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 11 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.510288:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489024 00000100:00100000:0.0:1746142914.510290:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489024 00010000:00010000:0.0:1746142914.510307:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 44 pid: 7232 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.510319:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6553 00000100:00100000:0.0:1746142914.510325:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867489152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.510335:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.510340:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 11 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.510352:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 11 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.510369:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.510373:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.510381:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.510385:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142914.510401:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867489152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.510406:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6553 00000100:00100000:0.0:1746142914.510415:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6554 00000100:00100000:0.0:1746142914.510419:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867489024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.510424:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.510427:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 44 pid: 7232 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.510434:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 44 pid: 7232 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.510443:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.510446:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.510451:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.510457:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142914.510469:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142914.510479:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867489024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.510484:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6554 00010000:00010000:2.0:1746142914.510618:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5200/0x2fa243e067ccda07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae61 expref: 43 pid: 7232 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.510634:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867854720:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.510662:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3600/0x2fa243e067ccd9cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae3e expref: 10 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.510670:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867854848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.510685:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.510691:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.510696:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142914.510710:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.510799:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccda15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae68 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.510810:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae68 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.510815:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.510817:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142914.510819:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3400, rc 0) 00000100:00100000:2.0:1746142914.510837:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32569:x1830962867488384:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10206us (10857us total) trans 8589936662 rc 0/0 00000100:00100000:2.0:1746142914.510843:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14484 00000100:00100000:1.0:1746142914.511078:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867488896 00000100:00100000:1.0:1746142914.511083:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867488896 00000100:00100000:1.0:1746142914.511104:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14494 00000100:00100000:1.0:1746142914.511109:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:32564:x1830962867488896:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142914.511119:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.511128:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae76 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.511144:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 30 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.511152:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.511158:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.511163:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.511165:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.511168:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3665920->4194303] (req 3665920->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.511186:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.511195:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 13 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746142914.511205:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867855360:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.511256:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.511264:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746142914.511270:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867855488:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.511301:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 30 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.511308:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 30 pid: 9578 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.511314:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867855616:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.511329:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.513447:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867854976:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.517668:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.517706:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.517716:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489408 00000100:00100000:2.0:1746142914.517722:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.517723:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489408 00000100:00100000:2.0:1746142914.517747:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142914.517750:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 31 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.517771:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489280 00000100:00100000:0.0:1746142914.517773:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489280 00010000:00010000:0.0:1746142914.517781:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 9 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746142914.517790:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489536 00000100:00100000:0.0:1746142914.517791:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489536 00010000:00010000:0.0:1746142914.517798:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 14 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.517809:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6555 00000100:00100000:2.0:1746142914.517818:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867489408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.517829:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.517847:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 31 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.517856:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6556 00010000:00010000:2.0:1746142914.517858:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 31 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.517862:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867489280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.517869:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.517877:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 9 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.517879:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142914.517890:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 9 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746142914.517920:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.517931:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867489408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.517937:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867489280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.517940:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6555 00000100:00100000:0.0:1746142914.517943:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6556 00000100:00100000:0.0:1746142914.517954:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6557 00000100:00100000:0.0:1746142914.517959:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867489536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.517964:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.517971:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 14 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746142914.517977:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 14 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746142914.517987:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d950800/0x2fa243e067ccd8b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adb9 expref: 14 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746142914.518001:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.518002:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.518007:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 30 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.518014:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 30 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.518043:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 30 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.518053:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867855744:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142914.518094:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324330c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.518928:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867855360:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.518938:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867855488:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.518959:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489664 00000100:00100000:2.0:1746142914.518962:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489664 00000100:00100000:2.0:1746142914.518984:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14495 00000100:00100000:2.0:1746142914.518989:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867489664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.519000:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.519010:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccda38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae7d expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.519037:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867855872:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142914.519243:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746142914.519280:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974d3a00/0x2fa243e067ccd9d6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae45 expref: 8 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746142914.519306:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867855104:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142914.519317:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d951c00/0x2fa243e067ccd886 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ada4 expref: 30 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.519325:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867855232:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.519335:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867855616:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142914.519345:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 29 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.519352:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3665920->4194303] (req 3665920->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.519353:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3920800, rc 0) 00010000:00010000:2.0:1746142914.519360:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8e400, rc 0) 00000100:00100000:3.0:1746142914.519373:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32571:x1830962867488768:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 13912us (14043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.519377:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:32564:x1830962867488896:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8268us (9439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.519378:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14493 00000100:00100000:2.0:1746142914.519382:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14494 00000100:00100000:2.0:1746142914.519419:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.519435:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867489920 00000100:00100000:2.0:1746142914.519438:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867489920 00000100:00100000:3.0:1746142914.519450:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.519461:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14485 00000100:00100000:2.0:1746142914.519465:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32569:x1830962867489920:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142914.519475:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.519477:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142914.519491:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccda1c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae68 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.519500:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.519503:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142914.519509:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2e00/0x2fa243e067ccda3f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae84 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.519550:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867490048 00000100:00100000:1.0:1746142914.519554:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867490048 00010000:00010000:1.0:1746142914.519567:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.519577:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142914.519585:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6558 00010000:00010000:2.0:1746142914.519586:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142914.519590:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867490048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.519593:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142914.519596:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.519604:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.519611:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.519621:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4a00/0x2fa243e067ccd9dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae53 expref: 8 pid: 1397 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.519642:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.519658:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:2003:x1830962867490048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.519664:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6558 00010000:00010000:2.0:1746142914.519681:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519687:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519692:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519697:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9d1800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.519700:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519705:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519711:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.519713:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142914.519716:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519719:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1800/0x2fa243e067ccda46 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.519738:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2e00/0x2fa243e067ccda3f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae84 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.519744:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2e00/0x2fa243e067ccda3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae84 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.519750:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2e00, rc 0) 00000100:00100000:2.0:1746142914.519766:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32569:x1830962867489920:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 300us (346us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.519772:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14485 00000100:00100000:0.0:1746142914.525126:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.525188:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867855744:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142914.525203:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142914.525246:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867489536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7285us (7521us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.525254:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6557 00000100:00100000:0.0:1746142914.525274:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867490176 00000100:00100000:0.0:1746142914.525279:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867490176 00010000:00010000:0.0:1746142914.525307:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 29 pid: 9578 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.525331:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6559 00000100:00100000:0.0:1746142914.525336:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867490176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.525347:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.525363:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 29 pid: 9578 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.525373:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 29 pid: 9578 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.525386:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142914.525394:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067ccd958 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae14 expref: 29 pid: 9578 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.525408:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746142914.525421:0:11421:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime: 1746142914 -> 1746142915 00000100:00100000:0.0:1746142914.525423:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867490176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.525428:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6559 00000100:00100000:3.0:1746142914.525430:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867855872:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142914.525446:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccda38 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae7d expref: 13 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.525457:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccda38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae7d expref: 13 pid: 11421 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142914.525459:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867490432 00000100:00100000:0.0:1746142914.525462:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867490432 00010000:00010000:3.0:1746142914.525463:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cce00, rc 0) 00002000:00100000:0.0:1746142914.525479:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (233472->237567) req@ffff880098191f80 x1830962867490432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746142914.525482:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867489664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6492us (7734us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142914.525487:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14495 00002000:00100000:0.0:1746142914.525487:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191f80 with x1830962867490432 ext(233472->237567) 00002000:00010000:0.0:1746142914.525490:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191f80 00000100:00100000:0.0:1746142914.525500:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4523 00000100:00100000:0.0:1746142914.525505:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867490432:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142914.525592:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867490432:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 86us (207us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142914.525597:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4523 00002000:00100000:0.0:1746142914.525601:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (233472->237567) req@ffff880098191f80 x1830962867490432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.525607:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191f80 with x1830962867490432 ext(233472->237567) 00002000:00010000:0.0:1746142914.525609:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191f80 00000100:00100000:0.0:1746142914.526262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.526897:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.528328:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867490560 00000100:00100000:1.0:1746142914.528336:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867490560 00000100:00100000:3.0:1746142914.528541:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867490816 00000100:00100000:3.0:1746142914.528544:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867490816 00000100:00100000:3.0:1746142914.528575:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5291 00000100:00100000:3.0:1746142914.528583:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:32569:x1830962867490816:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:3.0:1746142914.528713:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:32569:x1830962867490816:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 130us (1816us total) trans 8589936663 rc 0/0 00000100:00100000:3.0:1746142914.528719:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5291 00010000:00010000:1.0:1746142914.528775:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 12 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746142914.528798:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6560 00000100:00100000:1.0:1746142914.528803:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867490560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.528813:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.528825:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 12 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.528833:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 12 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.528848:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e600/0x2fa243e067ccd9ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae30 expref: 12 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.528859:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.528861:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.528867:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.528874:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.528911:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.528921:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867856000:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142914.528955:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.529184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.529197:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867491072 00000100:00100000:0.0:1746142914.529200:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867491072 00000100:00100000:0.0:1746142914.529216:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5292 00000100:00100000:0.0:1746142914.529221:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32571:x1830962867491072:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142914.529858:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32571:x1830962867491072:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 634us (672us total) trans 8589936664 rc 0/0 00000100:00100000:0.0:1746142914.529864:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5292 00000100:00100000:0.0:1746142914.530430:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.530479:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867491200 00000100:00100000:2.0:1746142914.530484:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867491200 00000100:00100000:2.0:1746142914.530508:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14496 00000100:00100000:2.0:1746142914.530514:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:32568:x1830962867491200:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.530523:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.530534:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae8b expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.530556:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.530562:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.530564:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.530567:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->5066751] (req 4194304->5066751) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.530585:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.530595:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 13 pid: 11943 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.530604:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867856128:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.530666:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.532593:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867856128:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.532615:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [4194304->5066751] (req 4194304->5066751) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.532633:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0200, rc 0) 00000100:00100000:2.0:1746142914.532665:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:32568:x1830962867491200:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2150us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.532672:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14496 00000100:00100000:1.0:1746142914.532890:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867856000:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142914.532915:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.532932:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867490560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4129us (6671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.532940:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6560 00000100:00100000:0.0:1746142914.534443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.534620:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867491456 00000100:00100000:1.0:1746142914.534627:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867491456 00002000:00100000:1.0:1746142914.534659:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3665920->3670015) req@ffff880088d7ca80 x1830962867491456/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.534668:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ca80 with x1830962867491456 ext(3665920->3670015) 00010000:00010000:1.0:1746142914.534675:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 12 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.534686:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 12 pid: 11943 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746142914.534692:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7ca80 00000100:00100000:1.0:1746142914.534707:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1406 00000100:00100000:1.0:1746142914.534714:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867491456:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.534824:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867491456:12345-192.168.204.50@tcp:3:cat.0 Request processed in 110us (386us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142914.534829:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1406 00002000:00100000:1.0:1746142914.534834:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3665920->3670015) req@ffff880088d7ca80 x1830962867491456/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.534840:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ca80 with x1830962867491456 ext(3665920->3670015) 00010000:00010000:1.0:1746142914.534844:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 12 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.534857:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 12 pid: 11943 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746142914.534862:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7ca80 00000100:00100000:0.0:1746142914.544432:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.544480:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.544527:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867491712 00000100:00100000:3.0:1746142914.544534:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867491712 00002000:00100000:3.0:1746142914.544576:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3665920->4194303) req@ffff880088d7f800 x1830962867491712/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.544586:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7f800 with x1830962867491712 ext(3665920->4194303) 00010000:00010000:3.0:1746142914.544594:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 12 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.544605:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 12 pid: 11943 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.544612:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7f800 00000100:00100000:3.0:1746142914.544629:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1407 00000100:00100000:3.0:1746142914.544635:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867491712:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142914.545350:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867856256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746142914.545384:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142914.545385:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867491840 00000100:00100000:2.0:1746142914.545389:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867491840 00000100:00100000:1.0:1746142914.545405:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746142914.545410:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867856384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746142914.545411:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14497 00000100:00100000:2.0:1746142914.545416:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+14:32564:x1830962867491840:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.545424:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142914.545426:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746142914.545435:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae92 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.545443:0:13943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867856256 00000100:00100000:1.0:1746142914.545446:0:13943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867856256 00010000:00010000:2.0:1746142914.545453:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 27 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.545460:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142914.545462:0:13943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867856384 00000100:00100000:1.0:1746142914.545464:0:13943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867856384 00010000:00010000:2.0:1746142914.545467:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.545472:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142914.545473:0:13943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00010000:00010000:2.0:1746142914.545474:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.545476:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3145728->3440639] (req 3145728->3440639) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.545493:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.545500:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.545509:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867856512:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.545544:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 11 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.545552:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 11 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.545558:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867856640:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.545579:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 27 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.545587:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 27 pid: 9578 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.545594:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867856768:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.545608:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.545621:0:3103:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:2.0:1746142914.545627:0:3103:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867856384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746142914.545637:0:3103:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1184910144 pending 2785280 free 3906605056 avail 3665219584 00000100:00100000:2.0:1746142914.545664:0:3103:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867856384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.545669:0:3103:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1746142914.545672:0:13943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867856256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746142914.545684:0:13943:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1304669888 pending 1236992 free 3908063232 avail 3667005440 00000100:00100000:2.0:1746142914.545699:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867856384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746142914.545706:0:13943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867856256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 228us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.545709:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867856256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746142914.545712:0:13943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1746142914.550048:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.550263:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867491968 00000100:00100000:1.0:1746142914.550270:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867491968 00010000:00010000:1.0:1746142914.550308:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 12 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746142914.550334:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6561 00000100:00100000:1.0:1746142914.550341:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867491968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.550352:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.550369:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 12 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.550378:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 12 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:1.0:1746142914.550397:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.550427:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867491968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.550432:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6561 00000100:00100000:2.0:1746142914.550869:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867856512:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.550879:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3000/0x2fa243e067ccda00 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae5a expref: 11 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.550918:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867856640:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.550927:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867856768:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.550947:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->3440639] (req 3145728->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 15 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.550956:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0e00, rc 0) 00000100:00100000:2.0:1746142914.550978:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+15:32564:x1830962867491840:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5562us (6498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.550984:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14497 00000100:00100000:3.0:1746142914.552078:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.552099:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.552265:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867492224 00000100:00100000:0.0:1746142914.552270:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867492224 00010000:00010000:0.0:1746142914.552287:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 28 pid: 9578 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.552311:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867492096 00000100:00100000:0.0:1746142914.552314:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867492096 00010000:00010000:0.0:1746142914.552322:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746142914.553647:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6562 00000100:00100000:3.0:1746142914.553656:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867492224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.553666:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.553682:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 28 pid: 9578 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.553691:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 28 pid: 9578 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.553709:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1c00/0x2fa243e067ccd95f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae1b expref: 28 pid: 9578 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.553724:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.553753:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867492224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.553759:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6562 00000100:00100000:3.0:1746142914.553773:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6563 00000100:00100000:3.0:1746142914.553778:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867492096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.553784:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.553790:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746142914.553797:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746142914.553808:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8e200/0x2fa243e067ccd9b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae37 expref: 15 pid: 9578 timeout: 788 lvb_type: 1 00010000:00010000:3.0:1746142914.553815:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.553817:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.553821:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.553828:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.553852:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 14 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.553862:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867856896:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.553896:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.555378:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867491712:12345-192.168.204.50@tcp:4:cat.0 Request processed in 10737us (10947us total) trans 21474841235 rc 0/0 00000100:00100000:0.0:1746142914.555386:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1407 00002000:00100000:0.0:1746142914.555394:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3665920->4194303) req@ffff880088d7f800 x1830962867491712/t21474841235(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.555403:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7f800 with x1830962867491712 ext(3665920->4194303) 00010000:00010000:0.0:1746142914.555409:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 14 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.555420:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 14 pid: 11943 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746142914.555426:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880088d7f800 00000100:00100000:3.0:1746142914.560423:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867856896:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142914.560440:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.560647:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867492096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6866us (8545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.560656:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6563 00000100:00100000:0.0:1746142914.563083:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.563418:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867492480 00000100:00100000:2.0:1746142914.563425:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867492480 00002000:00100000:2.0:1746142914.563460:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3436544->3440639) req@ffff880088d7ea00 x1830962867492480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.563469:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ea00 with x1830962867492480 ext(3436544->3440639) 00002000:00010000:2.0:1746142914.563473:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7ea00 00000100:00100000:2.0:1746142914.563503:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4524 00000100:00100000:2.0:1746142914.563510:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867492480:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.563991:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867492480:12345-192.168.204.50@tcp:3:cat.0 Request processed in 480us (911us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142914.563998:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4524 00002000:00100000:2.0:1746142914.564003:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3436544->3440639) req@ffff880088d7ea00 x1830962867492480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.564010:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ea00 with x1830962867492480 ext(3436544->3440639) 00002000:00010000:2.0:1746142914.564012:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088d7ea00 00000100:00100000:2.0:1746142914.564836:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.564885:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867492608 00000100:00100000:3.0:1746142914.564889:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867492608 00010000:00010000:3.0:1746142914.564921:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 14 pid: 11943 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.564989:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6564 00000100:00100000:3.0:1746142914.564996:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2004:x1830962867492608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.565004:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142914.565015:0:13297:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142914 -> 1746142915 00002000:00010000:3.0:1746142914.565018:0:13297:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142914 -> 1746142915 00010000:00010000:3.0:1746142914.565022:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 14 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.565033:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 14 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.565050:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8e400/0x2fa243e067ccda31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3665920->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae76 expref: 14 pid: 11943 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.565073:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.565075:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.565081:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.565092:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.565117:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.565127:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867857024:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.565669:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.566947:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867857024:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142914.566962:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.566999:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867492608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2003us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.567006:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6564 00000100:00100000:0.0:1746142914.568446:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.568677:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867492864 00000100:00100000:2.0:1746142914.568683:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867492864 00000100:00100000:2.0:1746142914.568958:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5293 00000100:00100000:2.0:1746142914.568965:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:32564:x1830962867492864:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142914.569107:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:32564:x1830962867492864:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 142us (664us total) trans 8589936665 rc 0/0 00000100:00100000:2.0:1746142914.569113:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5293 00000100:00100000:1.0:1746142914.569304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.569508:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867493120 00000100:00100000:0.0:1746142914.569511:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867493120 00002000:00100000:0.0:1746142914.569531:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012e67aa00 x1830962867493120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.569539:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67aa00 with x1830962867493120 ext(4194304->5066751) 00002000:00010000:0.0:1746142914.569543:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67aa00 00000100:00100000:0.0:1746142914.569553:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4525 00000100:00100000:0.0:1746142914.569557:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867493120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.576358:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867493120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6792us (7046us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142914.576369:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4525 00002000:00100000:2.0:1746142914.576378:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012e67aa00 x1830962867493120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.576387:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67aa00 with x1830962867493120 ext(4194304->5066751) 00002000:00010000:2.0:1746142914.576392:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67aa00 00000100:00100000:0.0:1746142914.578961:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.579101:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867493248 00000100:00100000:2.0:1746142914.579108:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867493248 00000100:00100000:2.0:1746142914.579156:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14498 00000100:00100000:2.0:1746142914.579163:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867493248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.579177:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.579191:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccda5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8ae99 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.579236:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867857152:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142914.580454:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd36c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746142914.581926:0:11421:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime: 1746142914 -> 1746142915 00002000:00010000:2.0:1746142914.581930:0:11421:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime: 1746142914 -> 1746142915 00000100:00100000:2.0:1746142914.581945:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867857152:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142914.581967:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccda5b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae99 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.581978:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d1400/0x2fa243e067ccda5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae99 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.581992:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d1400, rc 0) 00000100:00100000:2.0:1746142914.582028:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867493248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2865us (3073us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.582033:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14498 00000100:00100000:0.0:1746142914.583996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.584192:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867493376 00000100:00100000:2.0:1746142914.584198:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867493376 00000100:00100000:2.0:1746142914.584239:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14499 00000100:00100000:2.0:1746142914.584246:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867493376:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.584258:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.584272:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccda62 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aea0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.584321:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867857280:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142914.584426:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.585663:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867857280:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142914.585682:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccda62 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea0 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.585692:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0600/0x2fa243e067ccda62 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea0 expref: 14 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.585763:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0600, rc 0) 00000100:00100000:2.0:1746142914.586067:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+13:2004:x1830962867493376:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1820us (2075us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.586074:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14499 00000100:00100000:0.0:1746142914.588845:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.589194:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867493632 00000100:00100000:3.0:1746142914.589201:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867493632 00000100:00100000:3.0:1746142914.589338:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5294 00000100:00100000:3.0:1746142914.589345:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:32568:x1830962867493632:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142914.589714:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+27:32568:x1830962867493632:12345-192.168.204.50@tcp:35:cat.0 Request processed in 368us (885us total) trans 8589936666 rc 0/0 00000100:00100000:3.0:1746142914.589720:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5294 00000100:00100000:0.0:1746142914.635508:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.635689:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867493888 00000100:00100000:2.0:1746142914.635697:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867493888 00000100:00100000:2.0:1746142914.635738:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14486 00000100:00100000:2.0:1746142914.635746:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32578:x1830962867493888:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.635766:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.635781:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccda69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aea7 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.635840:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635850:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635859:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635874:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635879:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635884:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635986:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.635995:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636006:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142914.636015:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.636072:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636078:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636083:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636088:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9d0a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.636091:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636097:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636107:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142914.636109:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.636112:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636117:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0a00/0x2fa243e067ccda70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636142:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636146:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636150:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636153:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a9d1600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.636155:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636159:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636164:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd000) 00010000:00010000:2.0:1746142914.636166:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.636168:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636172:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d1600/0x2fa243e067ccda77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142914.636200:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0400/0x2fa243e067ccda69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 47 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.636211:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 46 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.636216:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.636218:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142914.636220:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0800, rc 0) 00000100:00100000:2.0:1746142914.636254:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32578:x1830962867493888:12345-192.168.204.50@tcp:101:cat.0 Request processed in 509us (758us total) trans 8589936667 rc 0/0 00000100:00100000:2.0:1746142914.636259:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14486 00000100:00100000:0.0:1746142914.639332:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.639374:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.639422:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867494016 00000100:00100000:2.0:1746142914.639429:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867494016 00000100:00100000:2.0:1746142914.639468:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867494144 00000100:00100000:2.0:1746142914.639470:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867494144 00000100:00100000:2.0:1746142914.639492:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14500 00000100:00100000:2.0:1746142914.639499:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867494016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.639512:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.639524:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aeae expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.639540:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.639542:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.639548:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.639559:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 29 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.639571:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba800, rc 0) 00000100:00100000:0.0:1746142914.639588:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14501 00000100:00100000:0.0:1746142914.639595:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867494144:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.639602:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142914.639605:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867494016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.639610:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14500 00010000:00010000:0.0:1746142914.639611:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f38ee00/0x2fa243e067ccda93 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aeb5 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.639643:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867857408:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142914.639693:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433cc0 going to sleep for 11 seconds 00002000:00010000:2.0:1746142914.641437:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142914 -> 1746142915 00002000:00010000:2.0:1746142914.641443:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142914 -> 1746142915 00002000:00010000:2.0:1746142914.641445:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142914 -> 1746142915 00000100:00100000:2.0:1746142914.641460:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867857408:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142914.641482:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f38ee00/0x2fa243e067ccda93 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeb5 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.641491:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f38ee00/0x2fa243e067ccda93 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeb5 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.641499:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f38ee00, rc 0) 00000100:00100000:2.0:1746142914.641581:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867494144:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1986us (2206us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.641586:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14501 00000100:00100000:0.0:1746142914.646267:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.646829:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867494400 00000100:00100000:2.0:1746142914.646836:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867494400 00002000:00100000:2.0:1746142914.646870:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012b1a0700 x1830962867494400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 504/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.646879:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0700 with x1830962867494400 ext(0->1048575) 00002000:00010000:2.0:1746142914.646884:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a0700 00000100:00100000:2.0:1746142914.646928:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4526 00000100:00100000:2.0:1746142914.646934:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867494400:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.653413:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867494400:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6471us (7144us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1746142914.653424:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4526 00002000:00100000:2.0:1746142914.653434:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012b1a0700 x1830962867494400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 504/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.653443:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a0700 with x1830962867494400 ext(0->1048575) 00002000:00010000:2.0:1746142914.653448:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a0700 00000100:00100000:0.0:1746142914.657244:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.658420:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867494656 00000100:00100000:2.0:1746142914.658429:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867494656 00000100:00100000:2.0:1746142914.658480:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14487 00000100:00100000:2.0:1746142914.658489:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:32580:x1830962867494656:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.658510:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.658525:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccda9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aebc expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.658603:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.658615:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 47 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.658622:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.658645:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 47 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.658656:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 47 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.658666:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867857536:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.659800:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.660362:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867857536:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.660380:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142914.661680:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.661741:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867494784 00000100:00100000:3.0:1746142914.661748:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867494784 00010000:00010000:3.0:1746142914.661774:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 48 pid: 13326 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.661812:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6565 00000100:00100000:3.0:1746142914.661819:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2005:x1830962867494784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.661829:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.661834:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 48 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.661843:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 48 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.661861:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a9d0800/0x2fa243e067ccda7e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aea7 expref: 48 pid: 13326 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.661887:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142914.661891:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.661914:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.661920:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.661946:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.661978:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867494784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.661984:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6565 00010000:00010000:2.0:1746142914.662073:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.662081:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142914.662097:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.662197:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbb400/0x2fa243e067ccda9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 48 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.662228:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 47 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.662234:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.662236:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142914.662238:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbbe00, rc 0) 00000100:00100000:2.0:1746142914.662261:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32580:x1830962867494656:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3774us (5025us total) trans 8589936668 rc 0/0 00000100:00100000:2.0:1746142914.662268:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14487 00000100:00100000:0.0:1746142914.665979:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.666038:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867495040 00000100:00100000:2.0:1746142914.666048:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867495040 00002000:00100000:2.0:1746142914.666091:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012b1a1f80 x1830962867495040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.666100:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1f80 with x1830962867495040 ext(2097152->3145727) 00002000:00010000:2.0:1746142914.666104:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a1f80 00000100:00100000:2.0:1746142914.667472:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4527 00000100:00100000:2.0:1746142914.667484:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867495040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.675242:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867495040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7750us (9258us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.675255:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4527 00002000:00100000:2.0:1746142914.675269:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88012b1a1f80 x1830962867495040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.675277:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b1a1f80 with x1830962867495040 ext(2097152->3145727) 00002000:00010000:2.0:1746142914.675283:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b1a1f80 00000100:00100000:0.0:1746142914.682080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.682330:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867495168 00000100:00100000:2.0:1746142914.682340:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867495168 00000100:00100000:2.0:1746142914.682409:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14502 00000100:00100000:2.0:1746142914.682419:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32578:x1830962867495168:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.682437:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.682454:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aec3 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.682481:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.682493:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.682495:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142914.682498:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 28 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.682527:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 13 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.682539:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 13 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.682551:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867857664:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.682671:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.688010:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.688376:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867857664:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.688401:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 28 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.688415:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba000, rc 0) 00000100:00100000:2.0:1746142914.688454:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32578:x1830962867495168:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6037us (6383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.688461:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14502 00000100:00100000:3.0:1746142914.688603:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867495296 00000100:00100000:3.0:1746142914.688610:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867495296 00002000:00100000:3.0:1746142914.688642:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3440639) req@ffff88009cfee680 x1830962867495296/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.688650:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee680 with x1830962867495296 ext(3145728->3440639) 00010000:00010000:3.0:1746142914.688656:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.688666:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 14 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.688671:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cfee680 00000100:00100000:3.0:1746142914.688696:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1408 00000100:00100000:3.0:1746142914.688702:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867495296:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142914.693733:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+16:2003:x1830962867495296:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5022us (5721us total) trans 17179873974 rc 0/0 00000100:00100000:0.0:1746142914.693744:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1408 00002000:00100000:0.0:1746142914.693755:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3440639) req@ffff88009cfee680 x1830962867495296/t17179873974(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.693764:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfee680 with x1830962867495296 ext(3145728->3440639) 00010000:00010000:0.0:1746142914.693774:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 16 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.693787:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 16 pid: 11421 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746142914.693794:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009cfee680 00000100:00100000:2.0:1746142914.702325:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.702449:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867495424 00000100:00100000:0.0:1746142914.702457:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867495424 00010000:00010000:0.0:1746142914.702486:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 16 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.702513:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6566 00000100:00100000:0.0:1746142914.702519:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962867495424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.702529:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.702544:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 16 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.702553:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 16 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.702570:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0e00/0x2fa243e067ccda54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3440639) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae92 expref: 16 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.703824:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.703828:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.703837:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.703847:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.703879:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 27 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.703893:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867857792:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142914.703975:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.710499:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.710709:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867495680 00000100:00100000:1.0:1746142914.710717:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867495680 00002000:00100000:1.0:1746142914.710753:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009cd5ed80 x1830962867495680/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.710762:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5ed80 with x1830962867495680 ext(2097152->4194303) 00002000:00010000:1.0:1746142914.710767:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5ed80 00000100:00100000:1.0:1746142914.710794:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4528 00000100:00100000:1.0:1746142914.710801:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867495680:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.711112:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867857792:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142914.711129:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142914.711161:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867495424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8642us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.711169:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6566 00000100:00100000:3.0:1746142914.711450:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.711632:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867495936 00000100:00100000:2.0:1746142914.711636:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867495936 00002000:00100000:2.0:1746142914.711653:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880098192300 x1830962867495936/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.711660:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098192300 with x1830962867495936 ext(3145728->4194303) 00002000:00010000:2.0:1746142914.711663:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098192300 00000100:00100000:2.0:1746142914.711682:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4529 00000100:00100000:2.0:1746142914.711687:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867495936:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.728141:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867495680:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17331us (17638us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142914.728153:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4528 00002000:00100000:1.0:1746142914.728163:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009cd5ed80 x1830962867495680/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.728178:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5ed80 with x1830962867495680 ext(2097152->4194303) 00002000:00010000:1.0:1746142914.728183:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5ed80 00000100:00100000:2.0:1746142914.731295:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867495936:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19588us (19825us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.731307:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4529 00002000:00100000:2.0:1746142914.731319:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880098192300 x1830962867495936/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.731327:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098192300 with x1830962867495936 ext(3145728->4194303) 00002000:00010000:2.0:1746142914.731332:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098192300 00000100:00100000:0.0:1746142914.740339:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.740406:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867496192 00000100:00100000:2.0:1746142914.740414:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867496192 00002000:00100000:2.0:1746142914.740450:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88009cfef480 x1830962867496192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.740459:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfef480 with x1830962867496192 ext(4194304->5066751) 00002000:00010000:2.0:1746142914.740464:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfef480 00000100:00100000:2.0:1746142914.740493:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4530 00000100:00100000:2.0:1746142914.740500:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867496192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.751495:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867496192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10987us (11156us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142914.751506:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4530 00002000:00100000:2.0:1746142914.751516:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88009cfef480 x1830962867496192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.751523:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfef480 with x1830962867496192 ext(4194304->5066751) 00002000:00010000:2.0:1746142914.751528:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfef480 00000100:00100000:0.0:1746142914.760507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.760583:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867496448 00000100:00100000:3.0:1746142914.760593:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867496448 00000100:00100000:3.0:1746142914.760644:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5295 00000100:00100000:3.0:1746142914.760651:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32578:x1830962867496448:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142914.760879:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32578:x1830962867496448:12345-192.168.204.50@tcp:35:cat.0 Request processed in 225us (374us total) trans 8589936669 rc 0/0 00000100:00100000:3.0:1746142914.760886:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5295 00000100:00100000:0.0:1746142914.772881:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.774102:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867496576 00000100:00100000:2.0:1746142914.774111:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867496576 00000100:00100000:2.0:1746142914.774153:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14503 00000100:00100000:2.0:1746142914.774159:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32580:x1830962867496576:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.774173:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.774187:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aeca expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.774208:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.774215:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.774220:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.774221:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.774223:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2945024->3145727] (req 2945024->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 30 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.774244:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.774252:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.774261:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867857920:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.774640:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 12 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.774647:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 12 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.774655:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867858048:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.774713:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.777621:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867857920:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.777633:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867858048:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.777658:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2945024->3145727] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 30 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.777670:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbae00, rc 0) 00000100:00100000:2.0:1746142914.777717:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32580:x1830962867496576:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3556us (4844us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.777725:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14503 00000100:00100000:0.0:1746142914.778485:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.778849:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867496704 00000100:00100000:2.0:1746142914.778855:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867496704 00010000:00010000:2.0:1746142914.778878:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.779020:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.779248:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867496832 00000100:00100000:2.0:1746142914.779253:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867496832 00000100:00100000:0.0:1746142914.779256:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6567 00010000:00010000:2.0:1746142914.779263:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 788 lvb_type: 1 00000100:00100000:0.0:1746142914.779263:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867496704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.779273:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746142914.779300:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6568 00000100:00100000:2.0:1746142914.779305:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867496832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.779314:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.779327:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.779337:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746142914.779961:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.779971:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fba800/0x2fa243e067ccda8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeae expref: 30 pid: 11421 timeout: 788 lvb_type: 1 00010000:00010000:0.0:1746142914.779971:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.779982:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9d0200/0x2fa243e067ccda4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5066751) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae8b expref: 13 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.780002:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.780004:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.780267:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.780307:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.780317:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142914.780334:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.780345:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cfefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867858176:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142914.780348:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867496832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1043us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.780354:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6568 00000100:00100000:0.0:1746142914.780396:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.782794:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.783038:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867497088 00000100:00100000:3.0:1746142914.783046:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867497088 00002000:00100000:3.0:1746142914.783085:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2945024->2949119) req@ffff88009cfec000 x1830962867497088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.783094:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec000 with x1830962867497088 ext(2945024->2949119) 00002000:00010000:3.0:1746142914.783099:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfec000 00000100:00100000:3.0:1746142914.783129:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4531 00000100:00100000:3.0:1746142914.783136:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867497088:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142914.783230:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867497088:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 94us (443us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142914.783235:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4531 00002000:00100000:3.0:1746142914.783239:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2945024->2949119) req@ffff88009cfec000 x1830962867497088/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.783246:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfec000 with x1830962867497088 ext(2945024->2949119) 00002000:00010000:3.0:1746142914.783248:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfec000 00000100:00100000:2.0:1746142914.783265:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cfefb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867858176:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142914.783278:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.783310:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867496704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4047us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.783317:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6567 00000100:00100000:0.0:1746142914.787145:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.787655:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867497216 00000100:00100000:2.0:1746142914.787663:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867497216 00000100:00100000:2.0:1746142914.787705:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14504 00000100:00100000:2.0:1746142914.787712:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32580:x1830962867497216:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.787725:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.787738:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aed1 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.787759:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.787766:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.787768:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.787771:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2760703] (req 2097152->2760703) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.787794:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.787804:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.787814:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858304:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.787896:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.790554:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.790613:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867497472 00000100:00100000:3.0:1746142914.790619:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867497472 00000100:00100000:3.0:1746142914.790674:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14488 00000100:00100000:2.0:1746142914.790675:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858304:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142914.790680:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:32584:x1830962867497472:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142914.790696:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.790696:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2760703] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.790709:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbbc00, rc 0) 00010000:00010000:3.0:1746142914.790710:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdac4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aed8 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.790752:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32580:x1830962867497216:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3040us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.790758:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14504 00010000:00010000:3.0:1746142914.790781:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790791:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790799:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790808:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790813:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790818:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790885:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdad9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790893:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdad9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790920:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdad9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142914.790927:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142914.790983:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790988:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790993:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.790998:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791003:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.791005:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791010:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791022:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142914.791025:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.791028:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791032:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f400/0x2fa243e067ccdacb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791055:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791060:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791064:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791068:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.791070:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791074:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791080:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4000) 00010000:00010000:3.0:1746142914.791082:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.791084:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791088:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdad2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.791116:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdac4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed8 expref: 30 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.791124:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdad9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed8 expref: 29 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.791130:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142914.791132:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142914.791133:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471fe00, rc 0) 00000100:00100000:3.0:1746142914.791164:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:32584:x1830962867497472:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 484us (617us total) trans 8589936670 rc 0/0 00000100:00100000:3.0:1746142914.791170:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14488 00000100:00100000:0.0:1746142914.795484:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.795605:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867497600 00000100:00100000:2.0:1746142914.795613:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867497600 00010000:00010000:2.0:1746142914.795641:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.795673:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6569 00000100:00100000:2.0:1746142914.795681:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867497600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.795692:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.795709:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.795721:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.795738:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba000/0x2fa243e067ccdaaf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aec3 expref: 29 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.795766:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.795769:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.795774:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 28 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.795781:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 28 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.795814:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 28 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.795824:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867858432:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142914.796251:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.805579:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.805687:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867858432:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142914.805705:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.805743:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867497600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10063us (10266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.805752:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6569 00000100:00100000:2.0:1746142914.805773:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867497728 00000100:00100000:2.0:1746142914.805778:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867497728 00000100:00100000:2.0:1746142914.806188:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 776 00000100:00100000:2.0:1746142914.806195:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867497728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.806206:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.806225:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdad9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed8 expref: 29 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.806240:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.806243:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.806955:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867497728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 756us (1379us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.806961:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 776 00000100:00100000:0.0:1746142914.808692:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.808771:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867497856 00000100:00100000:2.0:1746142914.808779:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867497856 00000100:00100000:2.0:1746142914.808821:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14505 00000100:00100000:2.0:1746142914.808828:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:32584:x1830962867497856:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.808843:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.808856:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aedf expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.808880:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.808888:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 10 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.808895:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 16 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.809004:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142914.809066:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.809068:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.809072:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1368064->1613823] (req 1368064->1613823) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.809096:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 16 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.809106:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 16 pid: 1852 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.809117:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858560:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.809184:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 10 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.809192:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 10 pid: 11943 timeout: 788 lvb_type: 1 00000100:00100000:3.0:1746142914.809236:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867498112 00000100:00100000:3.0:1746142914.809240:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867498112 00000100:00100000:3.0:1746142914.809267:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14489 00000100:00100000:3.0:1746142914.809272:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:32587:x1830962867498112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.809283:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.809304:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f200/0x2fa243e067ccdaee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aee6 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.809357:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.809367:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.809375:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.809386:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142914.809920:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858688:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.809974:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 27 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.809983:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 27 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.809991:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858816:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.810007:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd39c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746142914.810059:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.810068:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.810145:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdb03 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.810154:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdb03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.810160:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdb03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142914.810167:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142914.811296:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811306:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811311:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811317:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811321:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471e600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.811324:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811330:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811344:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142914.811347:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.811350:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811354:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdaf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811376:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811382:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811386:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811389:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471e200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.811391:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811395:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811400:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4800) 00010000:00010000:3.0:1746142914.811402:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.811404:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811408:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e200/0x2fa243e067ccdafc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.811444:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f200/0x2fa243e067ccdaee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aee6 expref: 31 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.811455:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdb03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aee6 expref: 30 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.811461:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142914.811463:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142914.811465:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f800, rc 0) 00000100:00100000:3.0:1746142914.811503:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+30:32587:x1830962867498112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2229us (2498us total) trans 8589936671 rc 0/0 00000100:00100000:3.0:1746142914.811510:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14489 00000100:00100000:3.0:1746142914.812017:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858560:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142914.812613:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.812798:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867498368 00000100:00100000:1.0:1746142914.812805:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867498368 00000100:00100000:0.0:1746142914.812817:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:1.0:1746142914.812836:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2756608->2760703) req@ffff88009cfefb80 x1830962867498368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.812844:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfefb80 with x1830962867498368 ext(2756608->2760703) 00002000:00010000:1.0:1746142914.812849:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfefb80 00000100:00100000:1.0:1746142914.812873:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4532 00000100:00100000:1.0:1746142914.812879:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867498368:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142914.812895:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.812961:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867498496 00000100:00100000:2.0:1746142914.812965:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867498496 00010000:00010000:2.0:1746142914.812981:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 17 pid: 1852 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.812997:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867498624 00000100:00100000:2.0:1746142914.812998:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867498624 00000100:00100000:1.0:1746142914.813004:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867498368:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 119us (386us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746142914.813006:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 11 pid: 11943 timeout: 788 lvb_type: 1 00000100:00100000:1.0:1746142914.813010:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4532 00002000:00100000:1.0:1746142914.813015:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2756608->2760703) req@ffff88009cfefb80 x1830962867498368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746142914.813023:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6570 00002000:00100000:1.0:1746142914.813023:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfefb80 with x1830962867498368 ext(2756608->2760703) 00002000:00010000:1.0:1746142914.813025:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfefb80 00000100:00100000:2.0:1746142914.813028:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867498496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.813036:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142914.813040:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6571 00000100:00100000:1.0:1746142914.813044:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867498624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.813046:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 17 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.813049:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.813055:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 17 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.813061:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 11 pid: 11943 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.813068:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067ccd8da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adce expref: 17 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.813072:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 11 pid: 11943 timeout: 788 lvb_type: 1 00010000:00010000:2.0:1746142914.813083:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142914.813083:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.813098:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867498496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.813098:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867498624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.813103:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6570 00000100:00100000:1.0:1746142914.813106:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6571 00010000:00010000:2.0:1746142914.813355:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974d3e00/0x2fa243e067ccd9e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae4c expref: 10 pid: 11943 timeout: 788 lvb_type: 1 00000100:00100000:2.0:1746142914.813363:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858688:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142914.813370:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867858816:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142914.813387:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1368064->1613823] (req 1368064->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.813395:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbba00, rc 0) 00000100:00100000:2.0:1746142914.813454:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:32584:x1830962867497856:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4626us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.813463:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14505 00000100:00100000:0.0:1746142914.813749:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.813853:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867498752 00000100:00100000:2.0:1746142914.813856:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867498752 00000100:00100000:2.0:1746142914.813885:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 777 00000100:00100000:2.0:1746142914.813890:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2004:x1830962867498752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.813914:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.813927:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdb03 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aee6 expref: 30 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.813940:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.813944:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.814428:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867498752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 537us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.814434:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 777 00000100:00100000:0.0:1746142914.814759:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.814785:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.814807:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.814834:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.814875:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867498880 00000100:00100000:3.0:1746142914.814879:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867498880 00000100:00100000:3.0:1746142914.814896:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499008 00000100:00100000:3.0:1746142914.814913:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499008 00000100:00100000:3.0:1746142914.814923:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499136 00000100:00100000:3.0:1746142914.814924:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499136 00000100:00100000:3.0:1746142914.814936:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499264 00000100:00100000:3.0:1746142914.814938:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499264 00000100:00100000:3.0:1746142914.814950:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14506 00000100:00100000:3.0:1746142914.814955:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867498880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.814965:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.814976:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aeed expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.815007:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867858944:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142914.815059:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14507 00000100:00100000:2.0:1746142914.815065:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867499008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142914.815073:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.815080:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccdb18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aef4 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.815089:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.815094:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccdb18 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aef4 expref: 17 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.815102:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a9d0800/0x2fa243e067ccdb18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aef4 expref: 17 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.815114:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d0800, rc 0) 00000100:00100000:0.0:1746142914.815238:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14508 00000100:00100000:0.0:1746142914.815245:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867499136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.815251:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142914.815256:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccdb1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aefb expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.815274:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097348380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859072:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142914.815338:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.815354:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14509 00000100:00100000:3.0:1746142914.815359:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867499264:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.815370:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.815376:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801313dfa00/0x2fa243e067ccdb26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af02 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.815398:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867859200:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142914.815521:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867499008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 455us (734us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.815526:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14507 00000100:00100000:0.0:1746142914.815995:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.816044:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.816063:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.816083:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499392 00000100:00100000:3.0:1746142914.816087:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499392 00010000:00010000:3.0:1746142914.816102:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 28 pid: 11421 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.816117:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6572 00000100:00100000:3.0:1746142914.816122:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867499392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.816129:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.816445:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 28 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.816456:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 28 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.816471:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d951e00/0x2fa243e067ccd88d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8adab expref: 28 pid: 11421 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.816481:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.816483:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.816488:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.816494:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.816515:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.816523:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867859328:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.816563:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746142914.818949:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142914 -> 1746142915 00000100:00100000:1.0:1746142914.818970:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097348380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859072:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142914.818994:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccdb1f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aefb expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.819004:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cde00/0x2fa243e067ccdb1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aefb expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.819015:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:1.0:1746142914.819047:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867499136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3803us (4239us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142914.819054:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14508 00000100:00100000:2.0:1746142914.819113:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867859200:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142914.819128:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801313dfa00/0x2fa243e067ccdb26 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af02 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.819136:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801313dfa00/0x2fa243e067ccdb26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af02 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.819143:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801313dfa00, rc 0) 00000100:00100000:2.0:1746142914.819160:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867499264:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3800us (4326us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.819164:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14509 00000100:00100000:2.0:1746142914.819243:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867858944:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142914.819255:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb11 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeed expref: 14 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.819263:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeed expref: 14 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142914.819269:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f600, rc 0) 00000100:00100000:2.0:1746142914.819303:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867498880:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4348us (4544us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142914.819308:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14506 00000100:00100000:0.0:1746142914.821487:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.821727:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499648 00000100:00100000:2.0:1746142914.821734:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499648 00002000:00100000:2.0:1746142914.821766:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1368064->1372159) req@ffff88009734a300 x1830962867499648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.821779:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734a300 with x1830962867499648 ext(1368064->1372159) 00002000:00010000:2.0:1746142914.821784:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734a300 00000100:00100000:2.0:1746142914.821807:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4533 00000100:00100000:2.0:1746142914.821814:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867499648:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142914.821932:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867499648:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 117us (449us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142914.821938:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4533 00002000:00100000:2.0:1746142914.821943:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1368064->1372159) req@ffff88009734a300 x1830962867499648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.821950:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734a300 with x1830962867499648 ext(1368064->1372159) 00002000:00010000:2.0:1746142914.821952:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734a300 00000100:00100000:0.0:1746142914.822077:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.822191:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499776 00000100:00100000:1.0:1746142914.822195:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499776 00000100:00100000:1.0:1746142914.822215:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14510 00000100:00100000:1.0:1746142914.822219:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+12:32587:x1830962867499776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.822230:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.822242:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af09 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.822261:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.822268:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.822269:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.822272:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.822304:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.822315:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 28 pid: 1852 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.822324:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859456:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.822367:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.822580:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867859328:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142914.822596:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.822615:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867499392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6493us (6571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.822622:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6572 00000100:00100000:2.0:1746142914.826663:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.826698:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.826799:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859456:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.826823:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.826839:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a89d400, rc 0) 00000100:00100000:1.0:1746142914.826876:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:32587:x1830962867499776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4655us (4799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.826887:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14510 00000100:00100000:0.0:1746142914.827658:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867499904 00000100:00100000:0.0:1746142914.827664:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867499904 00002000:00100000:0.0:1746142914.827695:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (233472->290815) req@ffff88009cd5f100 x1830962867499904/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.827709:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f100 with x1830962867499904 ext(233472->290815) 00010000:00010000:0.0:1746142914.827715:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 29 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.827726:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 29 pid: 1852 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746142914.827732:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5f100 00000100:00100000:0.0:1746142914.827747:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867500160 00000100:00100000:0.0:1746142914.827750:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867500160 00002000:00100000:0.0:1746142914.827764:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1609728->1613823) req@ffff88009cd5d180 x1830962867500160/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.827771:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d180 with x1830962867500160 ext(1609728->1613823) 00002000:00010000:0.0:1746142914.827774:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5d180 00000100:00100000:0.0:1746142914.827786:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1409 00000100:00100000:0.0:1746142914.827792:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867499904:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142914.827932:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4534 00000100:00100000:1.0:1746142914.827939:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867500160:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.828020:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867500160:12345-192.168.204.50@tcp:3:cat.0 Request processed in 82us (1322us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142914.828025:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4534 00002000:00100000:1.0:1746142914.828030:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1609728->1613823) req@ffff88009cd5d180 x1830962867500160/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/4536 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.828036:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d180 with x1830962867500160 ext(1609728->1613823) 00002000:00010000:1.0:1746142914.828039:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5d180 00000100:00100000:0.0:1746142914.830728:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867499904:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 2929us (4066us total) trans 21474841236 rc 0/0 00000100:00100000:0.0:1746142914.830737:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1409 00002000:00100000:0.0:1746142914.830745:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (233472->290815) req@ffff88009cd5f100 x1830962867499904/t21474841236(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.830753:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f100 with x1830962867499904 ext(233472->290815) 00010000:00010000:0.0:1746142914.830761:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 31 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.830773:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 31 pid: 1852 timeout: 788 lvb_type: 0 00002000:00010000:0.0:1746142914.830779:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5f100 00000100:00100000:0.0:1746142914.832426:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.832606:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867500416 00000100:00100000:2.0:1746142914.832615:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867500416 00000100:00100000:2.0:1746142914.832659:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5296 00000100:00100000:2.0:1746142914.832667:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+29:32584:x1830962867500416:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142914.833074:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+30:32584:x1830962867500416:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 407us (652us total) trans 8589936672 rc 0/0 00000100:00100000:2.0:1746142914.833084:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5296 00000100:00100000:0.0:1746142914.833873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.833950:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867500544 00000100:00100000:3.0:1746142914.833956:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867500544 00010000:00010000:3.0:1746142914.833977:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 31 pid: 1852 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.833995:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6573 00000100:00100000:3.0:1746142914.834001:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867500544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.834010:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.834025:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 31 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.834039:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 31 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.834057:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3920800/0x2fa243e067ccda23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 233472->290815) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ae6f expref: 31 pid: 1852 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.834689:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.834692:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.834699:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.834706:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.834735:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 12 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.834744:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867859584:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142914.835312:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142914.839785:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867859584:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142914.839812:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.839859:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867500544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5856us (5985us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.839868:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6573 00000100:00100000:0.0:1746142914.842317:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.843829:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867500928 00000100:00100000:0.0:1746142914.843833:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.843838:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867500928 00002000:00100000:2.0:1746142914.843872:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880097349180 x1830962867500928/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.843881:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349180 with x1830962867500928 ext(0->1048575) 00002000:00010000:2.0:1746142914.843886:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097349180 00000100:00100000:2.0:1746142914.843916:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501056 00000100:00100000:2.0:1746142914.843919:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501056 00002000:00100000:2.0:1746142914.843931:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097348000 x1830962867501056/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 504/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.843938:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348000 with x1830962867501056 ext(1048576->2097151) 00002000:00010000:2.0:1746142914.843940:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097348000 00000100:00100000:2.0:1746142914.843966:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4535 00000100:00100000:2.0:1746142914.843973:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867500928:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142914.844082:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4536 00000100:00100000:0.0:1746142914.844089:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867501056:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.855176:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867501056:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11079us (11341us total) trans 0 rc 802816/802816 00000100:00100000:2.0:1746142914.855187:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4536 00002000:00100000:2.0:1746142914.855197:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097348000 x1830962867501056/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 504/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 802816/802816 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.855207:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348000 with x1830962867501056 ext(1048576->2097151) 00002000:00010000:2.0:1746142914.855212:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097348000 00000100:00100000:2.0:1746142914.857662:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867500928:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13683us (15343us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.857676:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4535 00002000:00100000:2.0:1746142914.857684:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff880097349180 x1830962867500928/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.857692:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097349180 with x1830962867500928 ext(0->1048575) 00002000:00010000:2.0:1746142914.857696:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097349180 00000100:00100000:0.0:1746142914.869278:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.869340:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.869439:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501184 00000100:00100000:1.0:1746142914.869447:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501184 00000100:00100000:1.0:1746142914.869494:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501312 00000100:00100000:1.0:1746142914.869496:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501312 00000100:00100000:1.0:1746142914.869512:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14511 00000100:00100000:1.0:1746142914.869518:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867501184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.869533:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.869546:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccdb34 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af10 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142914.869591:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859712:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142914.869641:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14512 00000100:00100000:3.0:1746142914.869649:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867501312:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1746142914.869656:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746142914.869657:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.869666:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdb3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af17 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.869688:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867859840:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142914.869714:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.872062:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859712:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142914.872082:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867859840:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142914.872089:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccdb34 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af10 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.872097:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdb3b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af17 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.872103:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb24000/0x2fa243e067ccdb34 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af10 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.872104:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdb3b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af17 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142914.872126:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83600, rc 0) 00000100:00100000:3.0:1746142914.872159:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867501312:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2510us (2818us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142914.872166:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14512 00010000:00010000:1.0:1746142914.872639:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb24000, rc 0) 00000100:00100000:1.0:1746142914.872658:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867501184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3140us (3387us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142914.872663:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14511 00000100:00100000:0.0:1746142914.874705:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.875156:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501440 00000100:00100000:1.0:1746142914.875164:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501440 00000100:00100000:1.0:1746142914.875211:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14513 00000100:00100000:1.0:1746142914.875217:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:32587:x1830962867501440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.875232:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.875246:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af1e expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.875269:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.875275:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.875277:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.875280:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.875312:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 29 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.875326:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 29 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.875336:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e67b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859968:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.875406:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.876800:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e67b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867859968:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.876822:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.876835:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25800, rc 0) 00000100:00100000:1.0:1746142914.876866:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:32587:x1830962867501440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1645us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.876873:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14513 00000100:00100000:0.0:1746142914.877969:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.878042:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501568 00000100:00100000:2.0:1746142914.878049:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501568 00002000:00100000:2.0:1746142914.878083:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2945024->3145727) req@ffff880097348380 x1830962867501568/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.878091:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348380 with x1830962867501568 ext(2945024->3145727) 00010000:00010000:2.0:1746142914.878098:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.878108:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.878115:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097348380 00000100:00100000:2.0:1746142914.878129:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1410 00000100:00100000:2.0:1746142914.878136:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867501568:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142914.882333:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.882811:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501824 00000100:00100000:3.0:1746142914.882823:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501824 00000100:00100000:3.0:1746142914.882869:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14490 00000100:00100000:3.0:1746142914.882877:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32592:x1830962867501824:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142914.882924:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142914.882940:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdb49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af25 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.883005:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883015:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883024:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883035:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883040:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883046:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883119:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccdb5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883128:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccdb5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883133:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccdb5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142914.883140:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142914.883700:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883706:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883714:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883718:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883722:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.883725:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883731:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883739:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142914.883742:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.883745:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883749:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdb50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883770:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883775:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883779:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883783:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd83600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142914.883785:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883793:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883799:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4d00) 00010000:00010000:3.0:1746142914.883801:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142914.883803:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883807:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdb57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142914.883838:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdb49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af25 expref: 51 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.883847:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccdb5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af25 expref: 50 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.883852:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142914.883854:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142914.883856:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82000, rc 0) 00000100:00100000:3.0:1746142914.883934:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32592:x1830962867501824:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1057us (1607us total) trans 8589936673 rc 0/0 00000100:00100000:3.0:1746142914.883940:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14490 00000100:00100000:2.0:1746142914.884575:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867501568:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 6438us (6607us total) trans 21474841237 rc 0/0 00000100:00100000:2.0:1746142914.884584:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1410 00002000:00100000:2.0:1746142914.884592:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2945024->3145727) req@ffff880097348380 x1830962867501568/t21474841237(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.884606:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097348380 with x1830962867501568 ext(2945024->3145727) 00010000:00010000:2.0:1746142914.884612:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 32 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.884623:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 32 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.884630:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097348380 00000100:00100000:0.0:1746142914.889618:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.889655:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.889678:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.889703:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.889726:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867501952 00000100:00100000:0.0:1746142914.889734:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867501952 00010000:00010000:0.0:1746142914.889764:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 32 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:0.0:1746142914.889785:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867502336 00000100:00100000:0.0:1746142914.889787:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867502336 00000100:00100000:0.0:1746142914.889802:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6574 00000100:00100000:0.0:1746142914.889808:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867501952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.889819:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.889835:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 32 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.889847:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 32 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.889866:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdab6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2945024->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aeca expref: 32 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:0.0:1746142914.889885:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.889887:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.889893:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.889923:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.889951:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 13 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.889961:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867860096:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142914.890027:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.890064:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.890083:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867502080 00000100:00100000:0.0:1746142914.890086:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867502080 00000100:00100000:0.0:1746142914.890102:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867502208 00000100:00100000:0.0:1746142914.890103:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867502208 00000100:00100000:0.0:1746142914.890113:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867502464 00000100:00100000:0.0:1746142914.890114:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867502464 00000100:00100000:0.0:1746142914.890127:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14514 00000100:00100000:0.0:1746142914.890132:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867502080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.890142:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142914.890151:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af2c expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.890163:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.890165:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.890169:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.890178:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.890185:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2b200, rc 0) 00000100:00100000:0.0:1746142914.890205:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867502080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 72us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.890210:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14514 00000100:00100000:0.0:1746142914.890221:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14515 00000100:00100000:0.0:1746142914.890226:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867502208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.890232:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142914.890239:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067ccdb73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af33 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142914.890262:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860224:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142914.890280:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.890303:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14516 00000100:00100000:0.0:1746142914.890309:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867502464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142914.890314:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142914.890321:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af3a expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.890330:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.890331:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142914.890335:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 34 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.890343:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 34 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142914.890349:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cce00, rc 0) 00000100:00100000:0.0:1746142914.890363:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867502464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 55us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.890367:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14516 00000100:00100000:1.0:1746142914.890522:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 778 00000100:00100000:1.0:1746142914.890529:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2006:x1830962867502336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142914.890537:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142914.890550:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82000/0x2fa243e067ccdb5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af25 expref: 50 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.890562:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142914.890565:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142914.890583:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867502336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 55us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.890588:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 778 00000100:00100000:2.0:1746142914.895002:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867860096:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142914.895020:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.895062:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867501952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5252us (5453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.895072:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6574 00002000:00010000:1.0:1746142914.895266:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142914 -> 1746142915 00002000:00010000:1.0:1746142914.895270:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142914 -> 1746142915 00002000:00010000:1.0:1746142914.895272:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142914 -> 1746142915 00000100:00100000:1.0:1746142914.895295:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860224:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142914.895314:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067ccdb73 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af33 expref: 28 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.895327:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067ccdb73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af33 expref: 28 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142914.895347:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2bc00, rc 0) 00000100:00100000:1.0:1746142914.895370:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867502208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5144us (5692us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142914.895377:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14515 00000100:00100000:0.0:1746142914.897814:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.898182:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867502720 00000100:00100000:2.0:1746142914.898190:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867502720 00002000:00100000:2.0:1746142914.898231:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092d0a300 x1830962867502720/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.898240:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0a300 with x1830962867502720 ext(2097152->3145727) 00002000:00010000:2.0:1746142914.898245:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0a300 00000100:00100000:2.0:1746142914.898272:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4537 00000100:00100000:2.0:1746142914.898279:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867502720:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142914.906981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.907117:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867502976 00000100:00100000:0.0:1746142914.907124:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867502976 00002000:00100000:0.0:1746142914.907161:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012e67b480 x1830962867502976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142914.907171:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67b480 with x1830962867502976 ext(0->1048575) 00002000:00010000:0.0:1746142914.907175:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67b480 00000100:00100000:0.0:1746142914.907363:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4538 00000100:00100000:0.0:1746142914.907371:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867502976:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142914.910794:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867502720:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12507us (12979us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.910805:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4537 00002000:00100000:2.0:1746142914.910816:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092d0a300 x1830962867502720/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.910825:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0a300 with x1830962867502720 ext(2097152->3145727) 00002000:00010000:2.0:1746142914.910830:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0a300 00000100:00100000:2.0:1746142914.915548:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867502976:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8169us (8565us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142914.915559:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4538 00002000:00100000:2.0:1746142914.915571:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012e67b480 x1830962867502976/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.915580:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67b480 with x1830962867502976 ext(0->1048575) 00002000:00010000:2.0:1746142914.915585:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67b480 00000100:00100000:0.0:1746142914.918438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.918497:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867503104 00000100:00100000:1.0:1746142914.918507:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867503104 00000100:00100000:1.0:1746142914.918557:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14517 00000100:00100000:1.0:1746142914.918564:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+15:32587:x1830962867503104:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.918578:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.918592:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af41 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.918618:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.918625:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.918627:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.918630:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.918653:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.918664:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 26 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.918673:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860352:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.918756:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.921279:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860352:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.921313:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.921328:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77e00, rc 0) 00000100:00100000:1.0:1746142914.921371:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:32587:x1830962867503104:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2807us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.921379:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14517 00000100:00100000:0.0:1746142914.922694:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.922827:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867503232 00000100:00100000:1.0:1746142914.922833:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867503232 00000100:00100000:1.0:1746142914.923373:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14518 00000100:00100000:1.0:1746142914.923381:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32592:x1830962867503232:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142914.923394:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.923408:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af48 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.923432:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.923438:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.923440:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142914.923442:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.923463:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 15 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.923472:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 15 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.923480:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860480:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142914.924328:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142914.926931:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e679c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860480:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142914.926964:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.926979:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77400, rc 0) 00000100:00100000:1.0:1746142914.927032:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32592:x1830962867503232:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3647us (4337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142914.927040:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14518 00000100:00100000:0.0:1746142914.927448:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.927783:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867503360 00000100:00100000:2.0:1746142914.927790:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867503360 00002000:00100000:2.0:1746142914.927823:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2760703) req@ffff880092d08380 x1830962867503360/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.927832:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08380 with x1830962867503360 ext(2097152->2760703) 00010000:00010000:2.0:1746142914.927839:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 28 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.927849:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 28 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.927854:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092d08380 00000100:00100000:2.0:1746142914.927881:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1411 00000100:00100000:2.0:1746142914.927888:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867503360:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142914.928376:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.930059:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867503488 00000100:00100000:1.0:1746142914.930069:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867503488 00002000:00100000:1.0:1746142914.930102:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1368064->1613823) req@ffff880092d0aa00 x1830962867503488/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142914.930111:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0aa00 with x1830962867503488 ext(1368064->1613823) 00010000:00010000:1.0:1746142914.930119:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 16 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:1.0:1746142914.930129:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 16 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:1.0:1746142914.930136:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092d0aa00 00000100:00100000:1.0:1746142914.930171:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1412 00000100:00100000:1.0:1746142914.930177:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962867503488:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142914.940923:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867503360:12345-192.168.204.50@tcp:4:cat.0 Request processed in 13027us (13467us total) trans 17179873975 rc 0/0 00000100:00100000:2.0:1746142914.940935:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1411 00002000:00100000:2.0:1746142914.940945:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2760703) req@ffff880092d08380 x1830962867503360/t17179873975(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142914.940953:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08380 with x1830962867503360 ext(2097152->2760703) 00010000:00010000:2.0:1746142914.940964:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.940975:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:2.0:1746142914.940981:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092d08380 00000100:00100000:3.0:1746142914.944500:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867503488:12345-192.168.204.50@tcp:4:cat.0 Request processed in 14315us (16118us total) trans 17179873976 rc 0/0 00000100:00100000:3.0:1746142914.944510:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1412 00002000:00100000:3.0:1746142914.944519:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1368064->1613823) req@ffff880092d0aa00 x1830962867503488/t17179873976(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/448 e 0 to 0 dl 1746142925 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.944532:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0aa00 with x1830962867503488 ext(1368064->1613823) 00010000:00010000:3.0:1746142914.944540:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 18 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.944550:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 18 pid: 1397 timeout: 788 lvb_type: 0 00002000:00010000:3.0:1746142914.944556:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092d0aa00 00000100:00100000:1.0:1746142914.947368:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.947470:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867503616 00000100:00100000:3.0:1746142914.947478:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867503616 00010000:00010000:3.0:1746142914.947504:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:3.0:1746142914.947525:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6575 00000100:00100000:3.0:1746142914.947530:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867503616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142914.947541:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142914.947556:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.947565:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.947584:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fbbc00/0x2fa243e067ccdabd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2760703) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aed1 expref: 30 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:3.0:1746142914.947599:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.947601:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142914.947608:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.947615:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142914.947641:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142914.947651:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867860608:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142914.947955:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.948470:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867503872 00000100:00100000:2.0:1746142914.948475:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867503872 00000100:00100000:3.0:1746142914.948490:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142914.948506:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14491 00000100:00100000:2.0:1746142914.948511:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32594:x1830962867503872:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142914.948525:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142914.948538:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccdb8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af4f expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.948763:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948773:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948783:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948793:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948798:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948802:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948867:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdba4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948875:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdba4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948879:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdba4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142914.948885:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142914.948949:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948954:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948959:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948963:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948968:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801313dee00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.948971:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948976:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948983:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142914.948985:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.948987:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.948991:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccdb96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949010:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949015:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949018:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949022:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142914.949023:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949027:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949032:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdc00) 00010000:00010000:2.0:1746142914.949033:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142914.949035:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949042:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f600/0x2fa243e067ccdb9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142914.949067:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccdb8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af4f expref: 52 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.949075:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdba4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af4f expref: 51 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.949081:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142914.949083:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746142914.949084:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f800, rc 0) 00000100:00100000:2.0:1746142914.949109:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32594:x1830962867503872:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 598us (1156us total) trans 8589936674 rc 0/0 00000100:00100000:2.0:1746142914.949114:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14491 00000100:00100000:0.0:1746142914.952526:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142914.952604:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867504000 00000100:00100000:2.0:1746142914.952611:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867504000 00010000:00010000:2.0:1746142914.952638:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 18 pid: 1397 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142914.952660:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6576 00000100:00100000:2.0:1746142914.952665:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867504000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142914.952675:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142914.952691:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 18 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.952701:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 18 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.952717:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fbba00/0x2fa243e067ccdae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1368064->1613823) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aedf expref: 18 pid: 1397 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142914.952729:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.952731:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142914.952736:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.952743:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142914.952765:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142914.952774:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867860736:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142914.952844:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.953105:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.953154:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.953166:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867504384 00000100:00100000:0.0:1746142914.953169:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867504384 00000100:00100000:0.0:1746142914.953186:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 779 00000100:00100000:0.0:1746142914.953191:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a52bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:2004:x1830962867504384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142914.953198:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142914.953209:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f800/0x2fa243e067ccdba4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af4f expref: 51 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142914.953219:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142914.953222:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142914.953238:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a52bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2004:x1830962867504384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 47us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142914.953243:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 779 00000100:00100000:2.0:1746142914.953404:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867504256 00000100:00100000:2.0:1746142914.953407:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867504256 00000100:00100000:2.0:1746142914.953424:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5297 00000100:00100000:2.0:1746142914.953428:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32594:x1830962867504256:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142914.953542:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32594:x1830962867504256:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 113us (437us total) trans 8589936675 rc 0/0 00000100:00100000:2.0:1746142914.953548:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5297 00000100:00100000:3.0:1746142914.957968:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867860608:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142914.957986:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142914.958031:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867503616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10499us (10668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142914.958039:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6575 00000100:00100000:2.0:1746142914.958062:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867860736:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142914.958073:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142914.958089:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867504000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5423us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142914.958095:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6576 00000100:00100000:0.0:1746142914.963625:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.965242:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142914.965319:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.965403:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867504640 00000100:00100000:3.0:1746142914.965413:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867504640 00002000:00100000:3.0:1746142914.965458:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092433100 x1830962867504640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.965468:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092433100 with x1830962867504640 ext(1048576->2097151) 00002000:00010000:3.0:1746142914.965472:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092433100 00000100:00100000:3.0:1746142914.965513:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867504896 00000100:00100000:3.0:1746142914.965517:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867504896 00002000:00100000:3.0:1746142914.965534:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092431c00 x1830962867504896/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.965546:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431c00 with x1830962867504896 ext(2097152->4194303) 00002000:00010000:3.0:1746142914.965549:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092431c00 00000100:00100000:3.0:1746142914.965562:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867505152 00000100:00100000:3.0:1746142914.965565:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867505152 00002000:00100000:3.0:1746142914.965581:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092430380 x1830962867505152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.965587:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092430380 with x1830962867505152 ext(3145728->4194303) 00002000:00010000:3.0:1746142914.965590:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092430380 00000100:00100000:3.0:1746142914.965606:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4539 00000100:00100000:3.0:1746142914.965614:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867504640:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142914.966329:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4540 00000100:00100000:3.0:1746142914.966335:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867504896:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142914.967253:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4541 00000100:00100000:3.0:1746142914.967259:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867505152:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142914.977505:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867504640:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11879us (13874us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142914.977517:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4539 00002000:00100000:3.0:1746142914.977526:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092433100 x1830962867504640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.977535:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092433100 with x1830962867504640 ext(1048576->2097151) 00002000:00010000:3.0:1746142914.977540:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092433100 00000100:00100000:3.0:1746142914.988893:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867504896:12345-192.168.204.50@tcp:3:cat.0 Request processed in 22550us (23648us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142914.988923:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4540 00002000:00100000:3.0:1746142914.988933:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092431c00 x1830962867504896/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.988942:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431c00 with x1830962867504896 ext(2097152->4194303) 00002000:00010000:3.0:1746142914.988946:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092431c00 00000100:00100000:0.0:1746142914.995668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142914.995845:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867505280 00000100:00100000:1.0:1746142914.995854:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867505280 00000100:00100000:1.0:1746142914.995926:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14519 00000100:00100000:1.0:1746142914.995933:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32594:x1830962867505280:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142914.995948:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142914.995961:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af56 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.995985:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.995991:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.995993:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142914.995996:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2191360->2637823] (req 2191360->2637823) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.996016:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142914.996026:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 16 pid: 9580 timeout: 788 lvb_type: 0 00000100:00100000:1.0:1746142914.996035:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860864:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142914.996402:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867505152:12345-192.168.204.50@tcp:3:cat.0 Request processed in 29141us (31082us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142914.996410:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4541 00002000:00100000:3.0:1746142914.996418:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092430380 x1830962867505152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.996427:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092430380 with x1830962867505152 ext(3145728->4194303) 00002000:00010000:3.0:1746142914.996431:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092430380 00000100:00100000:1.0:1746142914.996757:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142914.997889:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142914.997931:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867505536 00000100:00100000:3.0:1746142914.997938:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867505536 00002000:00100000:3.0:1746142914.997968:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092431f80 x1830962867505536/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/0 e 0 to 0 dl 1746142925 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142914.997976:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431f80 with x1830962867505536 ext(2097152->3145727) 00002000:00010000:3.0:1746142914.997979:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092431f80 00000100:00100000:3.0:1746142914.997993:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4542 00000100:00100000:3.0:1746142914.998000:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867505536:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142914.998362:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867860864:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.000088:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2191360->2637823] (req 2191360->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.000112:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06e00, rc 0) 00000100:00100000:1.0:1746142915.000155:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32594:x1830962867505280:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4220us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.000163:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14519 00000100:00100000:0.0:1746142915.004532:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.004572:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.004631:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867505792 00000100:00100000:2.0:1746142915.004638:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867505792 00010000:00010000:2.0:1746142915.004681:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 788 lvb_type: 0 00000100:00100000:2.0:1746142915.004706:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6577 00000100:00100000:2.0:1746142915.004713:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2004:x1830962867505792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.004724:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.004739:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142915.004750:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 788 lvb_type: 0 00000100:00080000:0.0:1746142915.004758:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746142915.004770:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d77e00/0x2fa243e067ccdb81 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af41 expref: 17 pid: 9580 timeout: 788 lvb_type: 0 00010000:00010000:2.0:1746142915.004792:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.004794:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.004799:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.004806:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.004815:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867505664 00000100:00100000:1.0:1746142915.004819:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867505664 00000100:00100000:1.0:1746142915.004842:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14520 00000100:00100000:1.0:1746142915.004847:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32587:x1830962867505664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.004859:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.004861:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.004869:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af5d expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.004872:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867860992:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142915.004889:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.004894:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.004895:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746142915.004917:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867505536:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 6896us (7007us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746142915.004917:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 18 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.004926:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4542 00000100:00100000:2.0:1746142915.004931:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00010000:00010000:1.0:1746142915.004933:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 29 pid: 9580 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746142915.004934:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092431f80 x1830962867505536/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:65/0 lens 488/440 e 0 to 0 dl 1746142925 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746142915.004941:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 29 pid: 9580 timeout: 789 lvb_type: 0 00002000:00100000:3.0:1746142915.004942:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431f80 with x1830962867505536 ext(2097152->3145727) 00002000:00010000:3.0:1746142915.004946:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092431f80 00000100:00100000:1.0:1746142915.004949:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867861120:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.004971:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.009249:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867860992:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.009265:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.009308:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867505792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4595us (4734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.009317:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6577 00000100:00100000:0.0:1746142915.014603:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.014930:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867506048 00000100:00100000:3.0:1746142915.014938:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867506048 00002000:00100000:3.0:1746142915.014987:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880092433800 x1830962867506048/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.014996:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092433800 with x1830962867506048 ext(2097152->3145727) 00010000:00010000:3.0:1746142915.015004:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 30 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.015017:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 30 pid: 9580 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.015027:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092433800 00000100:00100000:3.0:1746142915.015047:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1413 00000100:00100000:3.0:1746142915.015054:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867506048:12345-192.168.204.50@tcp:3:multiop.0 00000100:00080000:0.0:1746142915.015711:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746142915.016279:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867861120:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.016311:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.016322:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06600, rc 0) 00000100:00100000:1.0:1746142915.018525:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32587:x1830962867505664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 13669us (13993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.018535:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14520 00000100:00100000:0.0:1746142915.018640:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.018683:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.018718:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.018739:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867506688 00000100:00100000:1.0:1746142915.018750:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867506688 00000100:00100000:1.0:1746142915.018778:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14521 00000100:00100000:1.0:1746142915.018784:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32592:x1830962867506688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.018797:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.018811:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af64 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.018831:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.018833:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.018836:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.018845:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 33 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.018853:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07a00, rc 0) 00000100:00100000:1.0:1746142915.018879:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32592:x1830962867506688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.018885:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14521 00000100:00100000:0.0:1746142915.020349:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867506432 00000100:00100000:0.0:1746142915.020356:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867506432 00000100:00100000:1.0:1746142915.020413:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867506560 00000100:00100000:1.0:1746142915.020416:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867506560 00002000:00100000:1.0:1746142915.020441:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880092431500 x1830962867506560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.020449:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431500 with x1830962867506560 ext(3145728->4194303) 00010000:00010000:1.0:1746142915.020456:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.020466:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746142915.020473:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092431500 00000100:00100000:1.0:1746142915.020487:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1414 00000100:00100000:1.0:1746142915.020492:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867506560:12345-192.168.204.50@tcp:3:multiop.0 00002000:00100000:3.0:1746142915.020543:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092430700 x1830962867506432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.020550:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092430700 with x1830962867506432 ext(3145728->4194303) 00002000:00010000:3.0:1746142915.020553:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092430700 00000100:00100000:3.0:1746142915.020564:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4543 00000100:00100000:3.0:1746142915.020568:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867506432:12345-192.168.204.50@tcp:3:multiop.0 00000100:00080000:0.0:1746142915.022641:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746142915.039365:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867506048:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 24300us (24760us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.039377:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1413 00002000:00100000:3.0:1746142915.039387:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->3145727) req@ffff880092433800 x1830962867506048/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.039395:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092433800 with x1830962867506048 ext(2097152->3145727) 00010000:00010000:3.0:1746142915.039404:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.039416:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.039422:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092433800 00000100:00100000:1.0:1746142915.041775:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867506560:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 21268us (23076us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142915.041790:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1414 00002000:00100000:1.0:1746142915.041804:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880092431500 x1830962867506560/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.041815:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431500 with x1830962867506560 ext(3145728->4194303) 00010000:00010000:1.0:1746142915.041826:0:20333:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 31 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.041844:0:20333:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 31 pid: 9580 timeout: 789 lvb_type: 0 00002000:00010000:1.0:1746142915.041850:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092431500 00000100:00100000:3.0:1746142915.044118:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867506432:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 23538us (25468us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.044129:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4543 00002000:00100000:3.0:1746142915.044140:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092430700 x1830962867506432/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.044150:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092430700 with x1830962867506432 ext(3145728->4194303) 00002000:00010000:3.0:1746142915.044156:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092430700 00000100:00100000:0.0:1746142915.049720:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.050078:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867506944 00000100:00100000:3.0:1746142915.050087:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867506944 00002000:00100000:3.0:1746142915.050128:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2191360->2637823) req@ffff880092431880 x1830962867506944/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.050142:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431880 with x1830962867506944 ext(2191360->2637823) 00010000:00010000:3.0:1746142915.050151:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 31 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.050163:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 31 pid: 9580 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.050169:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092431880 00000100:00100000:3.0:1746142915.050200:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1415 00000100:00100000:3.0:1746142915.050207:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2005:x1830962867506944:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142915.054625:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867506944:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4409us (4903us total) trans 17179873977 rc 0/0 00000100:00100000:0.0:1746142915.054636:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1415 00002000:00100000:0.0:1746142915.054647:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2191360->2637823) req@ffff880092431880 x1830962867506944/t17179873977(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142915.054654:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092431880 with x1830962867506944 ext(2191360->2637823) 00010000:00010000:0.0:1746142915.054663:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.054677:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746142915.054684:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092431880 00000100:00100000:0.0:1746142915.058356:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.058556:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867507200 00000100:00100000:2.0:1746142915.058564:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867507200 00000100:00100000:2.0:1746142915.058613:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14492 00000100:00100000:2.0:1746142915.058621:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:32596:x1830962867507200:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142915.058638:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.058653:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccdbc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af6b expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.058709:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058719:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058729:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058743:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058748:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058753:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058819:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdbdc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058826:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058831:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142915.058838:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142915.058888:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058893:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058920:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058925:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471e800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142915.058928:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058933:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058943:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142915.058945:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142915.058948:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058952:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdbce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058965:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058969:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058973:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058977:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471f000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142915.058978:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058982:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058987:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd100) 00010000:00010000:2.0:1746142915.058989:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142915.058991:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.058995:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdbd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.059023:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471ea00/0x2fa243e067ccdbc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af6b expref: 33 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.059033:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdbdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af6b expref: 32 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.059038:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.059039:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746142915.059041:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471e600, rc 0) 00000100:00100000:2.0:1746142915.059091:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+32:32596:x1830962867507200:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 471us (741us total) trans 8589936676 rc 0/0 00000100:00100000:2.0:1746142915.059097:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14492 00000100:00080000:0.0:1746142915.059478:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746142915.059600:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.060325:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867507328 00000100:00100000:0.0:1746142915.060330:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867507328 00010000:00010000:0.0:1746142915.060350:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.060731:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6578 00000100:00100000:0.0:1746142915.060738:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867507328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.060748:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.060764:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.060777:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.060793:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067ccdbb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2191360->2637823) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af56 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.060884:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.060886:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.060893:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.060914:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.060922:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.060923:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.060926:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.060932:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.061180:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.061192:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867861248:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142915.061471:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142915.061547:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 16 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.061556:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867861376:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142915.061580:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.061629:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867507456 00000100:00100000:3.0:1746142915.061632:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867507456 00000100:00100000:3.0:1746142915.061658:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 780 00000100:00100000:3.0:1746142915.061663:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867507456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.061670:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.061682:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdbdc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af6b expref: 32 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.061695:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.061698:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.061716:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867507456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.061721:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 780 00000100:00100000:2.0:1746142915.063661:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867861248:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.063678:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de10e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867861376:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.063696:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.063756:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867507328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3016us (4153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.063764:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6578 00000100:00100000:0.0:1746142915.067210:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.067257:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.067293:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867507712 00000100:00100000:2.0:1746142915.067301:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867507712 00000100:00100000:1.0:1746142915.067314:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867507968 00000100:00100000:1.0:1746142915.067317:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867507968 00002000:00100000:2.0:1746142915.067337:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88012de11500 x1830962867507712/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.067337:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012de13100 x1830962867507968/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.067346:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de11500 with x1830962867507712 ext(3145728->4194303) 00002000:00100000:1.0:1746142915.067346:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de13100 with x1830962867507968 ext(2097152->4194303) 00002000:00010000:2.0:1746142915.067350:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de11500 00002000:00010000:1.0:1746142915.067350:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de13100 00000100:00100000:2.0:1746142915.067377:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4544 00000100:00100000:1.0:1746142915.067380:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4545 00000100:00100000:2.0:1746142915.067384:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867507712:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142915.067384:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867507968:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142915.076693:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867507712:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9300us (9480us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142915.076704:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4544 00002000:00100000:2.0:1746142915.076714:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff88012de11500 x1830962867507712/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.076723:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de11500 with x1830962867507712 ext(3145728->4194303) 00002000:00010000:2.0:1746142915.076728:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de11500 00000100:00100000:0.0:1746142915.088451:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.088783:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867507968:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 21395us (21523us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142915.088794:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4545 00002000:00100000:2.0:1746142915.088805:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012de13100 x1830962867507968/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.088813:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de13100 with x1830962867507968 ext(2097152->4194303) 00002000:00010000:2.0:1746142915.088818:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de13100 00000100:00100000:1.0:1746142915.089012:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867508096 00000100:00100000:1.0:1746142915.089019:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867508096 00000100:00100000:1.0:1746142915.089048:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14522 00000100:00100000:1.0:1746142915.089055:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867508096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.089067:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.089079:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af72 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.089097:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.089099:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.089106:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.089120:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 18 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.090090:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131400, rc 0) 00000100:00100000:1.0:1746142915.090116:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867508096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1061us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.090122:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14522 00000100:00100000:0.0:1746142915.098304:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.099021:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867508352 00000100:00100000:2.0:1746142915.099030:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867508352 00002000:00100000:2.0:1746142915.099084:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012de12680 x1830962867508352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.099093:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12680 with x1830962867508352 ext(4194304->5066751) 00002000:00010000:2.0:1746142915.099097:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de12680 00000100:00100000:2.0:1746142915.099123:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4546 00000100:00100000:2.0:1746142915.099129:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867508352:12345-192.168.204.50@tcp:3:cat.0 00000100:00080000:0.0:1746142915.100840:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142915.105435:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.105533:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867508608 00000100:00100000:3.0:1746142915.105541:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867508608 00002000:00100000:3.0:1746142915.105574:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012de12300 x1830962867508608/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.105583:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12300 with x1830962867508608 ext(4194304->5066751) 00002000:00010000:3.0:1746142915.105587:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de12300 00000100:00100000:3.0:1746142915.105605:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4547 00000100:00100000:3.0:1746142915.105612:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867508608:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142915.111191:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867508352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12053us (12887us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142915.111202:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4546 00002000:00100000:2.0:1746142915.111212:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012de12680 x1830962867508352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.111221:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12680 with x1830962867508352 ext(4194304->5066751) 00002000:00010000:2.0:1746142915.111225:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de12680 00000100:00100000:3.0:1746142915.113965:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867508608:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8344us (8527us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142915.113975:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4547 00002000:00100000:3.0:1746142915.113983:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012de12300 x1830962867508608/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.113991:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de12300 with x1830962867508608 ext(4194304->5066751) 00002000:00010000:3.0:1746142915.113996:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de12300 00010000:00010000:2.0:1746142915.118581:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142915.119316:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.119449:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867508864 00000100:00100000:2.0:1746142915.119456:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867508864 00000100:00100000:2.0:1746142915.119505:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5298 00000100:00100000:2.0:1746142915.119513:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+31:32587:x1830962867508864:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142915.119677:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:32587:x1830962867508864:12345-192.168.204.50@tcp:35:cat.0 Request processed in 164us (365us total) trans 8589936677 rc 0/0 00000100:00100000:2.0:1746142915.119684:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5298 00000100:00100000:0.0:1746142915.130655:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.130868:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867509120 00000100:00100000:3.0:1746142915.130877:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867509120 00000100:00100000:3.0:1746142915.130962:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5299 00000100:00100000:3.0:1746142915.130970:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+51:32592:x1830962867509120:12345-192.168.204.50@tcp:35:cat.0 00000100:00080000:0.0:1746142915.131017:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142915.131247:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32592:x1830962867509120:12345-192.168.204.50@tcp:35:cat.0 Request processed in 276us (599us total) trans 8589936678 rc 0/0 00000100:00100000:3.0:1746142915.131253:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5299 00000100:00100000:0.0:1746142915.149751:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.149953:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867509248 00000100:00100000:3.0:1746142915.149962:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867509248 00000100:00100000:3.0:1746142915.150008:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14493 00000100:00100000:3.0:1746142915.150015:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:32600:x1830962867509248:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.150037:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.150052:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdbf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af79 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.150098:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150108:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150117:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150126:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150130:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150135:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150187:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150196:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 51 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.150201:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.150224:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 51 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.150239:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 51 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.150249:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867861504:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.151854:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.158221:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.158304:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867509504 00000100:00100000:2.0:1746142915.158315:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867509504 00000100:00100000:2.0:1746142915.158353:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5300 00000100:00100000:2.0:1746142915.158360:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:8514:x1830962867509504:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142915.158523:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+53:8514:x1830962867509504:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 164us (309us total) trans 8589936679 rc 0/0 00000100:00100000:2.0:1746142915.158530:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5300 00000100:00100000:3.0:1746142915.158603:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867861504:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.158622:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142915.161276:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.161521:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867509632 00000100:00100000:2.0:1746142915.161528:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867509632 00010000:00010000:2.0:1746142915.161555:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 53 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.161579:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6579 00000100:00100000:2.0:1746142915.161584:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+53:2004:x1830962867509632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.161594:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.161598:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 53 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.161607:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 53 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.161625:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdaa1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aebc expref: 53 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.161651:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.161655:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161664:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161670:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161691:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.161735:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:2004:x1830962867509632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.161741:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6579 00010000:00010000:2.0:1746142915.161767:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161776:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142915.161812:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:2.0:1746142915.161816:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142915.161828:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161836:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161845:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161849:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161854:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161860:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161864:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd83600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142915.161867:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161873:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161880:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142915.161882:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142915.161885:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161890:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdbf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161914:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161920:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161924:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161928:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142915.161930:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161934:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161940:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4d00) 00010000:00010000:2.0:1746142915.161942:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142915.161944:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161947:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdbff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.161973:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdbf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.161983:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 11 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.161992:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.161994:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142915.161995:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:2.0:1746142915.162029:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:32600:x1830962867509248:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 12014us (12284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.162035:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14493 00000100:00100000:0.0:1746142915.167511:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.167544:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.167567:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.167596:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.167629:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867509760 00000100:00100000:0.0:1746142915.167637:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867509760 00000100:00100000:0.0:1746142915.167680:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867509888 00000100:00100000:0.0:1746142915.167682:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867509888 00000100:00100000:0.0:1746142915.167694:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867510016 00000100:00100000:0.0:1746142915.167696:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867510016 00000100:00100000:0.0:1746142915.167704:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867510144 00000100:00100000:0.0:1746142915.167707:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867510144 00000100:00100000:0.0:1746142915.168770:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14523 00000100:00100000:0.0:1746142915.168780:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867509760:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.168795:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.168809:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af80 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.168828:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.168830:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.168837:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.168850:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.168859:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1200, rc 0) 00000100:00100000:0.0:1746142915.168923:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867509760:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 122us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.168929:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14523 00000100:00100000:0.0:1746142915.168943:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14524 00000100:00100000:0.0:1746142915.168947:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867509888:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.168954:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.168962:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af87 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.168972:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.168973:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.168977:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.168986:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.168993:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0e00, rc 0) 00000100:00100000:0.0:1746142915.169008:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867509888:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 61us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.169012:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14524 00000100:00100000:0.0:1746142915.169022:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14525 00000100:00100000:0.0:1746142915.169026:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867510016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.169032:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.169038:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af8e expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.169046:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.169047:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.169051:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.169058:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.169064:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1e00, rc 0) 00000100:00100000:0.0:1746142915.169076:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867510016:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 50us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.169080:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14525 00000100:00100000:0.0:1746142915.169089:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14526 00000100:00100000:0.0:1746142915.169093:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867510144:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.169098:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.169104:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af95 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.169113:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.169114:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.169118:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.169125:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.169132:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0000, rc 0) 00000100:00100000:0.0:1746142915.169144:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867510144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 51us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.169148:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14526 00000100:00080000:3.0:1746142915.169461:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746142915.169465:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142915.173151:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.173692:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867510400 00000100:00100000:2.0:1746142915.173701:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867510400 00000100:00100000:2.0:1746142915.173740:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14494 00000100:00100000:2.0:1746142915.173748:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:32600:x1830962867510400:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142915.173764:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.173779:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdc29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8af9c expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.173857:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.173870:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.173876:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.173919:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.173929:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 12 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.173943:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867861632:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.174015:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.176652:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.176736:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867510528 00000100:00100000:1.0:1746142915.176743:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867510528 00010000:00010000:1.0:1746142915.176772:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.176810:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6580 00000100:00100000:1.0:1746142915.176818:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867510528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.176829:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.176835:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.176844:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.176861:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142915.176865:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142915.176873:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142915.176878:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142915.176890:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.176948:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867510528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 130us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.176954:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6580 00010000:00010000:2.0:1746142915.176974:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdc06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af79 expref: 12 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.176997:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867861632:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.177012:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.177018:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.177023:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142915.177038:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142915.177130:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471fe00/0x2fa243e067ccdc29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.177142:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.177147:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.177149:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142915.177151:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471e600, rc 0) 00000100:00100000:2.0:1746142915.177184:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:32600:x1830962867510400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3436us (4040us total) trans 8589936680 rc 0/0 00000100:00100000:2.0:1746142915.177190:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14494 00000100:00100000:0.0:1746142915.181618:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.182009:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867510656 00000100:00100000:2.0:1746142915.182018:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867510656 00000100:00100000:2.0:1746142915.182242:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14495 00000100:00100000:2.0:1746142915.182250:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:32600:x1830962867510656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142915.182270:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.182292:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdc3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afa3 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.182360:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.182372:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.182378:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.182404:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.182414:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.182423:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867861760:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.182500:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.187493:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.187633:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867510784 00000100:00100000:1.0:1746142915.187641:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867510784 00010000:00010000:1.0:1746142915.187671:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 14 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.187697:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6581 00000100:00100000:1.0:1746142915.187704:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867510784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.187718:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.187723:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 14 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.187734:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 14 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.187752:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142915.187756:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142915.187764:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142915.187770:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142915.187785:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.187817:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867510784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.187823:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6581 00010000:00010000:3.0:1746142915.187988:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e600/0x2fa243e067ccdc30 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af9c expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.188003:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867861760:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.188018:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.188024:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.188029:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142915.188067:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142915.188071:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142915.188084:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.188110:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471f000/0x2fa243e067ccdc3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.188121:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.188126:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.188128:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142915.188130:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471e800, rc 0) 00000100:00100000:3.0:1746142915.188155:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:32600:x1830962867510656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5905us (6544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.188161:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14495 00000100:00100000:0.0:1746142915.190301:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.190374:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867511040 00000100:00100000:3.0:1746142915.190381:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867511040 00000100:00100000:1.0:1746142915.191857:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14496 00000100:00100000:1.0:1746142915.191870:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32600:x1830962867511040:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142915.191889:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.191921:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3b400/0x2fa243e067ccdc4c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afaa expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.191997:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192013:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192023:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192033:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192038:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192042:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192047:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c3ae00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142915.192051:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192055:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192064:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142915.192066:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142915.192070:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.192074:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3ae00/0x2fa243e067ccdc53 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.193078:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3b400/0x2fa243e067ccdc4c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afaa expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.193091:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c3b400/0x2fa243e067ccdc4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afaa expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.193100:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3b400, rc 0) 00000100:00100000:1.0:1746142915.193154:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32600:x1830962867511040:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1288us (2858us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142915.193160:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14496 00000100:00100000:0.0:1746142915.195849:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.195926:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867511168 00000100:00100000:2.0:1746142915.195935:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867511168 00000100:00100000:2.0:1746142915.195967:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14527 00000100:00100000:2.0:1746142915.195974:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:32596:x1830962867511168:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142915.195992:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.196005:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afb1 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.196028:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.196036:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 11 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.196042:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.196048:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.196049:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.196052:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3375104->4190207] (req 3375104->4190207) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.196075:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.196086:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 31 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.196096:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867861888:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.196170:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 11 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.196182:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 11 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.196190:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862016:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.196213:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.196220:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.196226:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862144:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.196236:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.199126:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.199225:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867511424 00000100:00100000:2.0:1746142915.199231:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867511424 00000100:00100000:2.0:1746142915.199260:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5301 00000100:00100000:2.0:1746142915.199267:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:32600:x1830962867511424:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1746142915.199489:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867861888:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.199498:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862016:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.199505:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862144:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.199527:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [3375104->4190207] (req 3375104->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.199541:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83600, rc 0) 00000100:00100000:2.0:1746142915.200074:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:32600:x1830962867511424:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 805us (952us total) trans 8589936681 rc 0/0 00000100:00100000:2.0:1746142915.200080:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5301 00000100:00100000:3.0:1746142915.200140:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:32596:x1830962867511168:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4167us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.200146:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14527 00000100:00100000:0.0:1746142915.201242:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.201271:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.201859:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.202190:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867511552 00000100:00100000:2.0:1746142915.202197:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867511552 00010000:00010000:2.0:1746142915.202221:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.202243:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867511808 00000100:00100000:2.0:1746142915.202245:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867511808 00010000:00010000:2.0:1746142915.202252:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.202265:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867511680 00000100:00100000:2.0:1746142915.202266:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867511680 00010000:00010000:2.0:1746142915.202273:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 12 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.202293:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6582 00000100:00100000:2.0:1746142915.202298:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867511552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.202308:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.202322:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.202330:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.202346:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07a00/0x2fa243e067ccdbc0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af64 expref: 32 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.202355:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.202379:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867511552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.202384:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6582 00000100:00100000:2.0:1746142915.202412:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6583 00000100:00100000:2.0:1746142915.202416:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867511808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.202421:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.202425:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.202432:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.202442:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06600/0x2fa243e067ccdbb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af5d expref: 19 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.202449:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.202461:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867511808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 44us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.202465:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6583 00000100:00100000:2.0:1746142915.202473:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6584 00000100:00100000:2.0:1746142915.202477:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867511680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.202482:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.202487:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 12 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.202495:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 12 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.202505:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0000/0x2fa243e067ccdc22 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af95 expref: 12 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.202514:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.202516:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.202521:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.202526:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.202548:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.202557:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867862272:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.202596:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.226070:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.226156:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867862272:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.226172:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.226206:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867511680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 23727us (24347us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.226215:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6584 00000100:00100000:3.0:1746142915.227381:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867512064 00000100:00100000:3.0:1746142915.227388:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867512064 00002000:00100000:3.0:1746142915.227421:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3375104->3379199) req@ffff88009ceb1f80 x1830962867512064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.227430:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1f80 with x1830962867512064 ext(3375104->3379199) 00002000:00010000:3.0:1746142915.227434:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1f80 00000100:00100000:3.0:1746142915.227450:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4548 00000100:00100000:3.0:1746142915.227455:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867512064:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142915.227554:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867512064:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 98us (1490us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.227559:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4548 00002000:00100000:3.0:1746142915.227563:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3375104->3379199) req@ffff88009ceb1f80 x1830962867512064/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.227569:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1f80 with x1830962867512064 ext(3375104->3379199) 00002000:00010000:3.0:1746142915.227572:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1f80 00000100:00100000:0.0:1746142915.269755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.270020:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867512320 00000100:00100000:2.0:1746142915.270029:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867512320 00002000:00100000:2.0:1746142915.270068:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (4186112->4190207) req@ffff88009ceb1500 x1830962867512320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.270076:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1500 with x1830962867512320 ext(4186112->4190207) 00002000:00010000:2.0:1746142915.270081:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1500 00000100:00100000:1.0:1746142915.270145:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.270185:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867512576 00000100:00100000:0.0:1746142915.270189:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867512576 00000100:00100000:0.0:1746142915.270367:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14497 00000100:00100000:2.0:1746142915.270368:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4549 00000100:00100000:0.0:1746142915.270374:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+52:32603:x1830962867512576:12345-192.168.204.50@tcp:101:multiop.0 00000100:00100000:2.0:1746142915.270375:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867512320:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:0.0:1746142915.270389:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.270404:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1400/0x2fa243e067ccdc61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afb8 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.270458:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270468:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270477:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142915.270481:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867512320:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 105us (732us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142915.270487:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4549 00010000:00010000:0.0:1746142915.270487:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00002000:00100000:2.0:1746142915.270492:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x7b:0x0] (4186112->4190207) req@ffff88009ceb1500 x1830962867512320/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746142915.270492:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270497:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00002000:00100000:2.0:1746142915.270499:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb1500 with x1830962867512320 ext(4186112->4190207) 00002000:00010000:2.0:1746142915.270502:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ceb1500 00010000:00010000:0.0:1746142915.270568:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270576:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270582:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142915.270588:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142915.270645:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270650:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270655:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270660:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984b0800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142915.270663:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270669:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270677:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142915.270679:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142915.270682:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270687:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0800/0x2fa243e067ccdc68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270712:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270716:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270724:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270728:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984b1600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142915.270730:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270735:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270740:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736a00) 00010000:00010000:0.0:1746142915.270742:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142915.270745:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270749:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067ccdc6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.270777:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1400/0x2fa243e067ccdc61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 55 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.270787:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 54 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.270792:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142915.270794:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142915.270796:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0600, rc 0) 00000100:00100000:0.0:1746142915.270825:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32603:x1830962867512576:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 451us (681us total) trans 8589936682 rc 0/0 00000100:00100000:0.0:1746142915.270831:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14497 00000100:00100000:0.0:1746142915.283559:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.285029:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867512832 00000100:00100000:2.0:1746142915.285039:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867512832 00000100:00100000:2.0:1746142915.285095:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14498 00000100:00100000:2.0:1746142915.285103:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+54:32606:x1830962867512832:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142915.285128:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.285143:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdc84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afbf expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.285228:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.285240:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.285248:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142915.285257:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142915.285347:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067ccdc84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.285382:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 56 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.285389:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.285392:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746142915.285394:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbae00, rc 0) 00000100:00100000:2.0:1746142915.285730:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32606:x1830962867512832:12345-192.168.204.50@tcp:101:cat.0 Request processed in 627us (2178us total) trans 8589936683 rc 0/0 00000100:00100000:2.0:1746142915.285736:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14498 00000100:00100000:0.0:1746142915.290792:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.291017:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867512960 00000100:00100000:3.0:1746142915.291026:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867512960 00000100:00100000:3.0:1746142915.291062:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14528 00000100:00100000:3.0:1746142915.291069:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867512960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142915.291084:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.291097:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1e00/0x2fa243e067ccdc99 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afc6 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.291138:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862400:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142915.291217:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.292829:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.293133:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513216 00000100:00100000:2.0:1746142915.293140:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513216 00000100:00100000:2.0:1746142915.293171:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5302 00000100:00100000:3.0:1746142915.293177:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862400:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142915.293178:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:32596:x1830962867513216:12345-192.168.204.50@tcp:35:multiop.0 00010000:00010000:3.0:1746142915.293198:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1e00/0x2fa243e067ccdc99 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afc6 expref: 32 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.293208:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1e00/0x2fa243e067ccdc99 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afc6 expref: 32 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.293227:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1e00, rc 0) 00000100:00100000:3.0:1746142915.293254:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867512960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2185us (2469us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142915.293259:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14528 00000100:00100000:2.0:1746142915.293310:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+33:32596:x1830962867513216:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 132us (486us total) trans 8589936684 rc 0/0 00000100:00100000:2.0:1746142915.293316:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5302 00000100:00100000:0.0:1746142915.307481:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.307585:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513344 00000100:00100000:3.0:1746142915.307593:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513344 00000100:00100000:3.0:1746142915.307638:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14529 00000100:00100000:3.0:1746142915.307645:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32606:x1830962867513344:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142915.307660:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.307675:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afcd expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.307700:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.307707:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142915.307708:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142915.307711:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 32 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.307734:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.307745:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 17 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.307755:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862528:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.307845:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.311674:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862528:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.311702:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 32 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.311718:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1800, rc 0) 00000100:00100000:3.0:1746142915.312103:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32606:x1830962867513344:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4457us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.312110:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14529 00000100:00100000:0.0:1746142915.313877:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.313980:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513472 00000100:00100000:3.0:1746142915.313987:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513472 00002000:00100000:3.0:1746142915.314019:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3375104->4190207) req@ffff88009ceb0a80 x1830962867513472/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.314027:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0a80 with x1830962867513472 ext(3375104->4190207) 00010000:00010000:3.0:1746142915.314034:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 18 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.314045:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 18 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.314055:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ceb0a80 00000100:00100000:3.0:1746142915.314078:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1416 00000100:00100000:3.0:1746142915.314083:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867513472:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142915.324221:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867513472:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 10130us (10341us total) trans 17179873978 rc 0/0 00000100:00100000:3.0:1746142915.324233:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1416 00002000:00100000:3.0:1746142915.324243:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (3375104->4190207) req@ffff88009ceb0a80 x1830962867513472/t17179873978(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.324252:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ceb0a80 with x1830962867513472 ext(3375104->4190207) 00010000:00010000:3.0:1746142915.324261:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 20 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.324284:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 20 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.324291:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ceb0a80 00000100:00100000:0.0:1746142915.329781:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.329831:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.329931:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513728 00000100:00100000:2.0:1746142915.329939:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513728 00010000:00010000:2.0:1746142915.329972:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 20 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.330008:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6585 00000100:00100000:2.0:1746142915.330015:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867513728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.330029:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.330044:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 20 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.330056:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 20 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.330075:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067ccdc5a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3375104->4190207) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb1 expref: 20 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.330091:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.330093:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.330098:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.330106:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.330133:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.330144:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867862656:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.330208:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3540 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.330374:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513600 00000100:00100000:3.0:1746142915.330378:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513600 00000100:00100000:3.0:1746142915.330399:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14530 00000100:00100000:3.0:1746142915.330403:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32603:x1830962867513600:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142915.330414:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.330423:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afd4 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.330442:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 10 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.330448:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 19 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.330453:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.330457:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.330458:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.330460:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1675264->2097151] (req 1675264->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.330474:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 33 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.330482:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 33 pid: 1397 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.330488:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862784:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.330516:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 19 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.330523:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 19 pid: 1397 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.330530:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862912:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.330550:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 10 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.330557:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 10 pid: 12211 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.330563:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867863040:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.330576:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.335357:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.335377:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.335393:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513984 00000100:00100000:0.0:1746142915.335399:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513984 00010000:00010000:0.0:1746142915.335423:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 20 pid: 1397 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.335441:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6586 00000100:00100000:0.0:1746142915.335446:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867513984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.335455:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.335470:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 20 pid: 1397 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.335479:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 20 pid: 1397 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.335496:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.335524:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867513984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.335528:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6586 00000100:00100000:0.0:1746142915.335539:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867513856 00000100:00100000:0.0:1746142915.335540:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867513856 00010000:00010000:0.0:1746142915.335547:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 34 pid: 1397 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.335557:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6587 00000100:00100000:0.0:1746142915.335560:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867513856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.335564:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.335569:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 34 pid: 1397 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.335575:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 34 pid: 1397 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.335582:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.335591:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867513856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.335595:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6587 00000100:00100000:0.0:1746142915.335619:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.335630:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867514112 00000100:00100000:0.0:1746142915.335632:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867514112 00010000:00010000:0.0:1746142915.335639:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 11 pid: 12211 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.335649:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6588 00000100:00100000:0.0:1746142915.335652:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867514112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.335659:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.335664:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 11 pid: 12211 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746142915.335670:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 11 pid: 12211 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746142915.335680:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.335681:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.335686:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.335692:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.335714:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.335723:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867863168:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142915.335762:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746142915.336074:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067ccd5bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abe4 expref: 33 pid: 1397 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.336096:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862784:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.336105:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25e00/0x2fa243e067ccd5c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8abeb expref: 19 pid: 1397 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.336111:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867862912:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.336117:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb24400/0x2fa243e067ccd4d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ab89 expref: 11 pid: 12211 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.336123:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867863040:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.336141:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 32 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.336153:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1a00, rc 0) 00000100:00100000:3.0:1746142915.336171:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32603:x1830962867513600:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5768us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.336176:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14530 00000100:00100000:2.0:1746142915.336433:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867862656:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.336442:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.336667:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867513728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6652us (6835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.336673:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6585 00000100:00100000:0.0:1746142915.339847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.339927:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867514368 00000100:00100000:3.0:1746142915.339935:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867514368 00002000:00100000:3.0:1746142915.339968:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012dc60380 x1830962867514368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.339978:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60380 with x1830962867514368 ext(2097152->4194303) 00002000:00010000:3.0:1746142915.339983:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc60380 00000100:00100000:3.0:1746142915.340011:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4550 00000100:00100000:3.0:1746142915.340018:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867514368:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142915.350189:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.350763:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867514624 00000100:00100000:3.0:1746142915.350771:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867514624 00002000:00100000:3.0:1746142915.350803:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1675264->1679359) req@ffff88012e678700 x1830962867514624/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.350812:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678700 with x1830962867514624 ext(1675264->1679359) 00002000:00010000:3.0:1746142915.350817:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e678700 00000100:00100000:3.0:1746142915.350831:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4551 00000100:00100000:3.0:1746142915.350836:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867514624:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142915.350950:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867514624:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 113us (766us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.350955:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4551 00002000:00100000:3.0:1746142915.350960:0:20333:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x79:0x0] (1675264->1679359) req@ffff88012e678700 x1830962867514624/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.350966:0:20333:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678700 with x1830962867514624 ext(1675264->1679359) 00002000:00010000:3.0:1746142915.350968:0:20333:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e678700 00000100:00100000:2.0:1746142915.351837:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867863168:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.351853:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.353414:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867514112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 17753us (17786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.353424:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6588 00000100:00100000:1.0:1746142915.355939:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.356084:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867514880 00000100:00100000:2.0:1746142915.356092:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867514880 00000100:00100000:2.0:1746142915.356139:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14499 00000100:00100000:2.0:1746142915.356145:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+33:32610:x1830962867514880:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142915.356160:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.356181:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067ccdcae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afdb expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.356244:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356254:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356266:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356284:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356292:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356296:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356371:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356379:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356387:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142915.356393:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142915.356447:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356453:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356463:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356468:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa50400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142915.356471:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356476:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356485:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142915.356492:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142915.356495:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356500:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50400/0x2fa243e067ccdcb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356524:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356532:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356537:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356545:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009aa51600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142915.356550:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356555:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356561:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbdb00) 00010000:00010000:2.0:1746142915.356563:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142915.356569:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356574:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0x2fa243e067ccdcbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.356610:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa50200/0x2fa243e067ccdcae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.356625:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 35 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.356630:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.356632:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142915.356634:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3c00, rc 0) 00000100:00100000:2.0:1746142915.356674:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+35:32610:x1830962867514880:12345-192.168.204.50@tcp:101:cat.0 Request processed in 526us (738us total) trans 8589936685 rc 0/0 00000100:00100000:2.0:1746142915.357767:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14499 00000100:00100000:3.0:1746142915.363597:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867514368:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 23571us (23747us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142915.363607:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4550 00002000:00100000:3.0:1746142915.363618:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88012dc60380 x1830962867514368/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.363626:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60380 with x1830962867514368 ext(2097152->4194303) 00002000:00010000:3.0:1746142915.363632:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc60380 00000100:00100000:1.0:1746142915.363684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.363943:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.364157:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515008 00000100:00100000:0.0:1746142915.364165:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515008 00000100:00100000:0.0:1746142915.364202:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515136 00000100:00100000:0.0:1746142915.364205:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515136 00000100:00100000:0.0:1746142915.364217:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14531 00000100:00100000:0.0:1746142915.364224:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867515008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142915.364237:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.364249:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b1c00/0x2fa243e067ccdcd1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afe2 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.364300:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867863296:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142915.364354:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.364438:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14532 00000100:00100000:3.0:1746142915.364444:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867515136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142915.364451:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.364457:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8afe9 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.364467:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.364469:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.364475:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.364486:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.364496:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009471f800, rc 0) 00000100:00100000:3.0:1746142915.364512:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867515136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 70us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.364517:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14532 00000100:00100000:0.0:1746142915.364753:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.365021:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515264 00000100:00100000:1.0:1746142915.365025:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515264 00000100:00100000:1.0:1746142915.365051:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14533 00000100:00100000:1.0:1746142915.365056:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32603:x1830962867515264:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142915.365062:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.365070:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aff0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.365084:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 13 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.365092:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 8 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.365098:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.365103:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.365105:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.365108:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 6/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.365124:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.365134:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.365142:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.365380:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 8 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.365387:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 8 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.365395:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863552:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.365519:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 13 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.365527:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 13 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.365540:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863680:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.365690:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00002000:00010000:2.0:1746142915.366162:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142913 -> 1746142915 00002000:00010000:2.0:1746142915.366165:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142913 -> 1746142915 00002000:00010000:2.0:1746142915.366167:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142913 -> 1746142915 00000100:00100000:2.0:1746142915.366180:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867863296:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142915.366201:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1c00/0x2fa243e067ccdcd1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe2 expref: 20 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.366210:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1c00/0x2fa243e067ccdcd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe2 expref: 20 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.366231:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1c00, rc 0) 00000100:00100000:2.0:1746142915.366261:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867515008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2037us (2577us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142915.366266:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14531 00000100:00100000:1.0:1746142915.370428:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863424:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.370440:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863552:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.370447:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863680:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.370471:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->1118207] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 34 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.370487:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3be00, rc 0) 00000100:00100000:1.0:1746142915.370536:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32603:x1830962867515264:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5479us (5782us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.370543:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14533 00000100:00100000:0.0:1746142915.370883:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.370934:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.371077:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515392 00000100:00100000:3.0:1746142915.371083:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515392 00010000:00010000:3.0:1746142915.371112:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 9 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.371133:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515520 00000100:00100000:3.0:1746142915.371135:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515520 00010000:00010000:3.0:1746142915.371145:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 14 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.371159:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6589 00000100:00100000:3.0:1746142915.371165:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867515392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.371176:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.371192:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 9 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.371192:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6590 00000100:00100000:0.0:1746142915.371199:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867515520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.371200:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 9 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746142915.371207:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.371219:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fac00/0x2fa243e067ccd783 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad11 expref: 9 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746142915.371372:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142915.371375:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 14 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.371383:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 14 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.371395:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867515392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 230us (512us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142915.371395:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009710c200/0x2fa243e067ccd695 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac9a expref: 14 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.371405:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6589 00010000:00010000:0.0:1746142915.371418:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.371435:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867515520:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 237us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.371441:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6590 00000100:00100000:0.0:1746142915.372302:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.372396:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515648 00000100:00100000:2.0:1746142915.372401:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515648 00010000:00010000:2.0:1746142915.372418:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.373330:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6591 00000100:00100000:2.0:1746142915.373340:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867515648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.373350:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.373363:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.373373:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.373387:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc29c00/0x2fa243e067ccd70c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8acd2 expref: 34 pid: 9578 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.373641:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.373643:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.373649:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.373657:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.373685:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 33 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.373696:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867863808:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.374648:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3540 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.376600:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867863808:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.376616:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.376645:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867515648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3307us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.376654:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6591 00000100:00100000:2.0:1746142915.378301:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.378345:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.378489:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.378544:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867516032 00000100:00100000:3.0:1746142915.378549:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867516032 00002000:00100000:3.0:1746142915.378578:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1114112->1118207) req@ffff88009cd5d880 x1830962867516032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.378588:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d880 with x1830962867516032 ext(1114112->1118207) 00002000:00010000:3.0:1746142915.378592:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5d880 00000100:00100000:3.0:1746142915.378603:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867516288 00000100:00100000:3.0:1746142915.378605:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867516288 00002000:00100000:3.0:1746142915.378613:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009cd5f480 x1830962867516288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.378619:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f480 with x1830962867516288 ext(1048576->2097151) 00002000:00010000:3.0:1746142915.378621:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5f480 00000100:00100000:3.0:1746142915.378635:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4552 00000100:00100000:3.0:1746142915.378641:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867516032:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142915.378728:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867516032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 87us (431us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.378733:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4552 00002000:00100000:3.0:1746142915.378737:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1114112->1118207) req@ffff88009cd5d880 x1830962867516032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.378744:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d880 with x1830962867516032 ext(1114112->1118207) 00002000:00010000:3.0:1746142915.378746:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5d880 00000100:00100000:3.0:1746142915.378754:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4553 00000100:00100000:3.0:1746142915.378758:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867516288:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142915.382205:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867515776 00000100:00100000:1.0:1746142915.382215:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867515776 00000100:00100000:1.0:1746142915.382354:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14534 00000100:00100000:1.0:1746142915.382362:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867515776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.382377:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.382389:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130600e00/0x2fa243e067ccdce6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8aff7 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.382426:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863936:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142915.382502:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.383653:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.383704:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867516544 00000100:00100000:2.0:1746142915.383710:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867516544 00000100:00100000:2.0:1746142915.383735:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5303 00000100:00100000:2.0:1746142915.383740:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32603:x1830962867516544:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142915.383997:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:32603:x1830962867516544:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 256us (346us total) trans 8589936686 rc 0/0 00000100:00100000:2.0:1746142915.384004:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5303 00002000:00010000:1.0:1746142915.385871:0:9578:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime: 1746142913 -> 1746142916 00002000:00010000:1.0:1746142915.385877:0:9578:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142913 -> 1746142915 00002000:00010000:1.0:1746142915.385879:0:9578:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime: 1746142913 -> 1746142916 00000100:00100000:1.0:1746142915.385894:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867863936:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142915.386425:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130600e00/0x2fa243e067ccdce6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff7 expref: 34 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.386441:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130600e00/0x2fa243e067ccdce6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff7 expref: 34 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.386463:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130600e00, rc 0) 00000100:00100000:1.0:1746142915.386495:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867515776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4134us (8005us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142915.386500:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14534 00000100:00100000:3.0:1746142915.387809:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867516288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9046us (9459us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.387817:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4553 00002000:00100000:3.0:1746142915.387825:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009cd5f480 x1830962867516288/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.387834:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5f480 with x1830962867516288 ext(1048576->2097151) 00002000:00010000:3.0:1746142915.387838:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5f480 00000100:00100000:0.0:1746142915.392474:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.392600:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867516672 00000100:00100000:1.0:1746142915.392608:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867516672 00000100:00100000:1.0:1746142915.392646:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14535 00000100:00100000:1.0:1746142915.392651:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+19:32610:x1830962867516672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.392664:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.392678:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8affe expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.392703:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.392709:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.392710:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.392713:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 20 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.392736:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.392753:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 31 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.392763:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867864064:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.392831:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.394129:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.394212:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867864064:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.394229:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 20 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.394241:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130601200, rc 0) 00000100:00100000:1.0:1746142915.394265:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:32610:x1830962867516672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1613us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.394270:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867516800 00000100:00100000:1.0:1746142915.394271:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14535 00000100:00100000:3.0:1746142915.394285:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867516800 00002000:00100000:3.0:1746142915.394311:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1675264->2097151) req@ffff88012dc61180 x1830962867516800/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.394319:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61180 with x1830962867516800 ext(1675264->2097151) 00010000:00010000:3.0:1746142915.394325:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 32 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.394335:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 32 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.394341:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc61180 00000100:00100000:3.0:1746142915.394356:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1417 00000100:00100000:3.0:1746142915.394361:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2003:x1830962867516800:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142915.398069:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867516800:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3701us (3936us total) trans 17179873979 rc 0/0 00000100:00100000:3.0:1746142915.398078:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1417 00002000:00100000:3.0:1746142915.398087:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1675264->2097151) req@ffff88012dc61180 x1830962867516800/t17179873979(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.398096:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc61180 with x1830962867516800 ext(1675264->2097151) 00010000:00010000:3.0:1746142915.398103:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.398115:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.398121:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc61180 00000100:00100000:0.0:1746142915.400463:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.400545:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867516928 00000100:00100000:2.0:1746142915.400553:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867516928 00010000:00010000:2.0:1746142915.400578:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.400598:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6592 00000100:00100000:2.0:1746142915.400604:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867516928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.400614:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142915.400624:0:7217:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142915 -> 1746142916 00010000:00010000:2.0:1746142915.400629:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.400638:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.400656:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1a00/0x2fa243e067ccdca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1675264->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afd4 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.400687:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.400689:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.400695:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.400701:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.400728:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.400738:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867864192:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.400799:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.405954:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867864192:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.405977:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.406020:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867516928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5414us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.406029:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6592 00000100:00100000:0.0:1746142915.408496:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.408558:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867517184 00000100:00100000:3.0:1746142915.408565:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867517184 00002000:00100000:3.0:1746142915.408603:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc60000 x1830962867517184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.408614:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60000 with x1830962867517184 ext(1048576->2097151) 00002000:00010000:3.0:1746142915.408618:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc60000 00000100:00100000:3.0:1746142915.408645:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4554 00000100:00100000:3.0:1746142915.408652:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867517184:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142915.415136:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.415190:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867517440 00000100:00100000:2.0:1746142915.415197:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867517440 00000100:00100000:2.0:1746142915.415243:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14500 00000100:00100000:2.0:1746142915.415250:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+35:32615:x1830962867517440:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142915.415270:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.415296:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e691800/0x2fa243e067ccdcf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b005 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415384:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.415398:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415404:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 56 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415409:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415415:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.415440:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415449:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 36 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.415459:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867864320:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.415550:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 56 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415558:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 56 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.415569:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867864448:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.415595:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 12 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.415602:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 12 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.415608:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de13800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867864576:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.415623:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.419941:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867517184:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11280us (11443us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.419952:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4554 00002000:00100000:3.0:1746142915.419961:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012dc60000 x1830962867517184/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.419970:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc60000 with x1830962867517184 ext(1048576->2097151) 00002000:00010000:3.0:1746142915.419975:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc60000 00000100:00100000:2.0:1746142915.421455:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867864320:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.421876:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.421924:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867517568 00000100:00100000:2.0:1746142915.421930:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867517568 00000100:00100000:0.0:1746142915.421951:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142915.421957:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 37 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.421977:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.421978:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867517824 00000100:00100000:2.0:1746142915.421980:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867517824 00010000:00010000:2.0:1746142915.421990:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.422003:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867517696 00000100:00100000:2.0:1746142915.422005:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867517696 00010000:00010000:2.0:1746142915.422012:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.422022:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6593 00000100:00100000:2.0:1746142915.422026:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+37:2005:x1830962867517568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.422035:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.422040:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 37 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.422048:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 37 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.422066:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3c00/0x2fa243e067ccdcc3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afdb expref: 37 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.422079:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.422083:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.422090:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.422095:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.422096:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6594 00000100:00100000:3.0:1746142915.422103:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962867517824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.422110:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.422115:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.422122:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+36:2005:x1830962867517568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (247us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142915.422123:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 13 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.422128:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6593 00010000:00010000:3.0:1746142915.422133:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.422135:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142915.422139:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6595 00010000:00010000:3.0:1746142915.422140:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.422144:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.422145:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2003:x1830962867517696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.422151:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.422155:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.422161:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2003:x1830962867517824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 58us (209us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142915.422163:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.422166:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6594 00010000:00010000:2.0:1746142915.422172:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.422175:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.422182:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.422188:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.422192:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0600/0x2fa243e067ccdc76 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afb8 expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.422200:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.422203:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867864448:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.422213:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccdc45 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afa3 expref: 12 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.422214:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2003:x1830962867517696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.422219:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de13800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867864576:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.422220:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6595 00010000:00010000:3.0:1746142915.422235:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.422242:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.422247:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.422261:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142915.422464:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e691800/0x2fa243e067ccdcf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 37 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.422475:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.422480:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.422483:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142915.422485:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e690c00, rc 0) 00000100:00100000:3.0:1746142915.422864:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+36:32615:x1830962867517440:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7614us (7736us total) trans 8589936687 rc 0/0 00000100:00100000:3.0:1746142915.422871:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14500 00000100:00100000:0.0:1746142915.426043:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.426605:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867517952 00000100:00100000:1.0:1746142915.426613:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867517952 00000100:00100000:1.0:1746142915.426711:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14536 00000100:00100000:1.0:1746142915.426719:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:32610:x1830962867517952:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.426734:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.426747:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b00c expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.426775:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.426782:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.426783:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.426786:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.426811:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 32 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.426820:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 32 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.426830:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867864704:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.426957:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.428708:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.428780:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867864704:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.428798:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 14 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.428809:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc79c00, rc 0) 00000100:00100000:1.0:1746142915.428833:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:32610:x1830962867517952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2116us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.428839:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14536 00000100:00100000:3.0:1746142915.428920:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518080 00000100:00100000:3.0:1746142915.428926:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518080 00002000:00100000:3.0:1746142915.428955:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1118207) req@ffff88012dc63100 x1830962867518080/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.428968:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63100 with x1830962867518080 ext(1048576->1118207) 00010000:00010000:3.0:1746142915.428975:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 33 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.428989:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 33 pid: 9578 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.428995:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc63100 00000100:00100000:3.0:1746142915.429114:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1418 00000100:00100000:3.0:1746142915.429122:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867518080:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142915.433874:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867518080:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4745us (5163us total) trans 21474841238 rc 0/0 00000100:00100000:3.0:1746142915.433885:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1418 00002000:00100000:3.0:1746142915.433895:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1118207) req@ffff88012dc63100 x1830962867518080/t21474841238(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.433944:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63100 with x1830962867518080 ext(1048576->1118207) 00010000:00010000:3.0:1746142915.433953:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 35 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.433967:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 35 pid: 9578 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.433973:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc63100 00000100:00100000:0.0:1746142915.436296:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.436523:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518208 00000100:00100000:2.0:1746142915.436531:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518208 00010000:00010000:2.0:1746142915.436560:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 35 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.436645:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6596 00000100:00100000:2.0:1746142915.436653:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867518208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.436666:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.436683:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 35 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.436699:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 35 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.436722:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067ccdcdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1118207) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aff0 expref: 35 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.436748:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.436750:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.436755:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 13 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.436763:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 13 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.436790:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 13 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.436799:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867864832:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.436869:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.438136:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.438188:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518336 00000100:00100000:1.0:1746142915.438194:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518336 00000100:00100000:1.0:1746142915.438230:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14537 00000100:00100000:1.0:1746142915.438244:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:32615:x1830962867518336:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142915.438257:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.438270:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b013 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.438301:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.438308:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.438314:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.438319:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.438320:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.438323:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1064960->1372159] (req 1064960->1372159) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 21 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.438342:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 21 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.438351:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 21 pid: 1397 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.438359:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867864960:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.438427:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 9 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.438435:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 9 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.438441:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867865088:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.438464:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 32 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.438471:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 32 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.438477:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867865216:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.438492:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48fdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.442647:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.442704:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518592 00000100:00100000:3.0:1746142915.442712:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518592 00000100:00100000:0.0:1746142915.442712:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1746142915.442753:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009862c000 x1830962867518592/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.442762:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862c000 with x1830962867518592 ext(1048576->2097151) 00002000:00010000:3.0:1746142915.442767:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009862c000 00000100:00100000:3.0:1746142915.442785:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4555 00000100:00100000:3.0:1746142915.442791:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867518592:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142915.442998:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867864832:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.443014:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.443056:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867518208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6404us (6765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.443064:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6596 00000100:00100000:2.0:1746142915.443097:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518848 00000100:00100000:2.0:1746142915.443099:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518848 00010000:00010000:2.0:1746142915.443111:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 22 pid: 1397 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.443132:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6597 00000100:00100000:2.0:1746142915.443137:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867518848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.443145:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.443158:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 22 pid: 1397 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.443167:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 22 pid: 1397 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.443185:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.443197:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867518848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 60us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.443202:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6597 00000100:00100000:0.0:1746142915.443319:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.443352:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142915.443378:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096131400/0x2fa243e067ccdbea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af72 expref: 21 pid: 1397 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.443395:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867864960:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.443403:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867865088:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.443410:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867865216:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.443428:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1064960->1372159] (req 1064960->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 20 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.443441:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea4dc00, rc 0) 00000100:00100000:1.0:1746142915.443458:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:32615:x1830962867518336:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5215us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.443463:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14537 00000100:00100000:1.0:1746142915.443483:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518976 00000100:00100000:1.0:1746142915.443486:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518976 00010000:00010000:1.0:1746142915.443495:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.443508:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867518720 00000100:00100000:1.0:1746142915.443510:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867518720 00010000:00010000:1.0:1746142915.443516:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 10 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.443518:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6598 00000100:00100000:0.0:1746142915.443525:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867518976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.443531:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142915.443534:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6599 00000100:00100000:1.0:1746142915.443539:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867518720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.443539:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.443545:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.443547:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.443732:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 10 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746142915.443736:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d77400/0x2fa243e067ccdb88 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af48 expref: 33 pid: 9580 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.443741:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 10 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.443754:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0e00/0x2fa243e067ccdc14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af87 expref: 10 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746142915.443754:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.443756:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.443761:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.443769:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.443776:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142915.443790:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.443800:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867865344:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142915.443998:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867518720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 457us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.444003:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6599 00000100:00100000:0.0:1746142915.444015:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.449324:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.449393:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867519232 00000100:00100000:1.0:1746142915.449400:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867519232 00002000:00100000:1.0:1746142915.449433:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1064960->1069055) req@ffff88009862d500 x1830962867519232/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.449441:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862d500 with x1830962867519232 ext(1064960->1069055) 00002000:00010000:1.0:1746142915.449446:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862d500 00000100:00100000:2.0:1746142915.449512:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867865344:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.449528:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.449566:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867518976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6042us (6247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.449573:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6598 00000100:00100000:1.0:1746142915.449775:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4556 00000100:00100000:1.0:1746142915.449783:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867519232:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142915.449873:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867519232:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 90us (556us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142915.449878:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4556 00002000:00100000:1.0:1746142915.449883:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1064960->1069055) req@ffff88009862d500 x1830962867519232/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.449890:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862d500 with x1830962867519232 ext(1064960->1069055) 00002000:00010000:1.0:1746142915.449893:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862d500 00000100:00100000:3.0:1746142915.450342:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867518592:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 7551us (7701us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.450348:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4555 00002000:00100000:3.0:1746142915.450353:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009862c000 x1830962867518592/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.450359:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862c000 with x1830962867518592 ext(1048576->2097151) 00002000:00010000:3.0:1746142915.450362:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009862c000 00000100:00100000:0.0:1746142915.461045:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.461106:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867519488 00000100:00100000:3.0:1746142915.461114:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867519488 00002000:00100000:3.0:1746142915.461152:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1368064->1372159) req@ffff88009862df80 x1830962867519488/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.461161:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862df80 with x1830962867519488 ext(1368064->1372159) 00002000:00010000:3.0:1746142915.461165:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862df80 00000100:00100000:3.0:1746142915.461194:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4557 00000100:00100000:3.0:1746142915.461201:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867519488:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142915.461323:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867519488:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 122us (285us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.461329:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4557 00002000:00100000:3.0:1746142915.461334:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1368064->1372159) req@ffff88009862df80 x1830962867519488/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.461345:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862df80 with x1830962867519488 ext(1368064->1372159) 00002000:00010000:3.0:1746142915.461347:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862df80 00000100:00100000:0.0:1746142915.464993:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.465429:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867519744 00000100:00100000:3.0:1746142915.465437:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867519744 00002000:00100000:3.0:1746142915.465471:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009862e680 x1830962867519744/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.465480:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862e680 with x1830962867519744 ext(2097152->4194303) 00002000:00010000:3.0:1746142915.465485:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862e680 00000100:00100000:3.0:1746142915.465514:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4558 00000100:00100000:3.0:1746142915.465521:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867519744:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142915.478756:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867519744:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13226us (13760us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142915.478767:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4558 00002000:00100000:3.0:1746142915.478777:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009862e680 x1830962867519744/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.478786:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862e680 with x1830962867519744 ext(2097152->4194303) 00002000:00010000:3.0:1746142915.478791:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009862e680 00000100:00100000:2.0:1746142915.487283:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.487352:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520000 00000100:00100000:0.0:1746142915.487360:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520000 00000100:00100000:0.0:1746142915.487405:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5304 00000100:00100000:0.0:1746142915.487412:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+36:32610:x1830962867520000:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:0.0:1746142915.487815:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+37:32610:x1830962867520000:12345-192.168.204.50@tcp:35:cat.0 Request processed in 403us (547us total) trans 8589936688 rc 0/0 00000100:00100000:0.0:1746142915.487821:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5304 00000100:00100000:0.0:1746142915.508067:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.508124:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520256 00000100:00100000:3.0:1746142915.508133:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520256 00000100:00100000:3.0:1746142915.508173:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14501 00000100:00100000:3.0:1746142915.508180:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:32619:x1830962867520256:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142915.508200:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.508215:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccdd17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b01a expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.508301:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.508312:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.508321:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.508328:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142915.508395:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a1e00/0x2fa243e067ccdd17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 59 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.509094:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 58 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.509102:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.509105:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142915.509107:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a0800, rc 0) 00000100:00100000:3.0:1746142915.509154:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:32619:x1830962867520256:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 975us (1095us total) trans 8589936689 rc 0/0 00000100:00100000:3.0:1746142915.509161:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14501 00000100:00100000:0.0:1746142915.526550:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.526607:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520384 00000100:00100000:1.0:1746142915.526616:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520384 00000100:00100000:2.0:1746142915.527820:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14538 00000100:00100000:2.0:1746142915.527832:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867520384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142915.527846:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.527862:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e670000/0x2fa243e067ccdd2c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b021 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.528020:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.528078:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520512 00000100:00100000:1.0:1746142915.528082:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520512 00000100:00100000:1.0:1746142915.528099:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14539 00000100:00100000:1.0:1746142915.528105:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867520512:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142915.528111:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.528118:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b028 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.528129:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.528131:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.528137:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.528149:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.528157:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a969a00, rc 0) 00000100:00100000:1.0:1746142915.528194:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867520512:12345-192.168.204.50@tcp:101:cat.0 Request processed in 89us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.528200:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14539 00000100:00100000:2.0:1746142915.528323:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867865472:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142915.528376:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.533388:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1746142915.534182:0:9580:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.534188:0:9580:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.534189:0:9580:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142915 -> 1746142916 00000100:00100000:2.0:1746142915.534209:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867865472:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142915.534241:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e670000/0x2fa243e067ccdd2c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b021 expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.534255:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e670000/0x2fa243e067ccdd2c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b021 expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.534282:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670000, rc 0) 00000100:00100000:2.0:1746142915.534331:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867520384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6500us (7784us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142915.534338:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14538 00000100:00100000:2.0:1746142915.534365:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520640 00000100:00100000:2.0:1746142915.534371:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520640 00000100:00100000:2.0:1746142915.534407:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14540 00000100:00100000:2.0:1746142915.534415:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867520640:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142915.534429:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.534442:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b02f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.534462:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.534465:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.534473:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 35 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.534487:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 35 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.534496:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671400, rc 0) 00000100:00100000:2.0:1746142915.534519:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867520640:12345-192.168.204.50@tcp:101:cat.0 Request processed in 104us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.534524:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14540 00000100:00100000:0.0:1746142915.544808:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.544963:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520768 00000100:00100000:3.0:1746142915.544971:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520768 00000100:00100000:3.0:1746142915.545021:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14541 00000100:00100000:3.0:1746142915.545029:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32622:x1830962867520768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142915.545044:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.545058:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b036 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.545082:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.545088:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142915.545089:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142915.545093:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 34 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.545117:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.545127:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 19 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.545137:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867865600:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.545209:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b069600 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.549504:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867865600:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.549529:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 34 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.549546:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a1600, rc 0) 00000100:00100000:3.0:1746142915.549581:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32622:x1830962867520768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4553us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.549589:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14541 00000100:00100000:0.0:1746142915.572396:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.572454:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867520896 00000100:00100000:3.0:1746142915.572462:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867520896 00002000:00100000:3.0:1746142915.572494:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1064960->1372159) req@ffff880130374380 x1830962867520896/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.572503:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374380 with x1830962867520896 ext(1064960->1372159) 00010000:00010000:3.0:1746142915.572511:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 20 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.572521:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 20 pid: 9578 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.572527:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130374380 00000100:00100000:3.0:1746142915.572542:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1419 00000100:00100000:3.0:1746142915.572547:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867520896:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142915.591578:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867520896:12345-192.168.204.50@tcp:4:cat.0 Request processed in 19021us (19179us total) trans 17179873980 rc 0/0 00000100:00100000:0.0:1746142915.591589:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1419 00002000:00100000:0.0:1746142915.591599:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1064960->1372159) req@ffff880130374380 x1830962867520896/t17179873980(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142915.591608:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374380 with x1830962867520896 ext(1064960->1372159) 00010000:00010000:0.0:1746142915.591617:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.591630:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00002000:00010000:0.0:1746142915.591636:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130374380 00000100:00100000:0.0:1746142915.599240:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.599345:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867521024 00000100:00100000:2.0:1746142915.599355:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867521024 00010000:00010000:2.0:1746142915.599396:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.599450:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6600 00000100:00100000:2.0:1746142915.599459:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867521024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.599473:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.599492:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.599504:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.599524:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea4dc00/0x2fa243e067ccdd10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1372159) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b013 expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.599549:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.599551:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.599558:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.599566:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.599599:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.599612:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867865728:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.599714:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.604172:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867865728:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.604195:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.604265:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867521024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4804us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.604288:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6600 00000100:00100000:2.0:1746142915.610613:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.610634:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.610656:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.610682:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867521408 00000100:00100000:2.0:1746142915.610688:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867521408 00002000:00100000:2.0:1746142915.610727:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012de10a80 x1830962867521408/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.610741:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de10a80 with x1830962867521408 ext(1048576->2097151) 00002000:00010000:2.0:1746142915.610746:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de10a80 00000100:00100000:2.0:1746142915.614178:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867521536 00000100:00100000:2.0:1746142915.614193:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867521536 00002000:00100000:2.0:1746142915.614237:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012de13800 x1830962867521536/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.614247:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de13800 with x1830962867521536 ext(1048576->2097151) 00002000:00010000:2.0:1746142915.614253:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de13800 00000100:00100000:1.0:1746142915.614402:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867521792 00000100:00100000:1.0:1746142915.614408:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867521792 00002000:00100000:1.0:1746142915.614430:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dc62a00 x1830962867521792/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.614437:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc62a00 with x1830962867521792 ext(1048576->2097151) 00002000:00010000:1.0:1746142915.614441:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc62a00 00000100:00100000:1.0:1746142915.614465:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4559 00000100:00100000:1.0:1746142915.614475:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867521408:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142915.616048:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4560 00000100:00100000:1.0:1746142915.616057:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867521536:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142915.624637:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4561 00000100:00100000:2.0:1746142915.624651:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867521792:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142915.630973:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.631133:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867521408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16658us (20525us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142915.631143:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4559 00002000:00100000:0.0:1746142915.631152:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012de10a80 x1830962867521408/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142915.631161:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de10a80 with x1830962867521408 ext(1048576->2097151) 00002000:00010000:0.0:1746142915.631166:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de10a80 00000100:00100000:3.0:1746142915.631244:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867522048 00000100:00100000:3.0:1746142915.631250:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867522048 00000100:00100000:3.0:1746142915.631292:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14502 00000100:00100000:3.0:1746142915.631298:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+37:32628:x1830962867522048:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142915.631316:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.631330:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdd48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b03d expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.631387:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631398:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631406:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631418:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631423:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631428:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631499:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdd5d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631507:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdd5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631512:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdd5d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.631518:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142915.631565:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631570:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631574:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631578:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142915.631582:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631586:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631594:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142915.631597:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142915.631600:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631604:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631614:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631617:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631621:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631624:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd82a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142915.631626:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631630:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631634:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4200) 00010000:00010000:3.0:1746142915.631635:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142915.631636:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631640:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.631663:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdd48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b03d expref: 40 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.631671:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdd5d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b03d expref: 39 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.631676:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.631678:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142915.631680:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83600, rc 0) 00000100:00100000:3.0:1746142915.631699:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+39:32628:x1830962867522048:12345-192.168.204.50@tcp:101:cat.0 Request processed in 401us (735us total) trans 8589936690 rc 0/0 00000100:00100000:3.0:1746142915.631704:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14502 00000100:00100000:2.0:1746142915.642362:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867521792:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17708us (31696us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142915.642371:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4561 00002000:00100000:2.0:1746142915.642381:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012dc62a00 x1830962867521792/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.642390:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc62a00 with x1830962867521792 ext(1048576->2097151) 00002000:00010000:2.0:1746142915.642395:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc62a00 00000100:00100000:1.0:1746142915.642569:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867521536:12345-192.168.204.50@tcp:3:cat.0 Request processed in 26513us (31933us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142915.642575:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4560 00002000:00100000:1.0:1746142915.642579:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012de13800 x1830962867521536/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.642585:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de13800 with x1830962867521536 ext(1048576->2097151) 00002000:00010000:1.0:1746142915.642588:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de13800 00000100:00100000:0.0:1746142915.645848:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.645918:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867522304 00000100:00100000:3.0:1746142915.645925:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867522304 00000100:00100000:3.0:1746142915.645972:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14542 00000100:00100000:3.0:1746142915.645980:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867522304:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142915.645995:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.646010:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b044 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.646029:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.646030:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.646038:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 22 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.646051:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 22 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.646060:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82a00, rc 0) 00000100:00100000:3.0:1746142915.646094:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867522304:12345-192.168.204.50@tcp:101:cat.0 Request processed in 116us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.646099:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14542 00000100:00100000:0.0:1746142915.652089:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.652138:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.652217:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867522560 00000100:00100000:1.0:1746142915.652224:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867522560 00002000:00100000:1.0:1746142915.652261:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130375180 x1830962867522560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.652277:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375180 with x1830962867522560 ext(1048576->2097151) 00002000:00010000:1.0:1746142915.652282:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130375180 00000100:00100000:1.0:1746142915.652312:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4562 00000100:00100000:1.0:1746142915.652319:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867522560:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142915.655201:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867522176 00000100:00100000:2.0:1746142915.655210:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867522176 00000100:00100000:2.0:1746142915.655266:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 781 00000100:00100000:2.0:1746142915.655281:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+39:2005:x1830962867522176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.655291:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.655312:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdd5d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b03d expref: 39 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.655328:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.655331:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.655365:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+38:2005:x1830962867522176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.655371:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 781 00000100:00100000:0.0:1746142915.656725:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.656778:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867522816 00000100:00100000:3.0:1746142915.656784:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867522816 00000100:00100000:3.0:1746142915.656807:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14503 00000100:00100000:3.0:1746142915.656811:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+38:32624:x1830962867522816:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142915.656828:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.656840:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b04b expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.656918:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.656930:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.656940:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.656957:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.656963:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.656968:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657055:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccdd87 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657065:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccdd87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657071:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccdd87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142915.657080:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142915.657150:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657156:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657161:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657166:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657170:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd83e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142915.657174:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657179:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657188:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142915.657190:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142915.657194:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657198:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdd79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657232:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657242:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657246:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657249:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800920cfe00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142915.657252:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657256:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657262:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4900) 00010000:00010000:3.0:1746142915.657264:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142915.657267:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657281:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920cfe00/0x2fa243e067ccdd80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142915.657317:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd82e00/0x2fa243e067ccdd72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b04b expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.657329:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccdd87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b04b expref: 40 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.657334:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.657336:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746142915.657338:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920ce400, rc 0) 00000100:00100000:3.0:1746142915.657399:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+40:32624:x1830962867522816:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 584us (674us total) trans 8589936691 rc 0/0 00000100:00100000:3.0:1746142915.657405:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14503 00000100:00100000:0.0:1746142915.663637:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.663930:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.663954:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867523200 00000100:00100000:0.0:1746142915.663960:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867523200 00000100:00100000:0.0:1746142915.664006:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5305 00000100:00100000:0.0:1746142915.664013:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+40:32624:x1830962867523200:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142915.664159:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+41:32624:x1830962867523200:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 145us (228us total) trans 8589936692 rc 0/0 00000100:00100000:0.0:1746142915.664165:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5305 00000100:00100000:2.0:1746142915.664289:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867522944 00000100:00100000:2.0:1746142915.664293:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867522944 00000100:00100000:2.0:1746142915.664321:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 782 00000100:00100000:2.0:1746142915.664326:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+41:2004:x1830962867522944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.664336:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.664356:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920ce400/0x2fa243e067ccdd87 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b04b expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.664368:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.664373:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.664391:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+40:2004:x1830962867522944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.664396:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 782 00000100:00100000:1.0:1746142915.664532:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867522560:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12213us (12393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142915.664539:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4562 00002000:00100000:1.0:1746142915.664546:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130375180 x1830962867522560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/440 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142915.664553:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375180 with x1830962867522560 ext(1048576->2097151) 00002000:00010000:1.0:1746142915.664556:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130375180 00000100:00100000:0.0:1746142915.681121:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.681209:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867523328 00000100:00100000:2.0:1746142915.681217:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867523328 00000100:00100000:2.0:1746142915.681263:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14543 00000100:00100000:2.0:1746142915.681295:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:32624:x1830962867523328:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142915.681310:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.681325:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b052 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.681351:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.681359:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.681364:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.681365:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.681368:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1515520->1753087] (req 1515520->1753087) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.681392:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.681401:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 34 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.681411:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867865856:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.681501:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.681508:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.681515:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867865984:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.681534:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.682608:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867865856:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.684062:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.684129:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867523456 00000100:00100000:2.0:1746142915.684135:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867523456 00010000:00010000:2.0:1746142915.684159:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.684190:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6601 00000100:00100000:2.0:1746142915.684197:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867523456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.684205:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.684222:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.684231:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.684246:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e671400/0x2fa243e067ccdd3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b02f expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.685003:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.686301:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867523456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2098us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.686312:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6601 00000100:00100000:0.0:1746142915.687655:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.689086:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867523712 00000100:00100000:3.0:1746142915.689096:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867523712 00000100:00100000:3.0:1746142915.689144:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5306 00000100:00100000:3.0:1746142915.689151:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+40:32628:x1830962867523712:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142915.689327:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+41:32628:x1830962867523712:12345-192.168.204.50@tcp:35:cat.0 Request processed in 176us (1675us total) trans 8589936693 rc 0/0 00000100:00100000:3.0:1746142915.689334:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5306 00000100:00100000:2.0:1746142915.695947:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867865984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.695975:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1515520->1753087] (req 1515520->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.695995:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714600, rc 0) 00000100:00100000:2.0:1746142915.696047:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:32624:x1830962867523328:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 14775us (14931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.696054:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14543 00000100:00100000:0.0:1746142915.706704:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.706787:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867523840 00000100:00100000:2.0:1746142915.706795:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867523840 00010000:00010000:2.0:1746142915.706825:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.706848:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6602 00000100:00100000:2.0:1746142915.706856:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867523840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.706868:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.706884:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.706894:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.706934:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc79c00/0x2fa243e067ccdd09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b00c expref: 15 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.706963:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.706964:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.706970:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 14 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.706982:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 14 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.707009:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 14 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.707020:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867866112:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.707081:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.710111:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.710151:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867524096 00000100:00100000:0.0:1746142915.710157:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867524096 00002000:00100000:0.0:1746142915.710190:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1515520->1519615) req@ffff880130375f80 x1830962867524096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142915.710200:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375f80 with x1830962867524096 ext(1515520->1519615) 00002000:00010000:0.0:1746142915.710204:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130375f80 00000100:00100000:0.0:1746142915.710234:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4563 00000100:00100000:0.0:1746142915.710241:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867524096:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142915.710358:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867524096:12345-192.168.204.50@tcp:3:cat.0 Request processed in 117us (252us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142915.710367:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4563 00002000:00100000:0.0:1746142915.710373:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1515520->1519615) req@ffff880130375f80 x1830962867524096/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142915.710379:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375f80 with x1830962867524096 ext(1515520->1519615) 00002000:00010000:0.0:1746142915.710382:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130375f80 00000100:00100000:2.0:1746142915.710586:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867866112:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.710600:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.710620:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867523840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3765us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.710626:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6602 00000100:00100000:0.0:1746142915.713302:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.713404:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867524352 00000100:00100000:3.0:1746142915.713411:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867524352 00002000:00100000:3.0:1746142915.713443:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1748992->1753087) req@ffff880130375500 x1830962867524352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.713451:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375500 with x1830962867524352 ext(1748992->1753087) 00002000:00010000:3.0:1746142915.713456:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130375500 00000100:00100000:3.0:1746142915.713482:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4564 00000100:00100000:3.0:1746142915.713488:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867524352:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142915.713587:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867524352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 99us (291us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.713591:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4564 00002000:00100000:3.0:1746142915.713596:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1748992->1753087) req@ffff880130375500 x1830962867524352/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.713601:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375500 with x1830962867524352 ext(1748992->1753087) 00002000:00010000:3.0:1746142915.713604:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130375500 00000100:00100000:0.0:1746142915.714294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.714358:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867524480 00000100:00100000:2.0:1746142915.714362:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867524480 00000100:00100000:2.0:1746142915.714390:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14544 00000100:00100000:2.0:1746142915.714395:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32619:x1830962867524480:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142915.714404:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.714417:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b059 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.714435:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 21 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.714442:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.714448:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.714449:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.714452:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.714473:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.714482:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.714490:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867866240:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.714537:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 21 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.714544:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 21 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.714550:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867866368:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.714562:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.719600:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867866240:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.719609:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867866368:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.719630:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.719648:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715200, rc 0) 00000100:00100000:2.0:1746142915.719681:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32619:x1830962867524480:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5286us (5389us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.719689:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14544 00000100:00100000:0.0:1746142915.723314:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.724361:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867524608 00000100:00100000:2.0:1746142915.724370:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867524608 00010000:00010000:2.0:1746142915.724402:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.725003:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6603 00000100:00100000:2.0:1746142915.725011:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867524608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.725022:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.725039:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.725049:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.725066:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a969a00/0x2fa243e067ccdd33 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b028 expref: 35 pid: 9578 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.725092:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.725375:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867524608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 118us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.725384:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6603 00000100:00100000:0.0:1746142915.726958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.727046:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867524736 00000100:00100000:2.0:1746142915.727052:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867524736 00010000:00010000:2.0:1746142915.727070:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.727088:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6604 00000100:00100000:2.0:1746142915.727093:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867524736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.727100:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.727111:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.727121:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.727133:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130601200/0x2fa243e067ccdced lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8affe expref: 22 pid: 9578 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.727142:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.727144:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.727149:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.727155:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.727178:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.727191:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867866496:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.728278:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.729490:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867866496:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.729505:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.729538:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867524736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2444us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.729546:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6604 00000100:00100000:0.0:1746142915.729819:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.730167:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867524992 00000100:00100000:2.0:1746142915.730173:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867524992 00002000:00100000:2.0:1746142915.730202:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1982464->1986559) req@ffff880130377480 x1830962867524992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.730211:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377480 with x1830962867524992 ext(1982464->1986559) 00002000:00010000:2.0:1746142915.730215:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130377480 00000100:00100000:3.0:1746142915.730239:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4565 00000100:00100000:3.0:1746142915.730247:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867524992:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142915.730364:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867524992:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 118us (545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.730369:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4565 00002000:00100000:3.0:1746142915.730375:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1982464->1986559) req@ffff880130377480 x1830962867524992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.730381:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377480 with x1830962867524992 ext(1982464->1986559) 00002000:00010000:3.0:1746142915.730384:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130377480 00000100:00100000:0.0:1746142915.734974:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.735056:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867525120 00000100:00100000:2.0:1746142915.735063:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867525120 00000100:00100000:2.0:1746142915.735314:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14545 00000100:00100000:2.0:1746142915.735322:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32619:x1830962867525120:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142915.735337:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.735349:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b060 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.735372:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 13 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.735383:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142915.735385:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142915.735388:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1724415] (req 1048576->1724415) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.735408:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 13 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.735417:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 13 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.735426:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867866624:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.735496:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.736953:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867866624:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.736971:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1724415] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.736983:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714c00, rc 0) 00000100:00100000:2.0:1746142915.737011:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32619:x1830962867525120:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1690us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.737017:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14545 00000100:00100000:0.0:1746142915.738739:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.738836:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867525248 00000100:00100000:3.0:1746142915.738843:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867525248 00002000:00100000:3.0:1746142915.738878:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1515520->1753087) req@ffff880130376300 x1830962867525248/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.738887:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376300 with x1830962867525248 ext(1515520->1753087) 00010000:00010000:3.0:1746142915.738894:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 14 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.738937:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 14 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.738943:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130376300 00000100:00100000:3.0:1746142915.738965:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1420 00000100:00100000:3.0:1746142915.738972:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867525248:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1746142915.744454:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867525248:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5474us (5712us total) trans 21474841239 rc 0/0 00000100:00100000:3.0:1746142915.744466:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1420 00002000:00100000:3.0:1746142915.744476:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1515520->1753087) req@ffff880130376300 x1830962867525248/t21474841239(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.744484:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376300 with x1830962867525248 ext(1515520->1753087) 00010000:00010000:3.0:1746142915.744492:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 16 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.744504:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 16 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:3.0:1746142915.744510:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130376300 00000100:00100000:0.0:1746142915.752631:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.752788:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867525376 00000100:00100000:2.0:1746142915.752797:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867525376 00010000:00010000:2.0:1746142915.752828:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 16 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.752870:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6605 00000100:00100000:2.0:1746142915.752879:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2004:x1830962867525376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.752891:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.753197:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 16 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.753208:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 16 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.753227:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714600/0x2fa243e067ccdd95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1753087) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b052 expref: 16 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.753256:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.753258:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.753263:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.753279:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.753306:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.753317:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867866752:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142915.753394:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.757120:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867866752:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142915.757138:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.757174:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867525376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4296us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.757183:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6605 00000100:00100000:0.0:1746142915.761024:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.761105:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867525632 00000100:00100000:3.0:1746142915.761113:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867525632 00002000:00100000:3.0:1746142915.761149:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1720320->1724415) req@ffff880130374e00 x1830962867525632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.761158:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374e00 with x1830962867525632 ext(1720320->1724415) 00002000:00010000:3.0:1746142915.761162:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130374e00 00000100:00100000:3.0:1746142915.761191:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4566 00000100:00100000:3.0:1746142915.761198:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867525632:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142915.761313:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867525632:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 116us (298us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142915.761319:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4566 00002000:00100000:3.0:1746142915.761324:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1720320->1724415) req@ffff880130374e00 x1830962867525632/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/4536 e 0 to 0 dl 1746142926 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142915.761337:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374e00 with x1830962867525632 ext(1720320->1724415) 00002000:00010000:3.0:1746142915.761340:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130374e00 00000100:00100000:0.0:1746142915.781558:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.782118:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867525760 00000100:00100000:2.0:1746142915.782128:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867525760 00000100:00100000:2.0:1746142915.782176:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14504 00000100:00100000:2.0:1746142915.782185:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32634:x1830962867525760:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142915.782203:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.782217:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715e00/0x2fa243e067ccddaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b067 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.782280:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782292:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782302:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782312:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782317:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782322:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782371:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782380:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 40 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.782387:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.782393:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 5/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.782416:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.782426:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.782436:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867866880:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142915.783147:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 40 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.783155:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 40 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.783163:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867867008:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142915.783215:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142915.783880:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867866880:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.784837:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.786419:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526016 00000100:00100000:2.0:1746142915.786427:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526016 00000100:00100000:2.0:1746142915.786860:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5307 00000100:00100000:2.0:1746142915.786868:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:16318:x1830962867526016:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746142915.786893:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867867008:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.786926:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142915.787791:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:16318:x1830962867526016:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 923us (2955us total) trans 8589936694 rc 0/0 00000100:00100000:2.0:1746142915.787799:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5307 00000100:00100000:1.0:1746142915.788260:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.788345:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526272 00000100:00100000:2.0:1746142915.788353:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526272 00000100:00100000:2.0:1746142915.788382:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5308 00000100:00100000:2.0:1746142915.788388:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+41:30464:x1830962867526272:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746142915.788462:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+42:30464:x1830962867526272:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 74us (203us total) trans 8589936695 rc 0/0 00000100:00100000:2.0:1746142915.788468:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5308 00000100:00100000:0.0:1746142915.789615:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.789713:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526400 00000100:00100000:2.0:1746142915.789717:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526400 00010000:00010000:2.0:1746142915.789735:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 59 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.789871:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6606 00000100:00100000:2.0:1746142915.789878:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:2005:x1830962867526400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.789888:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.789916:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 59 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.789926:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 59 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.789949:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b2a0800/0x2fa243e067ccdd1e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b01a expref: 59 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.789961:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.789964:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.789971:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.789976:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.789980:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.790009:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2005:x1830962867526400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.790015:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6606 00000100:00100000:0.0:1746142915.790890:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.790965:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526528 00000100:00100000:2.0:1746142915.790971:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526528 00010000:00010000:2.0:1746142915.790984:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 42 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.790997:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6607 00000100:00100000:2.0:1746142915.791003:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+42:2005:x1830962867526528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.791011:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.791014:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 42 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.791022:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 42 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.791037:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e690c00/0x2fa243e067ccdcfb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b005 expref: 42 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.791044:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.791047:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.791053:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.791058:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.791081:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.791112:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+41:2005:x1830962867526528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.791117:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6607 00010000:00010000:3.0:1746142915.791150:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791157:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.791192:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142915.791195:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142915.791207:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791214:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791222:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791226:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791231:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791235:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142915.791238:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791244:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791250:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142915.791252:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142915.791255:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791258:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714800/0x2fa243e067ccddb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791279:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791283:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791287:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791290:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142915.791292:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791295:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791299:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880129fbd400) 00010000:00010000:3.0:1746142915.791301:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142915.791303:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791307:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccddb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.791329:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715e00/0x2fa243e067ccddaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.791337:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.791342:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.791343:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142915.791345:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715c00, rc 0) 00000100:00100000:3.0:1746142915.791436:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:32634:x1830962867525760:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 9252us (9884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.791441:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14504 00000100:00100000:0.0:1746142915.793306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.793342:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.793471:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526784 00000100:00100000:2.0:1746142915.793477:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526784 00000100:00100000:2.0:1746142915.793504:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527040 00000100:00100000:2.0:1746142915.793506:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527040 00000100:00100000:2.0:1746142915.793533:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14546 00000100:00100000:2.0:1746142915.793539:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867526784:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142915.793553:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.793567:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094715000/0x2fa243e067ccddc6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b075 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.793607:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867867136:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142915.793667:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.793778:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14547 00000100:00100000:0.0:1746142915.793785:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867527040:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.793791:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.793799:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b083 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.793815:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.793816:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.793822:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.793834:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 12 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.793842:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3e00, rc 0) 00000100:00100000:0.0:1746142915.793860:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867527040:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 76us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.793865:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14547 00000100:00100000:0.0:1746142915.793895:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.793930:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526656 00000100:00100000:0.0:1746142915.793933:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526656 00000100:00100000:0.0:1746142915.793948:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14548 00000100:00100000:0.0:1746142915.793953:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867526656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.793958:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.793964:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b06e expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.793973:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.793974:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.793977:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.793985:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.793992:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3400, rc 0) 00000100:00100000:0.0:1746142915.794005:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867526656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.794010:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14548 00000100:00100000:0.0:1746142915.795108:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.795141:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867526912 00000100:00100000:3.0:1746142915.795145:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867526912 00000100:00100000:3.0:1746142915.795166:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14549 00000100:00100000:3.0:1746142915.795170:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867526912:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.795177:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.795186:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdddb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b07c expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.795208:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867867264:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142915.795826:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373483c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746142915.796943:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.796947:0:1852:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142915 -> 1746142916 00000100:00100000:2.0:1746142915.796963:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867867136:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142915.796983:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094715000/0x2fa243e067ccddc6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b075 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.796993:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715000/0x2fa243e067ccddc6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b075 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.797001:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715000, rc 0) 00000100:00100000:2.0:1746142915.797027:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867526784:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3488us (3726us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142915.797034:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14546 00002000:00010000:3.0:1746142915.797257:0:11421:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime: 1746142915 -> 1746142916 00000100:00100000:3.0:1746142915.797275:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867867264:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142915.797291:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdddb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b07c expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.797304:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd82400/0x2fa243e067ccdddb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b07c expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.797310:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82400, rc 0) 00000100:00100000:3.0:1746142915.797325:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867526912:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2155us (2218us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142915.797330:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14549 00000100:00100000:0.0:1746142915.799413:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.800283:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527296 00000100:00100000:3.0:1746142915.800291:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527296 00000100:00100000:3.0:1746142915.800375:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14505 00000100:00100000:3.0:1746142915.800382:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:32634:x1830962867527296:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.800398:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.800414:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdde2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b08a expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.800492:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.800504:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.800511:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.800534:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.800549:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 14 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.800559:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867867392:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.800992:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801373483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.804712:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867867392:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.804735:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142915.804778:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.805279:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527424 00000100:00100000:1.0:1746142915.805285:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527424 00010000:00010000:1.0:1746142915.805309:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 15 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.805337:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6608 00000100:00100000:1.0:1746142915.805344:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867527424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.805354:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.805358:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 15 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.805367:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 15 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.805384:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715c00/0x2fa243e067ccddbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b067 expref: 15 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.805407:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142915.805411:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.805418:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.805424:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.805444:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.805475:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867527424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 132us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.805482:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6608 00010000:00010000:3.0:1746142915.805749:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.805756:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.805771:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142915.805870:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83600/0x2fa243e067ccdde2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.805885:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.805890:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.805892:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142915.805894:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:3.0:1746142915.805940:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:32634:x1830962867527296:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5559us (6532us total) trans 8589936696 rc 0/0 00000100:00100000:3.0:1746142915.805949:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14505 00000100:00100000:0.0:1746142915.811068:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.811151:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527552 00000100:00100000:3.0:1746142915.811158:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527552 00000100:00100000:3.0:1746142915.811194:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14506 00000100:00100000:3.0:1746142915.811201:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:32634:x1830962867527552:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.811219:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.811234:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f2a00/0x2fa243e067ccddf7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b091 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.811313:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.811325:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.811331:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.811355:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.811365:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 15 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.811376:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867867520:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.811703:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.812657:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867867520:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.812670:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142915.814035:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.814082:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527680 00000100:00100000:2.0:1746142915.814088:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527680 00010000:00010000:2.0:1746142915.814111:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 16 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.814140:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6609 00000100:00100000:2.0:1746142915.814146:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867527680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.814154:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.814159:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 16 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.814173:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 16 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.814189:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cd83e00/0x2fa243e067ccdde9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b08a expref: 16 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.814214:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.814217:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.814225:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.814231:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142915.814507:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142915.814581:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.814588:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.814626:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142915.814630:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142915.814642:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.814667:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800923f2a00/0x2fa243e067ccddf7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b091 expref: 16 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.814692:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b091 expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.814698:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.814700:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142915.814702:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130de3800, rc 0) 00000100:00100000:2.0:1746142915.814740:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867527680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 593us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.814746:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6609 00000100:00100000:3.0:1746142915.815150:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:32634:x1830962867527552:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3947us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.815155:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14506 00000100:00100000:2.0:1746142915.818038:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.818081:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.818142:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527808 00000100:00100000:3.0:1746142915.818149:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527808 00000100:00100000:3.0:1746142915.818513:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867527936 00000100:00100000:3.0:1746142915.818517:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867527936 00000100:00100000:0.0:1746142915.818579:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14550 00000100:00100000:0.0:1746142915.818587:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867527808:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.818602:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.818614:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067ccde05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b098 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.818655:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867867648:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142915.818720:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.818794:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14551 00000100:00100000:3.0:1746142915.818800:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867527936:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.818810:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.818819:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067ccde0c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b09f expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.818842:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867867776:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142915.818863:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142915.822461:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867867648:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142915.822486:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067ccde05 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b098 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.822496:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2000/0x2fa243e067ccde05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b098 expref: 12 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.822521:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2000, rc 0) 00000100:00100000:1.0:1746142915.822555:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867527808:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3969us (4522us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142915.822561:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14550 00000100:00100000:3.0:1746142915.822648:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867867776:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142915.822662:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067ccde0c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b09f expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.822671:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067ccde0c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b09f expref: 9 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.822680:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2ee00, rc 0) 00000100:00100000:3.0:1746142915.822696:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867527936:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3897us (4615us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142915.822702:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14551 00000100:00100000:0.0:1746142915.824470:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.824561:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528192 00000100:00100000:3.0:1746142915.824567:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528192 00000100:00100000:3.0:1746142915.824630:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14507 00000100:00100000:3.0:1746142915.824637:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:32634:x1830962867528192:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.824651:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.824664:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccde13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0a6 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.824735:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ea00/0x2fa243e067ccde1a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.824748:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ea00/0x2fa243e067ccde1a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.824756:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ea00/0x2fa243e067ccde1a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142915.824765:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142915.824833:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2e800/0x2fa243e067ccde13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0a6 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.824844:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ea00/0x2fa243e067ccde1a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0a6 expref: 16 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.824851:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.824853:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142915.824855:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2ea00, rc 0) 00000100:00100000:3.0:1746142915.824891:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:32634:x1830962867528192:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 255us (424us total) trans 8589936697 rc 0/0 00000100:00100000:3.0:1746142915.824897:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14507 00000100:00100000:0.0:1746142915.828791:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.829069:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528320 00000100:00100000:3.0:1746142915.829077:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528320 00000100:00100000:3.0:1746142915.829107:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14552 00000100:00100000:3.0:1746142915.829113:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867528320:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142915.829147:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.829162:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.829175:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.829181:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.829187:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.829188:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.829191:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.829215:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 34 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.829225:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 34 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.829236:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867867904:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.829309:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142915.829316:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 8 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.829323:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867868032:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.829348:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.829355:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.829361:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867868160:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.829377:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.829886:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.829947:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.829996:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.830024:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.830039:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528448 00000100:00100000:0.0:1746142915.830042:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528448 00000100:00100000:0.0:1746142915.830058:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528704 00000100:00100000:0.0:1746142915.830060:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528704 00000100:00100000:0.0:1746142915.830068:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528960 00000100:00100000:0.0:1746142915.830069:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528960 00000100:00100000:0.0:1746142915.830077:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528576 00000100:00100000:0.0:1746142915.830078:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528576 00000100:00100000:0.0:1746142915.830089:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14553 00000100:00100000:0.0:1746142915.830094:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867528448:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142915.830113:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830123:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830130:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830135:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 20 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830141:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.830142:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.830144:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830160:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 20 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830168:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 20 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.830187:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867868288:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142915.830227:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830234:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.830240:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867868416:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142915.830257:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 33 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830262:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 33 pid: 11421 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.830277:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867868544:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.830289:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.830301:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14554 00000100:00100000:0.0:1746142915.830306:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867528704:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142915.830320:0:9579:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830329:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830337:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142915.830338:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142915.830339:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830351:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 34 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830357:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.830363:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867868672:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.830377:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.830404:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.830419:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867528832 00000100:00100000:0.0:1746142915.830422:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867528832 00000100:00100000:0.0:1746142915.830435:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14555 00000100:00100000:0.0:1746142915.830439:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867528960:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:0.0:1746142915.830452:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830461:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830466:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830476:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830481:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.830482:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.830484:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830496:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830503:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.830511:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867868800:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142915.830532:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.830539:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 13 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.830545:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867868928:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142915.830563:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.830575:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 33 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.830582:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867869056:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.830596:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142915.830689:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14556 00000100:00100000:1.0:1746142915.830695:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867528576:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142915.830708:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830716:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830721:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.830722:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142915.830724:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830735:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 33 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830742:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 33 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.830748:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867869184:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.830766:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142915.830776:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14557 00000100:00100000:1.0:1746142915.830780:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867528832:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:1.0:1746142915.830790:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830799:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830804:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.830809:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 34 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.830813:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.830814:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.830815:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830825:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 34 pid: 11421 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.830837:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 34 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.830844:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867869312:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.830864:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 10 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.830871:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 10 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.830877:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867869440:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.830896:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.830921:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.830928:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867869568:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.830956:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142915.835873:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867868672:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142915.835924:0:9579:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.835955:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.835986:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.835998:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.836025:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867868800:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.836031:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529088 00000100:00100000:3.0:1746142915.836036:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529088 00000100:00100000:0.0:1746142915.836049:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867868928:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.836063:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.836070:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867869056:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.836080:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529344 00000100:00100000:3.0:1746142915.836082:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529344 00010000:00010000:0.0:1746142915.836086:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836089:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 15 pid: 1854 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.836098:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529216 00000100:00100000:3.0:1746142915.836099:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529216 00010000:00010000:3.0:1746142915.836106:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 11 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.836117:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6610 00000100:00100000:3.0:1746142915.836122:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867529088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142915.836129:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867869440:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.836132:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.836148:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.836151:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867869312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.836157:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 35 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746142915.836174:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.836189:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867869568:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142915.836202:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.836212:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867529088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.836217:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6610 00000100:00100000:3.0:1746142915.836229:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6611 00000100:00100000:3.0:1746142915.836233:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867529344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.836238:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.836244:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 15 pid: 1854 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.836251:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 15 pid: 1854 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.836261:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.836284:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:2004:x1830962867529344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.836289:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6611 00000100:00100000:3.0:1746142915.836298:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6612 00000100:00100000:3.0:1746142915.836302:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867529216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.836308:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.836314:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 11 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746142915.836322:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 11 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746142915.836332:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.836334:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.836338:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836345:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836356:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.836367:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867868288:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.836372:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867529216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 69us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.836375:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867868416:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.836377:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6612 00000100:00100000:1.0:1746142915.836382:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867868544:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.836397:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836401:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2b200/0x2fa243e067ccdb6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af2c expref: 34 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.836414:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867867904:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142915.836416:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867869184:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142915.836423:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836433:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984b1200/0x2fa243e067ccdc0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af80 expref: 10 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:3.0:1746142915.836440:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867868032:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.836448:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a89d400/0x2fa243e067ccdb2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af09 expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.836458:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867868160:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.836471:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836478:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836483:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836496:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836502:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836508:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836513:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2f200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142915.836516:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836522:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836535:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.836540:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2f200/0x2fa243e067ccde28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.836576:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867528320:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 7464us (7791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.836583:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14552 00000100:00100000:0.0:1746142915.845673:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.845888:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530496 00000100:00100000:2.0:1746142915.845897:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530496 00010000:00010000:2.0:1746142915.845953:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 21 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.845982:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6613 00000100:00100000:2.0:1746142915.845989:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867530496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142915.846003:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.846021:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 21 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.846032:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 21 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.846050:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82a00/0x2fa243e067ccdd6b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b044 expref: 21 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.846073:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.846108:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867530496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.846113:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6613 00000100:00100000:0.0:1746142915.848856:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850066:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850083:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850097:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850116:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850128:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850143:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850155:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.850178:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.850341:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529600 00000100:00100000:1.0:1746142915.850348:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529600 00010000:00010000:1.0:1746142915.850377:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 34 pid: 11421 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.850393:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529856 00000100:00100000:1.0:1746142915.850395:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529856 00010000:00010000:1.0:1746142915.850404:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 14 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.850411:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530368 00000100:00100000:1.0:1746142915.850413:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530368 00010000:00010000:1.0:1746142915.850420:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.850427:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529472 00000100:00100000:1.0:1746142915.850429:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529472 00010000:00010000:1.0:1746142915.850435:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 15 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.850442:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529984 00000100:00100000:1.0:1746142915.850444:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529984 00010000:00010000:1.0:1746142915.850449:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.850456:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530240 00000100:00100000:1.0:1746142915.850457:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530240 00010000:00010000:1.0:1746142915.850465:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 9 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.850472:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530624 00000100:00100000:1.0:1746142915.850473:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530624 00010000:00010000:1.0:1746142915.850481:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 34 pid: 11421 timeout: 789 lvb_type: 1 00000100:00100000:1.0:1746142915.850490:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6614 00000100:00100000:1.0:1746142915.850496:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867529600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.850507:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.850523:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 35 pid: 11421 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850531:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 35 pid: 11421 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850550:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1600/0x2fa243e067ccdd41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b036 expref: 35 pid: 11421 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850566:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.850600:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867529600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.850605:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6614 00000100:00100000:1.0:1746142915.850619:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6615 00000100:00100000:1.0:1746142915.850623:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867529856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.850628:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.850636:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 15 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.850643:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 15 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.850654:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3e00/0x2fa243e067ccddcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b083 expref: 15 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.850661:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.850675:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867529856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.850680:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6615 00000100:00100000:1.0:1746142915.850714:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6616 00000100:00100000:1.0:1746142915.850718:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867530368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.850724:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.850730:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.850736:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.850751:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009471f800/0x2fa243e067ccdcd8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afe9 expref: 20 pid: 1852 timeout: 789 lvb_type: 1 00000100:00100000:2.0:1746142915.850763:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530112 00000100:00100000:2.0:1746142915.850767:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530112 00002000:00100000:2.0:1746142915.850793:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1982464->2097151) req@ffff88009734fb80 x1830962867530112/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.850802:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734fb80 with x1830962867530112 ext(1982464->2097151) 00010000:00010000:2.0:1746142915.850808:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850814:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142915.850817:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746142915.850823:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734fb80 00000100:00100000:1.0:1746142915.850829:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867530368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.850834:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867529728 00000100:00100000:1.0:1746142915.850834:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6616 00000100:00100000:2.0:1746142915.850836:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867529728 00000100:00100000:1.0:1746142915.850844:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6617 00002000:00100000:2.0:1746142915.850846:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1724415) req@ffff88009734d500 x1830962867529728/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/0 e 0 to 0 dl 1746142926 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746142915.850848:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867529472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00100000:2.0:1746142915.850853:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d500 with x1830962867529728 ext(1048576->1724415) 00010000:00010000:1.0:1746142915.850854:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142915.850858:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850861:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 789 lvb_type: 1 00010000:00010000:2.0:1746142915.850865:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850868:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 789 lvb_type: 1 00002000:00010000:2.0:1746142915.850870:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734d500 00010000:00010000:1.0:1746142915.850878:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c3400/0x2fa243e067ccddd4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b06e expref: 13 pid: 9580 timeout: 789 lvb_type: 1 00000100:00100000:0.0:1746142915.850880:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1421 00000100:00100000:2.0:1746142915.850885:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1422 00010000:00010000:1.0:1746142915.850885:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.850887:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746142915.850888:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867530112:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142915.850890:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867529728:12345-192.168.204.50@tcp:4:multiop.0 00010000:00010000:1.0:1746142915.850890:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.850911:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.850929:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.850932:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6618 00000100:00100000:3.0:1746142915.850940:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867529984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142915.850941:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867529472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.850946:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6617 00010000:00010000:3.0:1746142915.850947:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.850955:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.850955:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6619 00000100:00100000:1.0:1746142915.850960:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867530240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.850964:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850966:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.850973:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 9 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746142915.850975:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a1800/0x2fa243e067ccdca0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afcd expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.850981:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 9 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.850991:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800984b1e00/0x2fa243e067ccdc1b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af8e expref: 9 pid: 1852 timeout: 789 lvb_type: 1 00010000:00010000:3.0:1746142915.850993:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.850995:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.850997:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.850999:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142915.851008:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.851010:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867530240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.851015:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6619 00000100:00100000:2.0:1746142915.851022:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6620 00010000:00010000:3.0:1746142915.851025:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142915.851028:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867530624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.851031:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.851034:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.851039:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851039:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.851041:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 36 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.851046:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.851049:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 36 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:0.0:1746142915.851052:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851059:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.851060:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968cce00/0x2fa243e067ccdb7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af3a expref: 36 pid: 11421 timeout: 789 lvb_type: 1 00010000:00010000:1.0:1746142915.851060:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851065:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.851066:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851071:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea41200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142915.851072:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142915.851072:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851074:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.851076:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c2400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142915.851079:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851081:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.851084:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.851087:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867530624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 58us (908us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142915.851090:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.851092:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6620 00010000:00010000:1.0:1746142915.851092:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.851095:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea41200/0x2fa243e067ccde3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.851097:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2400/0x2fa243e067ccde2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.851129:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867528448:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 21035us (21244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.851133:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867528960:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 20692us (21136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.851135:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14553 00000100:00100000:0.0:1746142915.851139:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14555 00000100:00100000:3.0:1746142915.851247:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867529984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.851256:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6618 00000100:00100000:2.0:1746142915.856181:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2005:x1830962867530112:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 5285us (6086us total) trans 17179873981 rc 0/0 00000100:00100000:2.0:1746142915.856193:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1421 00002000:00100000:2.0:1746142915.856203:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1982464->2097151) req@ffff88009734fb80 x1830962867530112/t17179873981(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.856212:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734fb80 with x1830962867530112 ext(1982464->2097151) 00010000:00010000:2.0:1746142915.856221:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.856232:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746142915.856238:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734fb80 00000100:00100000:2.0:1746142915.858219:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867529728:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 7321us (8082us total) trans 21474841240 rc 0/0 00000100:00100000:2.0:1746142915.858228:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1422 00002000:00100000:2.0:1746142915.858236:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1724415) req@ffff88009734d500 x1830962867529728/t21474841240(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:66/0 lens 488/448 e 0 to 0 dl 1746142926 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142915.858244:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734d500 with x1830962867529728 ext(1048576->1724415) 00010000:00010000:2.0:1746142915.858253:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:2.0:1746142915.858262:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00002000:00010000:2.0:1746142915.858275:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734d500 00000100:00100000:0.0:1746142915.858990:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.859084:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530752 00000100:00100000:3.0:1746142915.859091:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530752 00010000:00010000:3.0:1746142915.859111:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.859137:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6621 00000100:00100000:3.0:1746142915.859141:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867530752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.859149:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.859160:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.859167:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.859181:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25800/0x2fa243e067ccdb42 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8af1e expref: 14 pid: 1854 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.859197:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.859199:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.859202:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.859207:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.859223:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.859239:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867530752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.859242:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6621 00010000:00010000:0.0:1746142915.859446:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859454:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859467:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859477:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859484:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859489:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea53800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142915.859492:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859499:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859508:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.859513:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea53800/0x2fa243e067ccde4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.859561:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867528832:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 28780us (29155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.859568:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14557 00000100:00100000:2.0:1746142915.864159:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.864390:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867530880 00000100:00100000:0.0:1746142915.864396:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867530880 00010000:00010000:0.0:1746142915.864428:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.864469:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6622 00000100:00100000:0.0:1746142915.864475:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867530880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.864486:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.864503:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.864512:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.864530:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714c00/0x2fa243e067ccdda3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1724415) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b060 expref: 35 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.864550:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.864552:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.864556:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864563:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864580:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.864610:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867530880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 135us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.864616:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6622 00010000:00010000:0.0:1746142915.864655:0:9579:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864665:0:9579:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864677:0:9579:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864683:0:9579:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864689:0:9579:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864694:0:9579:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea40400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142915.864697:0:9579:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864703:0:9579:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864711:0:9579:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.864716:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea40400/0x2fa243e067ccde36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.864746:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962867528704:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 34440us (34799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.864754:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14554 00000100:00100000:2.0:1746142915.864810:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.864893:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867531008 00000100:00100000:1.0:1746142915.864912:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867531008 00010000:00010000:1.0:1746142915.864927:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.864941:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6623 00000100:00100000:1.0:1746142915.864946:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867531008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.864952:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.864963:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.864971:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.864982:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094715200/0x2fa243e067ccdd9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b059 expref: 34 pid: 1852 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.864993:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.864994:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.864998:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865003:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865014:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142915.865023:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865033:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865042:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865048:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865053:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865057:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea52200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142915.865060:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865064:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865071:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.865075:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ea52200/0x2fa243e067ccde44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.865108:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867528576:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 34413us (35082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.865115:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14556 00000100:00100000:1.0:1746142915.865132:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867531008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.865136:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6623 00000100:00100000:0.0:1746142915.868157:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.868343:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867531264 00000100:00100000:3.0:1746142915.868350:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867531264 00000100:00100000:3.0:1746142915.868392:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14508 00000100:00100000:3.0:1746142915.868399:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:32634:x1830962867531264:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1746142915.868438:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.868458:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130de3800/0x2fa243e067ccddfe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b091 expref: 16 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868473:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.868476:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142915.868495:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.868505:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868511:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 40 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868522:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868528:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 57 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868534:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868540:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.868563:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868572:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.868583:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867869696:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.868649:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 57 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868657:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 57 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.868664:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867869824:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.868682:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868690:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.868696:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867869952:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.868712:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 40 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868718:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 40 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.868724:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867870080:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.868740:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 57 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.868746:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.868752:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867870208:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.868763:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.873806:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867869696:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142915.874958:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.875007:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.875064:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.875128:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867531648 00000100:00100000:1.0:1746142915.875134:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867531648 00010000:00010000:1.0:1746142915.875161:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 58 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.875180:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867531904 00000100:00100000:1.0:1746142915.875182:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867531904 00010000:00010000:1.0:1746142915.875189:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 41 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:1.0:1746142915.875201:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6624 00000100:00100000:1.0:1746142915.875206:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2006:x1830962867531648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.875217:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.875221:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 58 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.875230:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 58 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.875248:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142915.875252:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.875260:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.875305:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2006:x1830962867531648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.875311:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6624 00000100:00100000:1.0:1746142915.875324:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6625 00000100:00100000:1.0:1746142915.875329:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+41:2006:x1830962867531904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142915.875335:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142915.875338:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 41 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.875345:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 41 pid: 7232 timeout: 789 lvb_type: 0 00010000:00010000:1.0:1746142915.875354:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142915.875356:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142915.875361:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142915.875374:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+41:2006:x1830962867531904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 45us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.875379:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6625 00000100:00100000:2.0:1746142915.875483:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867531520 00000100:00100000:2.0:1746142915.875487:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867531520 00010000:00010000:3.0:1746142915.875892:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e670c00/0x2fa243e067ccd609 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac2a expref: 58 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.875930:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867869824:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.875942:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867869952:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.875949:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c4fb200/0x2fa243e067ccd801 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ad49 expref: 40 pid: 7232 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.875957:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867870080:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.875963:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867870208:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.875983:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142915.877382:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.877408:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.877585:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867531776 00000100:00100000:0.0:1746142915.877590:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867531776 00000100:00100000:2.0:1746142915.877599:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5309 00010000:00010000:0.0:1746142915.877606:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 789 lvb_type: 0 00000100:00100000:2.0:1746142915.877609:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:16986:x1830962867531520:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746142915.877629:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532032 00000100:00100000:0.0:1746142915.877631:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532032 00010000:00010000:0.0:1746142915.877640:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 58 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:0.0:1746142915.877651:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6626 00000100:00100000:0.0:1746142915.877656:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+40:2003:x1830962867531776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.877665:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.877669:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.877677:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.877692:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337bc00/0x2fa243e067ccd5fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8ac1c expref: 40 pid: 10924 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.877711:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142915.877714:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.877721:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.877750:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+39:2003:x1830962867531776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.877754:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6626 00000100:00100000:2.0:1746142915.877763:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+59:16986:x1830962867531520:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 156us (2807us total) trans 8589936698 rc 0/0 00000100:00100000:0.0:1746142915.877765:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6627 00000100:00100000:2.0:1746142915.877768:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5309 00000100:00100000:0.0:1746142915.878095:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+58:2003:x1830962867532032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142915.878104:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142915.878108:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 58 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.878116:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 58 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.878125:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccd6bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8aca8 expref: 58 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:0.0:1746142915.878134:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142915.878137:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.878142:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142915.878156:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2003:x1830962867532032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 386us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.878164:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6627 00000100:00100000:0.0:1746142915.880701:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.881548:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532160 00000100:00100000:3.0:1746142915.881555:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532160 00010000:00010000:3.0:1746142915.881584:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.881614:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6628 00000100:00100000:3.0:1746142915.881621:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+57:2005:x1830962867532160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.881633:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.881638:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.881648:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.881665:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbae00/0x2fa243e067ccdc8b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8afbf expref: 57 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.881676:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.881680:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.881689:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.881694:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.881717:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142915.881741:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142915.881747:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000040:00080000:0.0:1746142915.882064:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].649, 88 off64824 00000004:00080000:0.0:1746142915.882071:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881170499ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882109:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].723, 88 off71432 00000004:00080000:0.0:1746142915.882113:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881212924ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882135:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].724, 88 off71520 00000004:00080000:0.0:1746142915.882137:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881237596ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882144:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].650, 88 off64912 00000004:00080000:0.0:1746142915.882146:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881246106ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882155:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].651, 88 off65000 00000004:00080000:0.0:1746142915.882158:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881257777ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882166:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].725, 88 off71608 00000004:00080000:0.0:1746142915.882168:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881268289ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882174:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].726, 88 off71696 00000004:00080000:0.0:1746142915.882176:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881276099ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882181:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].652, 88 off65088 00000004:00080000:0.0:1746142915.882183:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881283454ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882191:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].727, 88 off71784 00000004:00080000:0.0:1746142915.882193:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881293334ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882199:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].653, 88 off65176 00000004:00080000:0.0:1746142915.882201:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881301109ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882209:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].728, 88 off71872 00000004:00080000:0.0:1746142915.882211:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881311326ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882217:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].654, 88 off65264 00000004:00080000:0.0:1746142915.882219:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881318876ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882226:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].729, 88 off71960 00000004:00080000:0.0:1746142915.882228:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881328579ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882234:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].655, 88 off65352 00000004:00080000:0.0:1746142915.882236:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881335847ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142915.882243:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].730, 88 off72048 00000004:00080000:0.0:1746142915.882245:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881345644ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882251:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].731, 88 off72136 00000004:00080000:0.0:1746142915.882254:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689881354422ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142915.882262:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].656, 88 off65440 00000004:00080000:0.0:1746142915.882264:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689881364114ns, next at 629431245375ns, rc = 0 00000100:00100000:3.0:1746142915.882307:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+56:2005:x1830962867532160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 685us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.882314:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6628 00000001:00080000:3.0:1746142915.884572:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936699 is committed 00000004:00080000:3.0:1746142915.885051:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 645 committed 00000004:00080000:3.0:1746142915.885059:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 720 committed 00000100:00100000:0.0:1746142915.885184:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867870336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142915.885230:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142915.885261:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746142915.885273:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867870464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142915.885290:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142915.885311:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867870336 00000100:00100000:0.0:1746142915.885317:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867870336 00000100:00100000:0.0:1746142915.885343:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867870464 00000100:00100000:0.0:1746142915.885345:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867870464 00000100:00100000:0.0:1746142915.885355:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14558 00000100:00100000:0.0:1746142915.885360:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3762:x1830962867870336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142915.885470:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3762:x1830962867870336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (239us total) trans 21474841241 rc 0/0 00000100:00100000:0.0:1746142915.885477:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14558 00000100:00100000:0.0:1746142915.885488:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14559 00000100:00100000:0.0:1746142915.885492:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3762:x1830962867870464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142915.885535:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3762:x1830962867870464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (244us total) trans 21474841242 rc 0/0 00000100:00100000:0.0:1746142915.885539:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14559 00000004:00080000:0.0:1746142915.885568:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de0000/2, rc 0, transno 21474841242 00000100:00100000:0.0:1746142915.885573:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867870464:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142915.885578:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de0a80/2, rc 0, transno 21474841241 00000100:00100000:0.0:1746142915.885581:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867870336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142915.885631:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 719 committed 00000004:00080000:3.0:1746142915.885633:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 644 committed 00000004:00080000:3.0:1746142915.885634:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 718 committed 00000004:00080000:3.0:1746142915.885636:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 643 committed 00000004:00080000:3.0:1746142915.885637:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 717 committed 00000004:00080000:3.0:1746142915.885639:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 642 committed 00000004:00080000:3.0:1746142915.885640:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 716 committed 00000004:00080000:3.0:1746142915.885642:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 641 committed 00000004:00080000:3.0:1746142915.885643:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 715 committed 00000004:00080000:3.0:1746142915.885645:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 714 committed 00000004:00080000:3.0:1746142915.885646:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 640 committed 00000004:00080000:3.0:1746142915.885647:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 639 committed 00000004:00080000:3.0:1746142915.885649:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 713 committed 00000004:00080000:3.0:1746142915.885650:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 712 committed 00000004:00080000:3.0:1746142915.885651:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 638 committed 00000001:00080000:3.0:1746142915.885655:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936698 is committed 00000100:00100000:1.0:1746142915.885660:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867870976:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1746142915.885664:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936695 is committed 00000100:00100000:1.0:1746142915.885680:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142915.885691:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746142915.885694:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867870848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142915.885705:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142915.885718:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867870976 00000100:00100000:1.0:1746142915.885721:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867870976 00000100:00100000:1.0:1746142915.885733:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867870848 00000100:00100000:1.0:1746142915.885734:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867870848 00000100:00100000:1.0:1746142915.885743:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14560 00000100:00100000:1.0:1746142915.885747:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3763:x1830962867870976:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746142915.885764:0:13326:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093bced80 reply state ffff880096827c00 transno 8589936699 ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.885778:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.885785:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.885788:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746142915.885791:0:13326:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746142915.885797:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3763:x1830962867870976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (117us total) trans 21474841243 rc 0/0 00000100:00100000:1.0:1746142915.885802:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14560 00000100:00100000:1.0:1746142915.885811:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14561 00000100:00100000:1.0:1746142915.885815:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3763:x1830962867870848:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746142915.885840:0:13326:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746142915.885849:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32634:x1830962867531264:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 17450us (17698us total) trans 8589936699 rc 0/0 00000100:00100000:3.0:1746142915.885855:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14508 00000100:00100000:1.0:1746142915.885855:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3763:x1830962867870848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (150us total) trans 21474841244 rc 0/0 00000100:00100000:1.0:1746142915.885859:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14561 00010000:00010000:3.0:1746142915.885870:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.885877:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00000004:00080000:1.0:1746142915.885878:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de2a00/2, rc 0, transno 21474841244 00000100:00100000:1.0:1746142915.885881:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867870848:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746142915.885882:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00000004:00080000:1.0:1746142915.885886:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a359500/2, rc 0, transno 21474841243 00010000:00010000:3.0:1746142915.885887:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097420e00 already unused, calling callback (ffffffffa0f2d690) 00000100:00100000:1.0:1746142915.885888:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867870976:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746142915.885891:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.885896:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.885919:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.885921:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142915.885923:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.885930:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067ccde52 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142915.885975:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867870592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142915.885996:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142915.886013:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867871104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142915.886026:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886031:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867870720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142915.886047:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886057:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867871232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142915.886067:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142915.886082:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867870592 00000100:00100000:2.0:1746142915.886084:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867870592 00000100:00100000:2.0:1746142915.886100:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871104 00000100:00100000:2.0:1746142915.886101:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871104 00000100:00100000:2.0:1746142915.886114:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867870720 00000100:00100000:2.0:1746142915.886115:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867870720 00000100:00100000:2.0:1746142915.886124:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871232 00000100:00100000:2.0:1746142915.886126:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871232 00000100:00100000:2.0:1746142915.886135:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14562 00000100:00100000:2.0:1746142915.886140:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867870592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142915.886193:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3764:x1830962867870592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (195us total) trans 21474841245 rc 0/0 00000100:00100000:2.0:1746142915.886197:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14562 00000100:00100000:2.0:1746142915.886205:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14563 00000100:00100000:2.0:1746142915.886209:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867871104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142915.886245:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142915.886248:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142915.886250:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142915.886251:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142915.886253:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142915.886278:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3764:x1830962867871104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (251us total) trans 21474841246 rc 0/0 00000100:00100000:2.0:1746142915.886283:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14563 00000100:00100000:2.0:1746142915.886291:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14564 00000100:00100000:2.0:1746142915.886295:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867870720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142915.886410:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14565 00000100:00100000:0.0:1746142915.886416:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867871232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142915.886476:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867871232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (407us total) trans 21474841247 rc 0/0 00000100:00100000:0.0:1746142915.886481:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14565 00000100:00100000:3.0:1746142915.886609:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867871744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886626:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886637:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886650:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746142915.886665:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734df80/2, rc 0, transno 21474841247 00000100:00100000:3.0:1746142915.886668:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867871232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142915.886672:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746142915.886676:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867871616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886688:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886694:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886703:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886714:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867871488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886726:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886732:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867872000:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886743:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886749:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746142915.886752:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867871360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886763:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886769:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867871872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.886780:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142915.886792:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871744 00000100:00100000:3.0:1746142915.886794:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871744 00000100:00100000:3.0:1746142915.886806:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872256 00000100:00100000:3.0:1746142915.886807:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872256 00000100:00100000:3.0:1746142915.886811:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871616 00000100:00100000:3.0:1746142915.886813:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871616 00000100:00100000:3.0:1746142915.886817:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872128 00000100:00100000:3.0:1746142915.886818:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872128 00000100:00100000:3.0:1746142915.886823:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871488 00000100:00100000:3.0:1746142915.886824:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871488 00000100:00100000:3.0:1746142915.886828:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872000 00000100:00100000:3.0:1746142915.886830:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872000 00000100:00100000:3.0:1746142915.886834:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871360 00000100:00100000:3.0:1746142915.886836:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871360 00000100:00100000:3.0:1746142915.886841:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867871872 00000100:00100000:3.0:1746142915.886842:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867871872 00000100:00100000:3.0:1746142915.886850:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14566 00000100:00100000:3.0:1746142915.886853:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867871744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142915.886923:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142915.886926:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142915.886927:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142915.886929:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142915.886930:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142915.886950:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867871744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (323us total) trans 17179873982 rc 0/0 00000100:00100000:3.0:1746142915.886955:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14566 00000100:00100000:3.0:1746142915.886965:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14567 00000100:00100000:3.0:1746142915.886969:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867872256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142915.887005:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:3.0:1746142915.887007:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142915.887008:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142915.887009:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142915.887011:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142915.887011:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14568 00000100:00100000:1.0:1746142915.887016:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867871616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.887027:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867872256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (376us total) trans 17179873983 rc 0/0 00000100:00100000:3.0:1746142915.887031:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14567 00000100:00100000:3.0:1746142915.887038:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14569 00000100:00100000:3.0:1746142915.887043:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867872128:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142915.887057:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098190e00/2, rc 0, transno 17179873982 00000100:00100000:3.0:1746142915.887063:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867871744:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142915.887068:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098190380/2, rc 0, transno 17179873983 00000100:00100000:1.0:1746142915.887070:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867871616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (381us total) trans 17179873984 rc 0/0 00000100:00100000:3.0:1746142915.887071:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887074:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14568 00000004:00080000:3.0:1746142915.887077:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098191500/2, rc 0, transno 17179873984 00000100:00100000:3.0:1746142915.887079:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867871616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887082:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14570 00000100:00100000:1.0:1746142915.887086:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867871488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887127:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867871488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (400us total) trans 17179873986 rc 0/0 00000004:00080000:3.0:1746142915.887128:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098192d80/2, rc 0, transno 17179873986 00000100:00100000:3.0:1746142915.887131:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098192d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867871488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.887134:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746142915.887135:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14570 00000100:00100000:3.0:1746142915.887138:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867872384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887142:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14571 00000100:00100000:1.0:1746142915.887146:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867872000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.887152:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746142915.887178:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:1.0:1746142915.887180:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:1.0:1746142915.887182:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142915.887183:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:1.0:1746142915.887185:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142915.887186:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867872128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (481us total) trans 17179873985 rc 0/0 00000100:00100000:3.0:1746142915.887191:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14569 00000100:00100000:3.0:1746142915.887198:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872384 00000100:00100000:1.0:1746142915.887199:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867872000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (455us total) trans 17179873987 rc 0/0 00000100:00100000:3.0:1746142915.887200:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872384 00000100:00100000:1.0:1746142915.887203:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14571 00000100:00100000:3.0:1746142915.887208:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14572 00000100:00100000:1.0:1746142915.887211:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14573 00000100:00100000:3.0:1746142915.887212:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867871360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887214:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867871872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142915.887244:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00000004:00080000:3.0:1746142915.887245:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098190000/2, rc 0, transno 17179873985 00002000:00010000:1.0:1746142915.887247:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00000100:00100000:3.0:1746142915.887248:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098190000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872128:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142915.887248:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142915.887250:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142915.887252:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000004:00080000:3.0:1746142915.887257:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098193b80/2, rc 0, transno 17179873987 00000100:00100000:3.0:1746142915.887260:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867872000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887278:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3763:x1830962867871872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (497us total) trans 17179873988 rc 0/0 00000004:00080000:3.0:1746142915.887279:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098191880/2, rc 0, transno 17179873988 00000100:00100000:3.0:1746142915.887281:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867871872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142915.887283:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14573 00000100:00100000:1.0:1746142915.887292:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14574 00000100:00100000:1.0:1746142915.887296:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867872384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142915.887309:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867871360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (545us total) trans 17179873989 rc 0/0 00000100:00100000:3.0:1746142915.887313:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14572 00000004:00080000:3.0:1746142915.887329:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098191180/2, rc 0, transno 17179873989 00000100:00100000:3.0:1746142915.887331:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867871360:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142915.887358:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de3100/2, rc 0, transno 21474841245 00000100:00100000:3.0:1746142915.887362:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867870592:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142915.887367:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a358000/2, rc 0, transno 21474841246 00000100:00100000:3.0:1746142915.887370:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867871104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142915.887402:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867870720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1106us (1353us total) trans 21474841248 rc 0/0 00000100:00100000:2.0:1746142915.887406:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14564 00000100:00100000:1.0:1746142915.888345:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867872384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1047us (1190us total) trans 17179873990 rc 0/0 00000100:00100000:1.0:1746142915.888352:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14574 00000004:00080000:2.0:1746142915.888419:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0380/2, rc 0, transno 17179873990 00000100:00100000:2.0:1746142915.888423:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867872384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142915.888440:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:3.0:1746142915.888690:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091de0e00/2, rc 0, transno 21474841248 00000100:00100000:3.0:1746142915.888694:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867870720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142915.888706:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532288 00000100:00100000:3.0:1746142915.888709:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532288 00000100:00100000:3.0:1746142915.889057:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14509 00000100:00100000:3.0:1746142915.889063:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:32634:x1830962867532288:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142915.889075:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142915.889211:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0ad expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.889249:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.889261:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.889283:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.889286:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142915.889288:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337a000, rc 0) 00000100:00100000:3.0:1746142915.889320:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32634:x1830962867532288:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 258us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142915.889325:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14509 00000100:00100000:0.0:1746142915.891895:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.892015:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532416 00000100:00100000:2.0:1746142915.892022:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532416 00000100:00100000:2.0:1746142915.892061:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14510 00000100:00100000:2.0:1746142915.892068:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32634:x1830962867532416:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142915.892080:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142915.892100:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccde60 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0b4 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.892167:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccde67 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.892178:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccde67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.892187:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccde67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142915.892207:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:2.0:1746142915.892210:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142915.892221:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccde67 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142915.892239:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714000/0x2fa243e067ccde60 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0b4 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.892253:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccde67 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0b4 expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.892260:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142915.892262:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142915.892274:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094714200, rc 0) 00000100:00100000:2.0:1746142915.892314:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:32634:x1830962867532416:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 245us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.892319:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14510 00000100:00100000:0.0:1746142915.901494:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.901527:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.901551:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.901562:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.901573:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.901593:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532544 00000100:00100000:0.0:1746142915.901601:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532544 00000100:00100000:0.0:1746142915.901631:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532800 00000100:00100000:0.0:1746142915.901634:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532800 00000100:00100000:0.0:1746142915.902524:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533056 00000100:00100000:0.0:1746142915.902528:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533056 00000100:00100000:1.0:1746142915.902541:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532672 00000100:00100000:1.0:1746142915.902544:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532672 00000100:00100000:0.0:1746142915.902546:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867532928 00000100:00100000:0.0:1746142915.902547:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867532928 00000100:00100000:0.0:1746142915.902560:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14575 00000100:00100000:0.0:1746142915.902566:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867532544:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.902581:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.902598:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0bb expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.902611:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14576 00000100:00100000:1.0:1746142915.902616:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867532800:12345-192.168.204.50@tcp:101:lfs.0 00002000:00010000:0.0:1746142915.902618:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406c3, atime: 0x681406c3, ctime: 0x681406c3, blocks: 0x7f0 00010000:00010000:1.0:1746142915.902623:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.902631:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0c9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.902633:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.902635:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.902642:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746142915.902643:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c3, ctime: 0x681406c4, blocks: 0x800 00010000:00010000:1.0:1746142915.902648:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.902649:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.902653:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.902653:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.902661:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 11 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.902662:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e690600, rc 0) 00010000:00010000:1.0:1746142915.902665:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009710ce00, rc 0) 00000100:00100000:1.0:1746142915.902699:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867532800:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 83us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.902699:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867532544:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 134us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.902705:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14576 00000100:00100000:0.0:1746142915.902707:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14575 00000100:00100000:0.0:1746142915.902717:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14577 00000100:00100000:0.0:1746142915.902722:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867533056:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142915.902727:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142915.902732:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14578 00010000:00010000:0.0:1746142915.902733:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0d7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.902739:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867532928:12345-192.168.204.50@tcp:101:lfs.0 00002000:00010000:0.0:1746142915.902742:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c3, atime: 0x681406c2, ctime: 0x681406c3, blocks: 0x16b0 00010000:00010000:2.0:1746142915.902744:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.902748:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.902749:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.902751:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0d0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.902752:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746142915.902759:0:9579:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c3, ctime: 0x681406c4, blocks: 0x808 00010000:00010000:0.0:1746142915.902760:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 9 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.902764:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.902765:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.902767:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e691000, rc 0) 00010000:00010000:2.0:1746142915.902768:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 10 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142915.902776:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 10 pid: 9579 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142915.902779:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867533056:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 58us (1228us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142915.902782:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094715a00, rc 0) 00000100:00100000:0.0:1746142915.902784:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14577 00000100:00100000:0.0:1746142915.902793:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14579 00000100:00100000:2.0:1746142915.902795:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867532928:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 59us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.902797:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867532672:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:2.0:1746142915.902799:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14578 00010000:00010000:0.0:1746142915.902801:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142915.902806:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0c2 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142915.902815:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c3, ctime: 0x681406c4, blocks: 0x808 00010000:00010000:0.0:1746142915.902820:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.902822:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.902825:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.902833:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142915.902839:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e690e00, rc 0) 00000100:00100000:0.0:1746142915.902853:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867532672:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 56us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.902857:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14579 00000100:00100000:0.0:1746142915.902927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.902939:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533184 00000100:00100000:1.0:1746142915.902942:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533184 00000100:00100000:1.0:1746142915.902967:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14580 00000100:00100000:1.0:1746142915.902972:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867533184:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142915.902980:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142915.902986:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0de expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746142915.902995:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c3, atime: 0x681406c3, ctime: 0x681406c3, blocks: 0x1008 00010000:00010000:1.0:1746142915.903000:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.903001:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142915.903005:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.903013:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142915.903019:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82000, rc 0) 00000100:00100000:1.0:1746142915.903036:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867533184:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.903041:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14580 00000100:00100000:0.0:1746142915.909584:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.910965:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533440 00000100:00100000:2.0:1746142915.910975:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533440 00000100:00100000:2.0:1746142915.911018:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14581 00000100:00100000:2.0:1746142915.911024:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867533440:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142915.911115:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867533440:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 91us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.911120:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14581 00000100:00100000:1.0:1746142915.911558:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.911648:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.911662:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533696 00000100:00100000:1.0:1746142915.911665:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533696 00000100:00100000:1.0:1746142915.911680:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533952 00000100:00100000:1.0:1746142915.911682:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533952 00000100:00100000:1.0:1746142915.911693:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14582 00000100:00100000:1.0:1746142915.911697:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867533696:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142915.911736:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867533696:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 38us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.911745:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14582 00000100:00100000:1.0:1746142915.911755:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14583 00000100:00100000:1.0:1746142915.911759:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867533952:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142915.911784:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867533952:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 24us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.911789:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14583 00000100:00100000:1.0:1746142915.911897:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.911921:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533312 00000100:00100000:1.0:1746142915.911923:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533312 00000100:00100000:1.0:1746142915.911935:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14584 00000100:00100000:1.0:1746142915.911938:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867533312:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142915.911966:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867533312:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 27us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.911971:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14584 00000100:00100000:1.0:1746142915.912001:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.912011:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533568 00000100:00100000:1.0:1746142915.912013:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533568 00000100:00100000:1.0:1746142915.912024:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14585 00000100:00100000:1.0:1746142915.912028:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867533568:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142915.912053:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867533568:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 24us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.912057:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14585 00000100:00100000:1.0:1746142915.912095:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.912106:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867533824 00000100:00100000:1.0:1746142915.912108:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867533824 00000100:00100000:1.0:1746142915.912120:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14586 00000100:00100000:1.0:1746142915.912124:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867533824:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142915.912149:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867533824:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 25us (54us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.912153:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14586 00000100:00100000:0.0:1746142915.915968:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.916066:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.916093:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.916110:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534208 00000100:00100000:0.0:1746142915.916117:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534208 00000100:00100000:0.0:1746142915.916143:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534464 00000100:00100000:0.0:1746142915.916145:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534464 00000100:00100000:0.0:1746142915.916154:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534720 00000100:00100000:0.0:1746142915.916155:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534720 00000100:00100000:0.0:1746142915.916176:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14587 00000100:00100000:0.0:1746142915.916183:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867534208:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142915.916221:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14588 00000100:00100000:1.0:1746142915.916228:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534464:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142915.916276:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867534208:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142915.916282:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534464:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.916283:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14587 00000100:00100000:1.0:1746142915.916287:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14588 00000100:00100000:0.0:1746142915.916295:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14589 00000100:00100000:0.0:1746142915.916299:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867534720:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142915.916324:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867534720:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 25us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.916328:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14589 00000100:00100000:0.0:1746142915.916373:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.916382:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534080 00000100:00100000:0.0:1746142915.916385:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534080 00000100:00100000:0.0:1746142915.916395:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14590 00000100:00100000:0.0:1746142915.916399:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534080:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142915.916425:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534080:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 26us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.916429:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14590 00000100:00100000:0.0:1746142915.916466:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.916473:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534336 00000100:00100000:0.0:1746142915.916475:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534336 00000100:00100000:0.0:1746142915.916484:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14591 00000100:00100000:0.0:1746142915.916487:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867534336:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142915.916509:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867534336:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 21us (43us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142915.916706:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14591 00000100:00100000:0.0:1746142915.916749:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.916775:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534592 00000100:00100000:2.0:1746142915.916779:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534592 00000100:00100000:2.0:1746142915.916802:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14592 00000100:00100000:2.0:1746142915.916807:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534592:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142915.916856:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534592:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142915.916861:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14592 00000100:00100000:0.0:1746142915.919757:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.920151:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534848 00000100:00100000:2.0:1746142915.920159:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534848 00000100:00100000:2.0:1746142915.920207:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14593 00000100:00100000:2.0:1746142915.920214:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867534848:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:2.0:1746142915.920396:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142915.920399:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142915.920401:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:2.0:1746142915.920402:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142915.920404:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746142915.920445:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867534848:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 231us (695us total) trans 17179873991 rc 0/0 00000100:00100000:2.0:1746142915.920731:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14593 00000100:00100000:0.0:1746142915.922261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.922337:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867534976 00000100:00100000:2.0:1746142915.922342:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867534976 00000100:00100000:2.0:1746142915.922405:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14594 00000100:00100000:2.0:1746142915.922412:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867534976:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:2.0:1746142915.922518:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142915.922520:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142915.922522:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142915.922523:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142915.922524:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142915.922556:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867534976:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 144us (296us total) trans 21474841249 rc 0/0 00000100:00100000:2.0:1746142915.922565:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14594 00000100:00100000:0.0:1746142915.927038:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.927144:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867535232 00000100:00100000:2.0:1746142915.927151:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867535232 00000100:00100000:2.0:1746142915.927197:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4567 00000100:00100000:2.0:1746142915.927204:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867535232:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142915.927230:0:20334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.927244:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.927245:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.927249:0:20334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.927259:0:20334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.930829:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.930859:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.930887:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.930888:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867535616 00000100:00100000:2.0:1746142915.930896:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867535616 00000100:00100000:0.0:1746142915.930936:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.930953:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867535744 00000100:00100000:2.0:1746142915.930955:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867535744 00000100:00100000:0.0:1746142915.930955:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867536128 00000100:00100000:0.0:1746142915.930958:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867536128 00000100:00100000:2.0:1746142915.930967:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867536000 00000100:00100000:2.0:1746142915.930969:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867536000 00000100:00100000:0.0:1746142915.930979:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4568 00000100:00100000:2.0:1746142915.930984:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4569 00000100:00100000:0.0:1746142915.930985:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867535616:12345-192.168.204.50@tcp:3:lfs.0 00000100:00100000:2.0:1746142915.930990:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867535744:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142915.931009:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.931009:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.931019:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.931019:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.931021:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.931021:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.931024:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.931025:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.931034:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.931034:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.931582:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4570 00000100:00100000:2.0:1746142915.931588:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4571 00000100:00100000:0.0:1746142915.931588:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867536128:12345-192.168.204.50@tcp:3:lfs.0 00000100:00100000:2.0:1746142915.931594:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867536000:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142915.931606:0:29473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.931610:0:9583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.931613:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.931615:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.931617:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.931617:0:29473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.931618:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.931622:0:9583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.931624:0:29473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.931630:0:9583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.940076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.940593:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.942077:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867536512 00000100:00100000:3.0:1746142915.942086:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867536512 00000100:00100000:3.0:1746142915.942124:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867536768 00000100:00100000:3.0:1746142915.942126:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867536768 00000100:00100000:3.0:1746142915.942142:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4572 00000100:00100000:3.0:1746142915.942148:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867536512:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142915.942175:0:13318:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.942185:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.942187:0:13318:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142915.942191:0:13318:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.942201:0:13318:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142915.942759:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4573 00000100:00100000:0.0:1746142915.942766:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867536768:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142915.942779:0:20334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.942784:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.942788:0:20334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.942792:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142915.942794:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.942795:0:20334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.942797:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.942801:0:20334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094714000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142915.942804:0:20334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142915.942806:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.942811:0:20334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.942824:0:20334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.942829:0:20334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094714000/0x2fa243e067ccde98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.943208:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867535232:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 16003us (16176us total) trans 0 rc 1036288/1036288 00000100:00100000:2.0:1746142915.943214:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4567 00000100:00100000:3.0:1746142915.943276:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.943322:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537024 00000100:00100000:2.0:1746142915.943326:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537024 00000100:00100000:2.0:1746142915.943352:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4574 00000100:00100000:2.0:1746142915.943357:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+19:2005:x1830962867537024:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142915.943369:0:20334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.943376:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.943377:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142915.943380:0:20334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.943392:0:20334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946068:0:29472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946081:0:29472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946093:0:29472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946099:0:29472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e690800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142915.946105:0:29472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946112:0:29472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946126:0:29472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.946130:0:29472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e690800/0x2fa243e067ccdea6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.946194:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962867535616:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 15206us (15370us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142915.946202:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4568 00010000:00010000:2.0:1746142915.953155:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.953171:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.953179:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.953185:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098290000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142915.953188:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.953195:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.953210:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.953216:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098290000/0x2fa243e067ccde9f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.954061:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867535744:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 23065us (23195us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142915.954073:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4569 00010000:00010000:1.0:1746142915.959259:0:29473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.959284:0:29473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.959292:0:29473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.959298:0:29473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e691e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142915.959301:0:29473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.959308:0:29473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.959326:0:29473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142915.959338:0:29473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e691e00/0x2fa243e067ccdead lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142915.959410:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867536128:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 27818us (28518us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142915.959420:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4570 00010000:00010000:2.0:1746142915.966539:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.966554:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.966561:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.966567:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093af8400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142915.966571:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.966578:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.966594:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.966599:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093af8400/0x2fa243e067ccdeb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.966683:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867536000:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 35084us (35742us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142915.966692:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4571 00010000:00010000:3.0:1746142915.971941:0:13318:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.971956:0:13318:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.971964:0:13318:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.971971:0:13318:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142915.971974:0:13318:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.971981:0:13318:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.971997:0:13318:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.972002:0:13318:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092732a00/0x2fa243e067ccdebb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13318 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.972084:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867536512:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 29931us (32011us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.972093:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4572 00010000:00010000:3.0:1746142915.975371:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.975385:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.975392:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.975398:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf15c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142915.975401:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.975408:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.975423:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.975429:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccdec2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142915.975491:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867536768:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 32721us (34894us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142915.975503:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4573 00010000:00010000:2.0:1746142915.979049:0:20334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.979062:0:20334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.979070:0:20334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.979076:0:20334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093af9400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142915.979079:0:20334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.979085:0:20334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.979100:0:20334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142915.979105:0:20334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093af9400/0x2fa243e067ccdec9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142915.979542:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867537024:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 36180us (36273us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142915.979550:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4574 00000100:00100000:0.0:1746142915.988737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.988933:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537280 00000100:00100000:3.0:1746142915.988942:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537280 00000100:00100000:3.0:1746142915.989818:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14511 00000100:00100000:3.0:1746142915.989827:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32634:x1830962867537280:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1746142915.989867:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.989889:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094714200/0x2fa243e067ccde67 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0b4 expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.989938:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.989942:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142915.989977:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.989987:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.989995:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00010000:3.0:1746142915.990084:0:13326:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800924f7b80 reply state ffff88012f877000 transno 8589936700 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.990092:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142915.990097:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.990099:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746142915.990102:0:13326:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746142915.990173:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32634:x1830962867537280:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 347us (1441us total) trans 8589936700 rc 0/0 00000100:00100000:3.0:1746142915.990179:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14511 00000100:00100000:0.0:1746142915.992296:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142915.992384:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537408 00000100:00100000:2.0:1746142915.992391:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537408 00000100:00100000:2.0:1746142915.992441:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14595 00000100:00100000:2.0:1746142915.992448:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867537408:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142915.992547:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142915.992551:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.992553:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.992555:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.992557:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142915.992600:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867537408:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 152us (309us total) trans 21474841250 rc 0/0 00000100:00100000:2.0:1746142915.992607:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14595 00000100:00100000:0.0:1746142915.992991:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.993303:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537536 00000100:00100000:3.0:1746142915.993314:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537536 00000100:00100000:3.0:1746142915.993351:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14596 00000100:00100000:3.0:1746142915.993357:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867537536:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:3.0:1746142915.993430:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142915.993438:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142915.993439:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142915 -> 1746142916 00002000:00010000:3.0:1746142915.993441:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142915.993442:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746142915.993461:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867537536:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 105us (471us total) trans 17179873992 rc 0/0 00000100:00100000:3.0:1746142915.993473:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14596 00000100:00100000:1.0:1746142915.993737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.993765:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.993791:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.993810:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142915.993824:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537792 00000100:00100000:1.0:1746142915.993827:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537792 00000100:00100000:1.0:1746142915.993846:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867538048 00000100:00100000:1.0:1746142915.993847:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867538048 00000100:00100000:1.0:1746142915.993854:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537664 00000100:00100000:1.0:1746142915.993855:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537664 00000100:00100000:1.0:1746142915.993862:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867537920 00000100:00100000:1.0:1746142915.993863:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867537920 00000100:00100000:1.0:1746142915.993872:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14597 00000100:00100000:1.0:1746142915.993876:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867537792:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:2.0:1746142915.993882:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14598 00000100:00100000:2.0:1746142915.993889:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867538048:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:1.0:1746142915.993947:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142915.993950:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142915.993951:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142915 -> 1746142916 00002000:00010000:1.0:1746142915.993953:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142915.993954:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142915.993965:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14599 00002000:00010000:2.0:1746142915.993967:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142915.993970:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142915 -> 1746142916 00002000:00010000:2.0:1746142915.993971:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142915 -> 1746142916 00000100:00100000:0.0:1746142915.993971:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867537664:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142915.993973:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142915 -> 1746142916 00000100:00100000:1.0:1746142915.993973:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867537792:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 97us (238us total) trans 21474841251 rc 0/0 00002000:00010000:2.0:1746142915.993974:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746142915.993979:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14597 00000100:00100000:1.0:1746142915.993990:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14600 00000100:00100000:1.0:1746142915.993994:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867537920:12345-192.168.204.50@tcp:2:lfs.0 00000100:00100000:2.0:1746142915.993999:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867538048:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 102us (225us total) trans 17179873993 rc 0/0 00000100:00100000:2.0:1746142915.994004:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14598 00002000:00010000:0.0:1746142915.994018:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142915.994020:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142915.994022:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:0.0:1746142915.994022:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142915 -> 1746142916 00002000:00010000:1.0:1746142915.994024:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142915 -> 1746142916 00002000:00010000:0.0:1746142915.994024:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142915.994026:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142914 -> 1746142916 00002000:00010000:0.0:1746142915.994026:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:1.0:1746142915.994027:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142915 -> 1746142916 00002000:00010000:1.0:1746142915.994029:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:1.0:1746142915.994041:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867537920:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 46us (231us total) trans 21474841252 rc 0/0 00000100:00100000:0.0:1746142915.994041:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867537664:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 71us (249us total) trans 17179873994 rc 0/0 00000100:00100000:1.0:1746142915.994046:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14600 00000100:00100000:0.0:1746142915.994056:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14599 00000100:00100000:2.0:1746142915.996800:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142915.996863:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867538304 00000100:00100000:0.0:1746142915.996870:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867538304 00000100:00100000:2.0:1746142915.996930:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5310 00000100:00100000:2.0:1746142915.996939:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:32634:x1830962867538304:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:3.0:1746142915.997193:0:7233:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x55:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ea00/0x2fa243e067ccde1a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0a6 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.997229:0:7233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142915.997240:0:7233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.997246:0:7233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142915.997286:0:7233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142915.997301:0:7233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 10 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.997313:0:7233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7233:1830962867872512:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142915.997386:0:7233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142915.998351:0:7233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7233:1830962867872512:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142915.998364:0:7233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00000100:00100000:0.0:1746142915.999159:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142915.999219:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867538432 00000100:00100000:3.0:1746142915.999224:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867538432 00010000:00010000:3.0:1746142915.999243:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 11 pid: 13326 timeout: 789 lvb_type: 0 00000100:00100000:3.0:1746142915.999261:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6629 00000100:00100000:3.0:1746142915.999279:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867538432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142915.999289:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142915.999294:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 11 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.999302:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 11 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.999315:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccde59 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ad expref: 11 pid: 13326 timeout: 789 lvb_type: 0 00010000:00010000:3.0:1746142915.999344:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142915.999348:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142915.999354:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142915.999360:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142915.999378:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142915.999403:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867538432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 124us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142915.999405:0:7233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142915.999413:0:7233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00000100:00100000:3.0:1746142915.999419:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6629 00000040:00080000:2.0:1746142915.999790:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].658, 88 off65624 00000004:00080000:2.0:1746142915.999795:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689998895099ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142915.999826:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].732, 88 off72224 00000004:00080000:2.0:1746142915.999830:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689998929677ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142915.999851:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].733, 88 off72312 00000004:00080000:2.0:1746142915.999854:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689998953744ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000389:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].659, 88 off65712 00000004:00080000:2.0:1746142916.000394:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999494367ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142916.000418:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].660, 88 off65800 00000004:00080000:2.0:1746142916.000421:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999521539ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142916.000430:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].734, 88 off72400 00000004:00080000:2.0:1746142916.000432:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999532524ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000450:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].735, 88 off72488 00000004:00080000:2.0:1746142916.000453:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999552834ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000460:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].661, 88 off65888 00000004:00080000:2.0:1746142916.000462:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999562676ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142916.000469:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].736, 88 off72576 00000004:00080000:2.0:1746142916.000471:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999571709ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000478:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].662, 88 off65976 00000004:00080000:2.0:1746142916.000481:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999580819ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142916.000487:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].737, 88 off72664 00000004:00080000:2.0:1746142916.000489:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999589499ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000496:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].663, 88 off66064 00000004:00080000:2.0:1746142916.000502:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999602174ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142916.000515:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].738, 88 off72752 00000004:00080000:2.0:1746142916.000517:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999617717ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000525:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].664, 88 off66152 00000004:00080000:2.0:1746142916.000527:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999626912ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142916.000534:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].739, 88 off72840 00000004:00080000:2.0:1746142916.000536:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999636002ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000594:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].740, 88 off72928 00000004:00080000:2.0:1746142916.000598:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 689999698264ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142916.000610:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].665, 88 off66240 00000004:00080000:2.0:1746142916.000613:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 689999712872ns, next at 629431245375ns, rc = 0 00000001:00080000:3.0:1746142916.002134:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936701 is committed 00000004:00080000:3.0:1746142916.002141:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 653 committed 00000004:00080000:3.0:1746142916.002150:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 729 committed 00000004:00080000:3.0:1746142916.002161:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 728 committed 00000004:00080000:3.0:1746142916.002162:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 652 committed 00000004:00080000:3.0:1746142916.002164:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 727 committed 00000004:00080000:3.0:1746142916.002165:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 651 committed 00000004:00080000:3.0:1746142916.002167:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 726 committed 00000004:00080000:3.0:1746142916.002168:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 650 committed 00000100:00100000:1.0:1746142916.002313:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002361:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.002380:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867873408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002393:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.002409:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746142916.002413:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002426:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.002435:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867873280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002447:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.002465:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872896 00000100:00100000:1.0:1746142916.002471:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872896 00000100:00100000:1.0:1746142916.002498:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873408 00000100:00100000:1.0:1746142916.002499:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873408 00000100:00100000:1.0:1746142916.002508:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872768 00000100:00100000:1.0:1746142916.002510:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872768 00000100:00100000:1.0:1746142916.002520:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14601 00000100:00100000:1.0:1746142916.002525:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3765:x1830962867872896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142916.002611:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:1.0:1746142916.002614:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142916.002617:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142916.002618:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142916.002620:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:1.0:1746142916.002644:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3765:x1830962867872896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (282us total) trans 21474841253 rc 0/0 00000100:00100000:1.0:1746142916.002650:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14601 00000100:00100000:1.0:1746142916.002661:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873280 00000100:00100000:1.0:1746142916.002663:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873280 00000100:00100000:1.0:1746142916.002675:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14602 00000100:00100000:1.0:1746142916.002679:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3765:x1830962867873408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142916.002718:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142916.002720:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142916.002722:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142916.002724:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142916.002725:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142916.002748:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3765:x1830962867873408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (353us total) trans 21474841254 rc 0/0 00000100:00100000:1.0:1746142916.002753:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14602 00000100:00100000:2.0:1746142916.002755:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867872640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002762:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14603 00000100:00100000:1.0:1746142916.002766:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3765:x1830962867872768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.002775:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142916.002788:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.002801:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746142916.002803:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142916.002805:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142916.002807:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142916.002809:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142916.002810:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142916.002812:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746142916.002816:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002825:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3765:x1830962867872768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (398us total) trans 21474841255 rc 0/0 00000100:00100000:2.0:1746142916.002828:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.002830:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14603 00000100:00100000:2.0:1746142916.002833:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.002837:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867872640 00000100:00100000:1.0:1746142916.002839:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867872640 00000100:00100000:2.0:1746142916.002844:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.002847:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873152 00000100:00100000:1.0:1746142916.002849:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873152 00000100:00100000:2.0:1746142916.002857:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873024 00000100:00100000:2.0:1746142916.002859:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873024 00000100:00100000:1.0:1746142916.002859:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873536 00000100:00100000:1.0:1746142916.002861:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873536 00000004:00080000:3.0:1746142916.002864:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 725 committed 00000004:00080000:3.0:1746142916.002866:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 649 committed 00000100:00100000:1.0:1746142916.002867:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14604 00000004:00080000:3.0:1746142916.002868:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 724 committed 00000004:00080000:3.0:1746142916.002869:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 723 committed 00000004:00080000:3.0:1746142916.002871:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 648 committed 00000100:00100000:1.0:1746142916.002871:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3765:x1830962867873280:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142916.002872:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 647 committed 00000100:00100000:2.0:1746142916.002872:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14605 00000004:00080000:3.0:1746142916.002874:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 722 committed 00000004:00080000:3.0:1746142916.002875:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 721 committed 00000100:00100000:2.0:1746142916.002876:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3763:x1830962867872640:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142916.002877:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 646 committed 00002000:00010000:2.0:1746142916.002933:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142916.002935:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.002937:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00000100:00100000:1.0:1746142916.002938:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867873280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (490us total) trans 21474841256 rc 0/0 00002000:00010000:2.0:1746142916.002939:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.002940:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:1.0:1746142916.002943:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14604 00000100:00100000:3.0:1746142916.002949:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14606 00000100:00100000:1.0:1746142916.002953:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14607 00000100:00100000:3.0:1746142916.002956:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867873152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.002958:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867872640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (182us total) trans 21474841257 rc 0/0 00000100:00100000:1.0:1746142916.002958:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867873536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.002962:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14605 00000100:00100000:2.0:1746142916.002971:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14608 00000100:00100000:2.0:1746142916.002975:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3763:x1830962867873024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.003004:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3763:x1830962867873536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (159us total) trans 21474841258 rc 0/0 00000100:00100000:1.0:1746142916.003008:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14607 00000100:00100000:2.0:1746142916.003017:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867873024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (189us total) trans 21474841260 rc 0/0 00000100:00100000:3.0:1746142916.003020:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867873152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (217us total) trans 21474841259 rc 0/0 00000100:00080000:1.0:1746142916.003020:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746142916.003022:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14608 00000100:00100000:3.0:1746142916.003025:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14606 00000004:00080000:1.0:1746142916.003045:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a358700/2, rc 0, transno 21474841255 00000100:00100000:1.0:1746142916.003050:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.003090:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867873792:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746142916.003095:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.003100:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873664:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746142916.003107:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142916.003109:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142916.003112:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.003117:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732c00 already unused, calling callback (ffffffffa0f2d690) 00000100:00100000:2.0:1746142916.003119:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142916.003121:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142916.003122:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867874304:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746142916.003126:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.003130:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867874176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.003137:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142916.003139:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.003141:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142916.003145:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.003147:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873792 00000100:00100000:2.0:1746142916.003150:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873792 00010000:00010000:0.0:1746142916.003150:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccded0 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142916.003153:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746142916.003157:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867873920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142916.003167:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873664 00000100:00100000:3.0:1746142916.003168:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142916.003168:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867874048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142916.003169:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873664 00000100:00100000:2.0:1746142916.003176:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867874304 00000100:00100000:3.0:1746142916.003177:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012de10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867874432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142916.003178:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867874304 00000100:00100000:2.0:1746142916.003186:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867873920 00000100:00100000:2.0:1746142916.003188:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867873920 00000100:00100000:0.0:1746142916.003190:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.003192:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14609 00000100:00100000:3.0:1746142916.003197:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3764:x1830962867873792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.003212:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867874560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.003225:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142916.003240:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867874048 00000100:00100000:0.0:1746142916.003243:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867874048 00002000:00010000:3.0:1746142916.003244:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142916.003246:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.003248:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.003250:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.003251:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746142916.003280:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3764:x1830962867873792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (170us total) trans 17179873995 rc 0/0 00000004:00080000:1.0:1746142916.003821:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35b480/2, rc 0, transno 21474841256 00000100:00100000:1.0:1746142916.003825:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867873280:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142916.003836:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35ad80/2, rc 0, transno 21474841253 00000100:00100000:1.0:1746142916.003839:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867872896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142916.003845:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a359880/2, rc 0, transno 21474841254 00000100:00100000:1.0:1746142916.003847:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867873408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.003861:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867874560 00000100:00100000:1.0:1746142916.003863:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867874560 00000100:00100000:2.0:1746142916.004049:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14610 00000100:00100000:2.0:1746142916.004055:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3763:x1830962867873664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142916.004147:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142916.004150:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.004152:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.004153:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.004155:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142916.004175:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867873664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (1055us total) trans 17179873996 rc 0/0 00000100:00100000:2.0:1746142916.004180:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14610 00000100:00100000:2.0:1746142916.004191:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14611 00000100:00100000:2.0:1746142916.004195:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867874304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142916.004226:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142916.004228:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142916.004230:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142916.004231:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142916.004233:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:2.0:1746142916.004248:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867874304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1109us total) trans 17179873997 rc 0/0 00000100:00100000:2.0:1746142916.004252:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14611 00000100:00100000:2.0:1746142916.004260:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14612 00000100:00100000:2.0:1746142916.004277:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3764:x1830962867873920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142916.004308:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142916.004310:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.004312:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.004313:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.004315:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746142916.004330:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867873920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1161us total) trans 17179873998 rc 0/0 00000100:00100000:2.0:1746142916.004335:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14612 00000100:00100000:2.0:1746142916.004350:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746142916.004368:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35aa00/2, rc 0, transno 21474841260 00000100:00100000:2.0:1746142916.004371:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.004394:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14609 00000100:00100000:0.0:1746142916.004397:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867874176 00000100:00100000:0.0:1746142916.004400:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867874176 00000100:00100000:3.0:1746142916.004407:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14613 00000100:00100000:3.0:1746142916.004413:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867874048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.004420:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14614 00000100:00100000:0.0:1746142916.004425:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3763:x1830962867874176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.004453:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142916.004456:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.004457:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142916.004459:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.004461:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00002000:00010000:0.0:1746142916.004462:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746142916.004465:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142916.004466:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142916.004468:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142916.004470:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:3.0:1746142916.004484:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3762:x1830962867874048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1293us total) trans 17179873999 rc 0/0 00000100:00100000:3.0:1746142916.004489:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14613 00000100:00100000:0.0:1746142916.004489:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867874176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (138us total) trans 17179874000 rc 0/0 00000100:00100000:0.0:1746142916.004494:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14614 00000100:00100000:3.0:1746142916.004503:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142916.004513:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1a3100/2, rc 0, transno 17179873999 00000100:00100000:0.0:1746142916.004520:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867874048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.004522:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc63b80/2, rc 0, transno 17179873995 00000100:00100000:3.0:1746142916.004526:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867873792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.004530:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867874432 00000100:00100000:0.0:1746142916.004531:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867874432 00000004:00080000:3.0:1746142916.004533:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de13480/2, rc 0, transno 17179873997 00000100:00100000:3.0:1746142916.004536:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867874304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.004543:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc61c00/2, rc 0, transno 17179873998 00000100:00100000:0.0:1746142916.004544:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14615 00000100:00100000:3.0:1746142916.004545:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867873920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.004548:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867874432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.004595:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867874432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (91us total) trans 17179874001 rc 0/0 00000100:00100000:0.0:1746142916.004600:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14615 00000004:00080000:3.0:1746142916.004603:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012de10380/2, rc 0, transno 17179874001 00000100:00100000:3.0:1746142916.004607:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012de10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867874432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142916.004673:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14616 00000100:00100000:1.0:1746142916.004678:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867874560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142916.004716:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:1.0:1746142916.004719:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142916.004720:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142916.004722:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142916.004724:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142916.004743:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3762:x1830962867874560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1516us total) trans 17179874002 rc 0/0 00000100:00100000:1.0:1746142916.004747:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14616 00000100:00080000:1.0:1746142916.004762:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1746142916.004838:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd5f800/2, rc 0, transno 21474841258 00000100:00100000:2.0:1746142916.004842:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142916.004851:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a359c00/2, rc 0, transno 21474841257 00000100:00100000:2.0:1746142916.004854:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867872640:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142916.004860:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35b800/2, rc 0, transno 21474841259 00000100:00100000:2.0:1746142916.004862:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873152:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142916.004871:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc62d80/2, rc 0, transno 17179873996 00000100:00100000:2.0:1746142916.004873:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867873664:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142916.004879:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b1a0380/2, rc 0, transno 17179874000 00000100:00100000:2.0:1746142916.004882:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b1a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867874176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142916.004987:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009862f800/2, rc 0, transno 17179874002 00000100:00100000:0.0:1746142916.005039:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867874560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.005157:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867874688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142916.005176:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142916.005192:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867874688 00000100:00100000:0.0:1746142916.005195:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867874688 00000100:00100000:0.0:1746142916.005215:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14617 00000100:00100000:0.0:1746142916.005219:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867874688:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:2.0:1746142916.005290:0:7233:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012dc62300 reply state ffff88009800c000 transno 8589936701 ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142916.005302:0:7233:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142916.005309:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.005312:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746142916.005314:0:7233:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746142916.005319:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.005320:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142916.005325:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2ea00/0x2fa243e067ccde1a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0a6 expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.005590:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3763:x1830962867874688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 369us (412us total) trans 17179874003 rc 0/0 00000100:00100000:0.0:1746142916.005595:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14617 00000004:00080000:0.0:1746142916.005613:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009862ce00/2, rc 0, transno 17179874003 00000100:00100000:0.0:1746142916.005616:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867874688:0@lo:2:osp-syn-1-0.0 00010000:00080000:2.0:1746142916.005644:0:7233:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746142916.005662:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:32634:x1830962867538304:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 8724us (8868us total) trans 8589936701 rc 0/0 00000100:00100000:2.0:1746142916.005669:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5310 00010000:00010000:3.0:1746142916.005690:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142916.005698:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142916.005703:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142916.005708:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092733400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.005710:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142916.005716:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142916.005723:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.005725:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142916.005727:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142916.005731:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccded7 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7233 initiator: MDT0 00000100:00100000:0.0:1746142916.007384:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.007526:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867538560 00000100:00100000:3.0:1746142916.007533:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867538560 00000100:00100000:3.0:1746142916.007584:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14512 00000100:00100000:3.0:1746142916.007590:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+6:32634:x1830962867538560:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142916.007605:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.007618:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0e5 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.007656:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.007667:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.007681:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.007683:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142916.007685:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732e00, rc 0) 00000100:00080000:1.0:1746142916.007694:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142916.008770:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:32634:x1830962867538560:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 137us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.008777:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14512 00000100:00100000:0.0:1746142916.011309:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.011711:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867538816 00000100:00100000:2.0:1746142916.011718:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867538816 00000100:00100000:2.0:1746142916.011759:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5311 00000100:00100000:2.0:1746142916.011767:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:32634:x1830962867538816:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142916.011953:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32634:x1830962867538816:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 187us (650us total) trans 8589936702 rc 0/0 00000100:00100000:2.0:1746142916.011960:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5311 00000100:00100000:0.0:1746142916.031133:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.031239:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867539072 00000100:00100000:3.0:1746142916.031247:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867539072 00000100:00100000:3.0:1746142916.031308:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14513 00000100:00100000:3.0:1746142916.031317:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:32645:x1830962867539072:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.031338:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.031353:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccdee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0ec expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.031413:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031424:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031433:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031444:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031449:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031454:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031533:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031540:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031545:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142916.031552:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.031606:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031611:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031617:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031621:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092733400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.031624:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031630:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031639:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.031641:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.031644:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031649:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733400/0x2fa243e067ccdeec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031661:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031675:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031679:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031683:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.031685:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031689:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031695:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3200) 00010000:00010000:3.0:1746142916.031697:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.031698:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031702:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067ccdef3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.031731:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733a00/0x2fa243e067ccdee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.031741:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.031747:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.031748:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.031750:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732600, rc 0) 00000100:00100000:3.0:1746142916.031805:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:32645:x1830962867539072:12345-192.168.204.50@tcp:101:cat.0 Request processed in 489us (681us total) trans 8589936703 rc 0/0 00000100:00100000:3.0:1746142916.031812:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14513 00000100:00100000:0.0:1746142916.032975:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.033047:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867539328 00000100:00100000:3.0:1746142916.033052:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867539328 00000100:00100000:3.0:1746142916.033088:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14514 00000100:00100000:3.0:1746142916.033094:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32646:x1830962867539328:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.033106:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.033115:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0f3 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.033151:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033159:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033166:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033175:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033179:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033184:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033231:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033238:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033243:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142916.033249:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.033295:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033300:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033305:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033309:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092733600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.033312:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033316:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033323:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.033326:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.033328:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033332:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033339:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033343:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033351:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033355:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009337a000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.033357:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033361:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033366:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3300) 00010000:00010000:3.0:1746142916.033368:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.033370:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033374:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337a000/0x2fa243e067ccdf16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.033396:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.033405:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 28 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.033410:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.033412:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.033413:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009337b800, rc 0) 00000100:00100000:3.0:1746142916.033439:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32646:x1830962867539328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 345us (465us total) trans 8589936704 rc 0/0 00000100:00100000:3.0:1746142916.033444:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14514 00000100:00100000:0.0:1746142916.036438:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.036498:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.036516:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867539456 00000100:00100000:1.0:1746142916.036525:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867539456 00000100:00100000:0.0:1746142916.036538:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.036555:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867539840 00000100:00100000:0.0:1746142916.036555:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.036558:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867539840 00000100:00100000:1.0:1746142916.036571:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14618 00000100:00100000:1.0:1746142916.036578:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:32645:x1830962867539456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.036593:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.036606:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b0fa expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.036612:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14619 00000100:00100000:2.0:1746142916.036620:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32646:x1830962867539840:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.036626:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.036627:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.036627:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.036633:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b108 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.036634:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 14 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.036644:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.036646:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.036650:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.036694:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867539712 00000100:00100000:3.0:1746142916.036698:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867539712 00000100:00100000:3.0:1746142916.036716:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867540096 00000100:00100000:3.0:1746142916.036717:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867540096 00000100:00100000:3.0:1746142916.036733:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14515 00000100:00100000:3.0:1746142916.036737:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32644:x1830962867539712:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.036747:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.036754:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1800/0x2fa243e067ccdf39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b101 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.036802:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 14 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.036812:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d951a00, rc 0) 00010000:00010000:3.0:1746142916.036813:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142916.036828:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.036831:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14516 00010000:00010000:3.0:1746142916.036835:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 28 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.036837:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32640:x1830962867540096:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.036840:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142916.036845:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.036851:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951400/0x2fa243e067ccdf47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b10f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.036861:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.036871:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 29 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.036880:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867874816:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.036889:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142916.036896:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142916.036921:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142916.036953:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:32645:x1830962867539456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 375us (522us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142916.036958:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.036959:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14618 00010000:00010000:3.0:1746142916.036966:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 10 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.036973:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867874944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.036991:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746142916.037379:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 35 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.037387:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098290000, rc 0) 00000100:00100000:2.0:1746142916.037407:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32646:x1830962867539840:12345-192.168.204.50@tcp:101:cat.0 Request processed in 789us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.037412:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14619 00000100:00100000:0.0:1746142916.038575:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.038643:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867874816:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.038788:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867540224 00000100:00100000:1.0:1746142916.038793:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867540224 00010000:00010000:1.0:1746142916.038810:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 30 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.040184:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6630 00000100:00100000:1.0:1746142916.040195:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867540224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.040207:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.040214:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 30 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.040224:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 30 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.040242:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009337b800/0x2fa243e067ccdf1d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0f3 expref: 30 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.040274:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.040279:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142916.040286:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142916.040291:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.040331:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867540224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 138us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.040339:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6630 00000100:00100000:0.0:1746142916.041198:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.041337:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867540480 00000100:00100000:2.0:1746142916.041343:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867540480 00002000:00100000:2.0:1746142916.041373:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938d2a00 x1830962867540480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.041382:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2a00 with x1830962867540480 ext(0->1048575) 00002000:00010000:2.0:1746142916.041385:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d2a00 00000100:00100000:2.0:1746142916.041410:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4575 00000100:00100000:2.0:1746142916.041416:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867540480:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.042341:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.042456:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867874944:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.042476:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142916.042489:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.042492:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867540608 00000100:00100000:3.0:1746142916.042496:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867540608 00010000:00010000:3.0:1746142916.042512:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.042527:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6631 00000100:00100000:3.0:1746142916.042533:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867540608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.042546:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.042550:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.042558:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.042574:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732600/0x2fa243e067ccdefa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0ec expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.042604:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.042609:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142916.042616:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142916.042621:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142916.042627:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142916.042632:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142916.042636:0:11911:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142916.042650:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.042672:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867540608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.042677:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6631 00010000:00010000:3.0:1746142916.042695:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142916.042701:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142916.042715:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.042810:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d951400/0x2fa243e067ccdf47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.042826:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.042832:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.042834:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142916.042836:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0cf400, rc 0) 00000100:00100000:3.0:1746142916.042854:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32640:x1830962867540096:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6018us (6297us total) trans 8589936705 rc 0/0 00000100:00100000:3.0:1746142916.042860:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14516 00000100:00100000:3.0:1746142916.042871:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867540736 00000100:00100000:3.0:1746142916.042874:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867540736 00000100:00100000:3.0:1746142916.042888:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14517 00000100:00100000:3.0:1746142916.042892:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32646:x1830962867540736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.042917:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.042927:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b116 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.042951:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.042959:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.042971:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.042973:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142916.042974:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a0200, rc 0) 00000100:00100000:3.0:1746142916.042989:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32646:x1830962867540736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 96us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.042994:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14517 00010000:00010000:3.0:1746142916.043009:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142916.043013:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142916.043021:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.043058:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1800/0x2fa243e067ccdf39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 11 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.043067:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 10 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.043072:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.043074:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142916.043076:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1400, rc 0) 00000100:00100000:3.0:1746142916.043092:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:32644:x1830962867539712:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6354us (6593us total) trans 8589936706 rc 0/0 00000100:00100000:3.0:1746142916.043096:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14515 00000100:00100000:2.0:1746142916.053849:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867540480:12345-192.168.204.50@tcp:3:cat.0 Request processed in 12425us (12644us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.053860:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4575 00002000:00100000:2.0:1746142916.053871:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938d2a00 x1830962867540480/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.053881:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d2a00 with x1830962867540480 ext(0->1048575) 00002000:00010000:2.0:1746142916.053886:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d2a00 00000100:00100000:0.0:1746142916.066702:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.066759:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.066821:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867541120 00000100:00100000:1.0:1746142916.066830:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867541120 00000100:00100000:1.0:1746142916.066885:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14518 00000100:00100000:1.0:1746142916.066891:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32644:x1830962867541120:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142916.066935:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.066951:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf6a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b11d expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.067000:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf6a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b11d expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.067013:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf6a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b11d expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.067028:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.067031:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142916.067033:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733600, rc 0) 00000100:00100000:1.0:1746142916.067088:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32644:x1830962867541120:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 196us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.067093:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14518 00000100:00100000:2.0:1746142916.067232:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867540992 00000100:00100000:2.0:1746142916.067238:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867540992 00002000:00100000:2.0:1746142916.067287:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938d1180 x1830962867540992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.067296:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d1180 with x1830962867540992 ext(0->1048575) 00002000:00010000:2.0:1746142916.067301:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d1180 00000100:00100000:2.0:1746142916.067327:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4576 00000100:00100000:2.0:1746142916.067334:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867540992:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.077949:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.077999:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867541248 00000100:00100000:2.0:1746142916.078007:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867541248 00000100:00100000:2.0:1746142916.078052:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14620 00000100:00100000:2.0:1746142916.078060:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:32645:x1830962867541248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.078076:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.078090:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b124 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.078112:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.078113:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.078120:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 20 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.078125:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142916.078133:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 20 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.078141:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebec00, rc 0) 00000100:00100000:3.0:1746142916.078171:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867541504 00000100:00100000:3.0:1746142916.078175:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867541504 00000100:00100000:2.0:1746142916.078178:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:32645:x1830962867541248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.078184:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14620 00000100:00100000:3.0:1746142916.078200:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14519 00000100:00100000:3.0:1746142916.078205:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:32644:x1830962867541504:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.078214:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.078217:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746142916.078232:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733600/0x2fa243e067ccdf6a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b11d expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.078249:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.078252:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142916.078259:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccdf78 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b12b expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.078302:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.078312:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.078318:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.078323:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 5/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.078344:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.078354:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 29 pid: 7231 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.078363:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867875072:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.078420:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.078427:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 7 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.078435:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867875200:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.078454:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.078882:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867540992:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11548us (12186us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.078888:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4576 00002000:00100000:3.0:1746142916.078895:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800938d1180 x1830962867540992/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.078922:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938d1180 with x1830962867540992 ext(0->1048575) 00002000:00010000:3.0:1746142916.078926:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938d1180 00000100:00100000:0.0:1746142916.084068:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.084136:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.084165:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.084190:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.084221:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867542016 00000100:00100000:0.0:1746142916.084227:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867542016 00010000:00010000:0.0:1746142916.084255:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 8 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.084293:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867541760 00000100:00100000:0.0:1746142916.084299:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867541760 00010000:00010000:0.0:1746142916.084308:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 30 pid: 7231 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.084321:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6632 00000100:00100000:1.0:1746142916.084327:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6633 00000100:00100000:0.0:1746142916.084328:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867542016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142916.084333:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867541760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.084339:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.084339:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.084343:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 30 pid: 7231 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.084343:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 8 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.084352:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 8 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.084396:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867541888 00000100:00100000:2.0:1746142916.084400:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867541888 00000100:00100000:3.0:1746142916.084414:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867875072:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.084420:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14621 00000100:00100000:3.0:1746142916.084423:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867875200:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.084424:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32646:x1830962867541888:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.084436:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.084446:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b139 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.084461:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 30 pid: 7231 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.084467:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.084468:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.084473:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 34 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.084476:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0200/0x2fa243e067ccdf5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b116 expref: 30 pid: 7231 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.084484:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 34 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.084490:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.084491:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebfc00, rc 0) 00010000:00010000:1.0:1746142916.084493:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.084499:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.084503:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.084522:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867541760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.084526:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32646:x1830962867541888:12345-192.168.204.50@tcp:101:cat.0 Request processed in 101us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.084527:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6633 00000100:00100000:2.0:1746142916.084530:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14621 00000100:00100000:1.0:1746142916.084547:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867541632 00000100:00100000:1.0:1746142916.084550:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867541632 00000100:00100000:1.0:1746142916.084566:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14520 00000100:00100000:1.0:1746142916.084571:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:32645:x1830962867541632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.084579:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.084585:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b132 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.084620:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.084621:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732e00/0x2fa243e067ccdede lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0e5 expref: 8 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.084629:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.084640:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.084642:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.084651:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.084659:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.084668:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.084685:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 5/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290000000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.084687:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142916.084692:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.084696:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000020 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142916.084700:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:2003:x1830962867542016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 374us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.084705:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6632 00000004:02000000:3.0:1746142916.084728:0:13326:0:(lod_object.c:7771:lod_primary_pick()) *** cfs_fail_loc=1a03, val=0*** 00010000:00010000:1.0:1746142916.085224:0:7230:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.085235:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.085249:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.085251:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142916.085254:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.085260:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092732a00, rc 0) 00000100:00100000:1.0:1746142916.085307:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:32645:x1830962867541632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 735us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.085312:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14520 00000040:00080000:3.0:1746142916.085936:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].666, 88 off66328 00000004:00080000:3.0:1746142916.085943:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690085043184ns, next at 629431245375ns, rc = 0 00000100:00100000:0.0:1746142916.086122:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.086541:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867542144 00000100:00100000:0.0:1746142916.086545:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867542144 00000100:00100000:0.0:1746142916.086611:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14521 00000100:00100000:0.0:1746142916.086617:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32646:x1830962867542144:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.086629:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.086638:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b140 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746142916.088209:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].741, 88 off73016 00000004:00080000:3.0:1746142916.088218:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690087318352ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.089346:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].742, 88 off73104 00000004:00080000:3.0:1746142916.089354:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690088453824ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090044:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].667, 88 off66416 00000004:00080000:3.0:1746142916.090048:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089148614ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142916.090072:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].668, 88 off66504 00000004:00080000:3.0:1746142916.090076:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089175816ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142916.090085:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].743, 88 off73192 00000004:00080000:3.0:1746142916.090088:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089187759ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090095:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].744, 88 off73280 00000004:00080000:3.0:1746142916.090098:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089198554ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090106:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].669, 88 off66592 00000004:00080000:3.0:1746142916.090109:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089208846ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142916.090186:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].745, 88 off73368 00000004:00080000:3.0:1746142916.090189:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089288852ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090196:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].670, 88 off66680 00000004:00080000:3.0:1746142916.090198:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089298224ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142916.090206:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].746, 88 off73456 00000004:00080000:3.0:1746142916.090208:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089308384ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090214:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].671, 88 off66768 00000004:00080000:3.0:1746142916.090216:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089316417ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142916.090223:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].747, 88 off73544 00000004:00080000:3.0:1746142916.090225:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089325412ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090231:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].672, 88 off66856 00000004:00080000:3.0:1746142916.090233:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089333316ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142916.090240:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].748, 88 off73632 00000004:00080000:3.0:1746142916.090242:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089342534ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090333:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].750, 88 off73816 00000004:00080000:3.0:1746142916.090336:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 690089436749ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142916.090350:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].673, 88 off66944 00000004:00080000:3.0:1746142916.090352:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690089452486ns, next at 629431245375ns, rc = 0 00010000:00010000:0.0:1746142916.090420:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.090438:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.090451:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.090456:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142916.090459:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.090468:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea41e00, rc 0) 00000100:00100000:0.0:1746142916.090563:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32646:x1830962867542144:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3944us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.090571:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14521 00000001:00080000:2.0:1746142916.092247:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936707 is committed 00000004:00080000:2.0:1746142916.092253:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 661 committed 00000004:00080000:2.0:1746142916.092258:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 738 committed 00000004:00080000:2.0:1746142916.092341:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 737 committed 00000004:00080000:2.0:1746142916.092343:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 660 committed 00000004:00080000:2.0:1746142916.092344:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 736 committed 00000004:00080000:2.0:1746142916.092345:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 659 committed 00000004:00080000:2.0:1746142916.092346:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 735 committed 00000004:00080000:2.0:1746142916.092348:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 658 committed 00000004:00080000:2.0:1746142916.092349:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 734 committed 00000004:00080000:2.0:1746142916.092350:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 657 committed 00000004:00080000:2.0:1746142916.092351:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 733 committed 00000004:00080000:2.0:1746142916.092353:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 732 committed 00000004:00080000:2.0:1746142916.092354:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 656 committed 00000004:00080000:2.0:1746142916.092356:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 655 committed 00000004:00080000:2.0:1746142916.092357:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 731 committed 00000004:00080000:2.0:1746142916.092358:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 730 committed 00000004:00080000:2.0:1746142916.092359:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 654 committed 00000001:00080000:2.0:1746142916.092364:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936705 is committed 00000001:00080000:2.0:1746142916.092369:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936702 is committed 00000100:00100000:1.0:1746142916.093057:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867875456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142916.093101:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.093123:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746142916.093127:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867875328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.093142:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142916.093233:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867875456 00000100:00100000:2.0:1746142916.093238:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867875456 00000100:00100000:2.0:1746142916.093273:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867875328 00000100:00100000:2.0:1746142916.093276:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867875328 00000100:00100000:2.0:1746142916.093291:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14622 00000100:00100000:2.0:1746142916.093297:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3765:x1830962867875456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142916.093386:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142916.093389:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.093391:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.093393:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.093394:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142916.093417:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3765:x1830962867875456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (316us total) trans 17179874004 rc 0/0 00000100:00100000:2.0:1746142916.093422:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14622 00000100:00100000:2.0:1746142916.093432:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14623 00000100:00100000:2.0:1746142916.093437:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3765:x1830962867875328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142916.093479:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142916.093481:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.093483:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.093484:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.093486:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142916.093502:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867875328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (359us total) trans 21474841261 rc 0/0 00000100:00100000:2.0:1746142916.093507:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14623 00000100:00100000:3.0:1746142916.093594:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867875840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.093613:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.093625:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867876352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.093636:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.093645:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746142916.093648:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867875968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.093660:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.093667:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867876480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.093678:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.093693:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867875840 00000100:00100000:3.0:1746142916.093696:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867875840 00000100:00100000:3.0:1746142916.093710:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867876352 00000100:00100000:3.0:1746142916.093712:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867876352 00000100:00100000:3.0:1746142916.093720:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867875968 00000100:00100000:3.0:1746142916.093721:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867875968 00000100:00100000:3.0:1746142916.093728:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867876480 00000100:00100000:3.0:1746142916.093730:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867876480 00000100:00100000:3.0:1746142916.093738:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14624 00000100:00100000:3.0:1746142916.093742:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867875840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.093783:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142916.093786:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.093787:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.093789:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.093790:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746142916.093809:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867875840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (195us total) trans 17179874005 rc 0/0 00000100:00100000:3.0:1746142916.093815:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14624 00000100:00100000:3.0:1746142916.093823:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14625 00000100:00100000:3.0:1746142916.093827:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867876352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.093870:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867876352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (233us total) trans 17179874006 rc 0/0 00000100:00100000:3.0:1746142916.093874:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14625 00000100:00100000:3.0:1746142916.093882:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14626 00000100:00100000:3.0:1746142916.093885:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867875968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.093934:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142916.093936:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.093938:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142916.093939:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.093941:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142916.093956:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867875968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (295us total) trans 17179874007 rc 0/0 00000100:00100000:3.0:1746142916.093960:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14626 00000100:00100000:3.0:1746142916.093968:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14627 00000100:00100000:3.0:1746142916.093972:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3764:x1830962867876480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.094000:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:3.0:1746142916.094002:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.094004:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142916.094005:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.094007:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:3.0:1746142916.094022:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3764:x1830962867876480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (343us total) trans 17179874008 rc 0/0 00000100:00100000:3.0:1746142916.094027:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14627 00000004:00080000:3.0:1746142916.094055:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2300/2, rc 0, transno 17179874007 00000100:00100000:3.0:1746142916.094062:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867875968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.094070:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2680/2, rc 0, transno 17179874008 00000100:00100000:3.0:1746142916.094072:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867876480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.094078:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0e00/2, rc 0, transno 17179874005 00000100:00100000:3.0:1746142916.094080:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867875840:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.094085:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb1880/2, rc 0, transno 17179874006 00000100:00100000:3.0:1746142916.094087:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867876352:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746142916.094144:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094153:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.094155:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746142916.094159:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094167:0:13326:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094173:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094179:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094189:0:13326:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094193:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.094209:0:13326:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.094217:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867876736:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142916.094259:0:13326:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.094276:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867876864:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142916.094289:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.094375:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867875712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.094391:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.094400:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867876224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.094410:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.094419:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746142916.094422:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867875584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.094431:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.094438:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867876096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.094447:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.094453:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867876608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.094463:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.094475:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867875712 00000100:00100000:3.0:1746142916.094478:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867875712 00000100:00100000:3.0:1746142916.094488:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867876224 00000100:00100000:3.0:1746142916.094489:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867876224 00000100:00100000:3.0:1746142916.094494:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867875584 00000100:00100000:3.0:1746142916.094496:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867875584 00000100:00100000:3.0:1746142916.094500:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867876096 00000100:00100000:3.0:1746142916.094501:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867876096 00000100:00100000:3.0:1746142916.094506:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867876608 00000100:00100000:3.0:1746142916.094507:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867876608 00000100:00100000:3.0:1746142916.094514:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14628 00000100:00100000:3.0:1746142916.094518:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867875712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142916.094561:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142916.094563:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.094565:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.094567:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.094568:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746142916.094586:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3763:x1830962867875712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (194us total) trans 21474841262 rc 0/0 00000100:00100000:3.0:1746142916.094591:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14628 00000100:00100000:3.0:1746142916.094600:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14629 00000100:00100000:3.0:1746142916.094604:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867876224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.094638:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:3.0:1746142916.094640:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142916.094642:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142916.094644:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142916.094646:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142916.094662:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867876224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (250us total) trans 17179874009 rc 0/0 00000100:00100000:3.0:1746142916.094666:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14629 00000100:00100000:3.0:1746142916.094674:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14630 00000100:00100000:3.0:1746142916.094678:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867875584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.094708:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142916.094710:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.094712:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.094713:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142916.094715:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746142916.094729:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867875584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (297us total) trans 17179874010 rc 0/0 00000100:00100000:3.0:1746142916.094734:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14630 00000100:00100000:3.0:1746142916.094741:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14631 00000100:00100000:3.0:1746142916.094745:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867876096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142916.094775:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746142916.094777:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.094778:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142916.094780:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.094782:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:3.0:1746142916.094795:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867876096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (347us total) trans 17179874011 rc 0/0 00000100:00100000:3.0:1746142916.094800:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14631 00000100:00100000:3.0:1746142916.094807:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14632 00000100:00100000:3.0:1746142916.094811:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867876608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142916.094851:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867876608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (386us total) trans 17179874012 rc 0/0 00000100:00100000:3.0:1746142916.094855:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14632 00000004:00080000:3.0:1746142916.094877:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb1180/2, rc 0, transno 17179874010 00000100:00100000:3.0:1746142916.094880:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867875584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.094885:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb3b80/2, rc 0, transno 17179874011 00000100:00100000:3.0:1746142916.094888:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867876096:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.094893:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1500/2, rc 0, transno 17179874012 00000100:00100000:3.0:1746142916.094895:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867876608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142916.094921:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644e680/2, rc 0, transno 21474841262 00000100:00100000:3.0:1746142916.094924:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867875712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142916.094930:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb3100/2, rc 0, transno 17179874009 00000100:00100000:3.0:1746142916.094933:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867876224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142916.095286:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867877248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.095317:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746142916.095390:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644e300/2, rc 0, transno 21474841261 00000100:00100000:1.0:1746142916.095396:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867875328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142916.095409:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb3800/2, rc 0, transno 17179874004 00000100:00100000:1.0:1746142916.095413:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867875456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142916.095420:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746142916.095425:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867877120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.095449:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142916.095489:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867877632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.095511:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142916.095598:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867877248 00000100:00100000:2.0:1746142916.095604:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867877248 00000100:00100000:2.0:1746142916.095628:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867877120 00000100:00100000:2.0:1746142916.095632:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867877120 00000100:00100000:2.0:1746142916.095647:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867877632 00000100:00100000:2.0:1746142916.095650:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867877632 00000100:00100000:2.0:1746142916.095667:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14633 00000100:00100000:2.0:1746142916.095673:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3765:x1830962867877248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.095765:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3765:x1830962867877248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (446us total) trans 21474841263 rc 0/0 00000100:00100000:2.0:1746142916.095770:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14633 00000100:00100000:2.0:1746142916.095784:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14634 00000100:00100000:2.0:1746142916.095791:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3765:x1830962867877120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.095866:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3765:x1830962867877120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (416us total) trans 21474841264 rc 0/0 00000100:00100000:2.0:1746142916.095872:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14634 00000100:00100000:2.0:1746142916.095884:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14635 00000100:00100000:2.0:1746142916.095891:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3765:x1830962867877632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.096006:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3765:x1830962867877632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (492us total) trans 21474841265 rc 0/0 00000100:00100000:2.0:1746142916.096011:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14635 00000004:00080000:1.0:1746142916.096170:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644dc00/2, rc 0, transno 21474841264 00000100:00100000:1.0:1746142916.096174:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867877120:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142916.096180:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644f100/2, rc 0, transno 21474841265 00000100:00100000:1.0:1746142916.096182:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867877632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142916.096187:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644d880/2, rc 0, transno 21474841263 00000100:00100000:1.0:1746142916.096189:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867877248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142916.097462:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867876736:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142916.097471:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867876864:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142916.097507:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a0e00/0x2fa243e067ccdf78 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 11 pid: 13326 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746142916.097531:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.097554:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1200, rc 0) 00000100:00100000:1.0:1746142916.097594:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:32644:x1830962867541504:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 19386us (19466us total) trans 8589936707 rc 0/0 00000100:00100000:1.0:1746142916.097604:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14519 00000100:00100000:3.0:1746142916.097737:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867877376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.097761:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.097774:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746142916.097777:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867876992:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.097785:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.097800:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867877504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.097808:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142916.097821:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867877376 00000100:00100000:3.0:1746142916.097823:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867877376 00000100:00100000:3.0:1746142916.097837:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867876992 00000100:00100000:3.0:1746142916.097838:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867876992 00000100:00100000:3.0:1746142916.097844:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867877504 00000100:00100000:3.0:1746142916.097845:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867877504 00000100:00100000:3.0:1746142916.097851:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14636 00000100:00100000:3.0:1746142916.097854:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3762:x1830962867877376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.097889:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14637 00000100:00100000:2.0:1746142916.097924:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3762:x1830962867876992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142916.097925:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3762:x1830962867877376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (163us total) trans 21474841266 rc 0/0 00000100:00100000:3.0:1746142916.097929:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14636 00000100:00100000:3.0:1746142916.097935:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14638 00000100:00100000:3.0:1746142916.097938:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3762:x1830962867877504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142916.097965:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142916.097967:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.097968:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142916.097969:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142916.097970:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:3.0:1746142916.097980:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3762:x1830962867877504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (171us total) trans 21474841267 rc 0/0 00000100:00100000:3.0:1746142916.097983:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14638 00002000:00010000:2.0:1746142916.097993:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:2.0:1746142916.097997:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00000004:00080000:3.0:1746142916.097998:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644d180/2, rc 0, transno 21474841267 00002000:00010000:2.0:1746142916.097999:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:2.0:1746142916.098000:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00000100:00100000:3.0:1746142916.098001:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867877504:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142916.098002:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000004:00080000:3.0:1746142916.098004:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644ea00/2, rc 0, transno 21474841266 00000100:00100000:3.0:1746142916.098006:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867877376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.098040:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3762:x1830962867876992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 142us (251us total) trans 21474841268 rc 0/0 00000004:00080000:3.0:1746142916.098041:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013644ed80/2, rc 0, transno 21474841268 00000100:00100000:3.0:1746142916.098043:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867876992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142916.098046:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14637 00000100:00100000:0.0:1746142916.098613:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.098636:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867542272 00000100:00100000:0.0:1746142916.098641:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867542272 00000100:00100000:0.0:1746142916.098699:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5312 00000100:00100000:0.0:1746142916.098707:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32646:x1830962867542272:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:0.0:1746142916.098777:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32646:x1830962867542272:12345-192.168.204.50@tcp:49:cat.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.098783:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5312 00000100:00100000:0.0:1746142916.098842:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.098860:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867542400 00000100:00100000:0.0:1746142916.098865:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867542400 00000100:00100000:0.0:1746142916.098889:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5313 00000100:00100000:0.0:1746142916.098895:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:32645:x1830962867542400:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:0.0:1746142916.098978:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:32645:x1830962867542400:12345-192.168.204.50@tcp:49:cat.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.098984:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5313 00000100:00100000:0.0:1746142916.103054:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.103202:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867542528 00000100:00100000:3.0:1746142916.103209:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867542528 00000100:00100000:3.0:1746142916.103242:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5314 00000100:00100000:3.0:1746142916.103249:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32644:x1830962867542528:12345-192.168.204.50@tcp:49:multiop.0 00000100:00100000:3.0:1746142916.103498:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32644:x1830962867542528:12345-192.168.204.50@tcp:49:multiop.0 Request processed in 248us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.103505:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5314 00000100:00100000:0.0:1746142916.108422:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.108539:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.109793:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867542784 00000100:00100000:3.0:1746142916.109802:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867542784 00002000:00100000:3.0:1746142916.109839:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88013644f800 x1830962867542784/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.109848:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f800 with x1830962867542784 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.109853:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644f800 00000100:00100000:3.0:1746142916.109873:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543040 00000100:00100000:3.0:1746142916.109876:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543040 00002000:00100000:3.0:1746142916.109886:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88013644c380 x1830962867543040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.109892:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644c380 with x1830962867543040 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.109895:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644c380 00000100:00100000:3.0:1746142916.109955:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4577 00000100:00100000:3.0:1746142916.109962:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867542784:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142916.110126:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4578 00000100:00100000:0.0:1746142916.110132:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867543040:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1746142916.120156:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746142916.120235:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.120256:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543168 00000100:00100000:2.0:1746142916.120275:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543168 00000100:00100000:2.0:1746142916.120326:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14639 00000100:00100000:2.0:1746142916.120334:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+14:32644:x1830962867543168:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142916.120348:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.120362:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b147 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.120385:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 12 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.120392:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.120394:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.120397:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1417215] (req 1048576->1417215) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.120422:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 12 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.120432:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 12 pid: 9579 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.120442:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867877760:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.120679:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.138686:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867543040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28542us (30137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.138697:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4578 00002000:00100000:2.0:1746142916.138710:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88013644c380 x1830962867543040/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142916.138885:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867877760:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.138938:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->1417215] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 15 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.138953:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37400, rc 0) 00000100:00100000:3.0:1746142916.138977:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:32644:x1830962867543168:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 18644us (18746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.138983:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14639 00002000:00100000:2.0:1746142916.140860:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644c380 with x1830962867543040 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.140871:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644c380 00000100:00100000:0.0:1746142916.156472:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.156796:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.156858:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543296 00000100:00100000:2.0:1746142916.156865:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543296 00010000:00010000:2.0:1746142916.156896:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 13 pid: 9579 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.156924:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543424 00000100:00100000:1.0:1746142916.156928:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543424 00000100:00100000:2.0:1746142916.156943:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6634 00000100:00100000:2.0:1746142916.156951:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867543296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142916.156954:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14522 00000100:00100000:1.0:1746142916.156960:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+6:32647:x1830962867543424:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142916.156962:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.156978:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.156979:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 13 pid: 9579 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.156989:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 13 pid: 9579 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.156992:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098445e00/0x2fa243e067ccdfa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b14e expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.157007:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094715a00/0x2fa243e067ccde83 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d0 expref: 13 pid: 9579 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.157035:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.157036:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.157037:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.157043:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 14 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157047:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.157050:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 14 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157056:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.157067:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.157072:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.157077:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 14 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157078:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.157087:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867877888:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142916.157129:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.157138:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157145:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157150:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.157155:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864da80 going to sleep for 11 seconds 00010000:00010000:1.0:1746142916.157236:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157250:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 27 pid: 7231 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.157258:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878016:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.157300:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 9 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.157308:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 9 pid: 7232 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.157315:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878144:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.157330:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.161772:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.161831:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867542784:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 51867us (53417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.161840:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4577 00002000:00100000:3.0:1746142916.161851:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88013644f800 x1830962867542784/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.161860:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f800 with x1830962867542784 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.161865:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644f800 00000100:00100000:3.0:1746142916.161893:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543552 00000100:00100000:3.0:1746142916.161909:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543552 00000100:00100000:3.0:1746142916.161936:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14640 00000100:00100000:3.0:1746142916.161943:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32646:x1830962867543552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.161954:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.161966:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b155 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.161984:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.161986:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.161991:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.162004:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.162013:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3e600, rc 0) 00000100:00100000:3.0:1746142916.162319:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32646:x1830962867543552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 375us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.162324:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14640 00000100:00100000:0.0:1746142916.162989:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.163041:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.163054:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543936 00000100:00100000:0.0:1746142916.163057:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543936 00010000:00010000:0.0:1746142916.163073:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 28 pid: 7231 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.163090:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6635 00000100:00100000:0.0:1746142916.163095:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867543936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.163104:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.163108:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 28 pid: 7231 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.163116:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 28 pid: 7231 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.163130:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.163134:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.163140:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.163145:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.163149:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142916.163188:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0cf400/0x2fa243e067ccdf4e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b10f expref: 28 pid: 7231 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.163196:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867543808 00000100:00100000:3.0:1746142916.163199:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867543808 00000100:00100000:1.0:1746142916.163206:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878016:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.163217:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878144:192.168.204.50@tcp:104: 00002000:00100000:3.0:1746142916.163219:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1052671) req@ffff88013644ce00 x1830962867543808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.163226:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ce00 with x1830962867543808 ext(1048576->1052671) 00002000:00010000:3.0:1746142916.163229:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644ce00 00010000:00010000:1.0:1746142916.163237:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142916.164301:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4579 00000100:00100000:3.0:1746142916.164309:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867543808:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142916.164406:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867543808:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 98us (1417us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142916.164411:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4579 00002000:00100000:3.0:1746142916.164416:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1052671) req@ffff88013644ce00 x1830962867543808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.164423:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ce00 with x1830962867543808 ext(1048576->1052671) 00002000:00010000:3.0:1746142916.164426:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644ce00 00000100:00100000:3.0:1746142916.164491:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.164507:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544064 00000100:00100000:3.0:1746142916.164510:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544064 00010000:00010000:3.0:1746142916.164522:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 10 pid: 7232 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.164537:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6636 00000100:00100000:3.0:1746142916.164542:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867544064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.164549:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.164553:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 10 pid: 7232 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.164561:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 10 pid: 7232 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.164573:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1400/0x2fa243e067ccdf40 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b101 expref: 10 pid: 7232 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.164585:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.164588:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.164593:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.164598:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.164612:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.164625:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867544064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.164630:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6636 00000100:00100000:2.0:1746142916.165581:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867877888:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.165599:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.166402:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867543936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3303us (3356us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142916.166404:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142916.166411:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6635 00010000:00010000:3.0:1746142916.166412:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142916.166454:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142916.166458:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142916.166470:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166480:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166487:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166493:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166498:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166503:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098444600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.166506:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.166507:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867543296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9557us (10042us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142916.166511:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.166512:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6634 00010000:00010000:3.0:1746142916.166521:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.166524:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.166526:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166531:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067ccdfa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166540:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166544:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166549:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166553:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098445c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.166555:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166559:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166564:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091eb9500) 00010000:00010000:3.0:1746142916.166566:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.166568:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166572:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445c00/0x2fa243e067ccdfb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.166604:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445e00/0x2fa243e067ccdfa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.166614:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 7 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.166620:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.166622:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.166624:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445000, rc 0) 00000100:00100000:3.0:1746142916.166704:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:32647:x1830962867543424:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 9744us (9909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.166710:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14522 00000100:00100000:0.0:1746142916.170076:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.170108:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.170146:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.170179:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544448 00000100:00100000:0.0:1746142916.170185:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544448 00002000:00100000:0.0:1746142916.170220:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88013644f480 x1830962867544448/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.170228:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f480 with x1830962867544448 ext(1048576->2097151) 00002000:00010000:0.0:1746142916.170233:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644f480 00000100:00100000:0.0:1746142916.170271:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544704 00000100:00100000:0.0:1746142916.170273:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544704 00002000:00100000:0.0:1746142916.170285:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1413120->1417215) req@ffff88013644ca80 x1830962867544704/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.170292:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ca80 with x1830962867544704 ext(1413120->1417215) 00002000:00010000:0.0:1746142916.170295:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644ca80 00000100:00100000:0.0:1746142916.170307:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4580 00000100:00100000:0.0:1746142916.170313:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867544448:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.170846:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544192 00000100:00100000:3.0:1746142916.170850:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544192 00000100:00100000:3.0:1746142916.170877:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14641 00000100:00100000:3.0:1746142916.170882:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:32645:x1830962867544192:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.170891:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.170918:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b15c expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.170935:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.170936:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142916.170938:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4581 00010000:00010000:3.0:1746142916.170942:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.170946:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867544704:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:3.0:1746142916.170956:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.170965:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3e800, rc 0) 00000100:00100000:3.0:1746142916.171000:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:32645:x1830962867544192:12345-192.168.204.50@tcp:101:cat.0 Request processed in 117us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.171004:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867544704:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 60us (857us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142916.171006:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14641 00000100:00100000:2.0:1746142916.171009:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4581 00002000:00100000:2.0:1746142916.171013:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1413120->1417215) req@ffff88013644ca80 x1830962867544704/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.171020:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644ca80 with x1830962867544704 ext(1413120->1417215) 00002000:00010000:2.0:1746142916.171022:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644ca80 00000100:00100000:3.0:1746142916.175383:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.175685:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867544832 00000100:00100000:0.0:1746142916.175693:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867544832 00000100:00100000:0.0:1746142916.175729:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14642 00000100:00100000:0.0:1746142916.175735:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867544832:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142916.175749:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.175762:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131322a00/0x2fa243e067ccdfcc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b163 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.175805:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867878272:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142916.175871:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.181724:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.181798:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545088 00000100:00100000:2.0:1746142916.181808:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545088 00002000:00100000:2.0:1746142916.181854:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88011e13c380 x1830962867545088/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.181864:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13c380 with x1830962867545088 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.181869:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13c380 00000100:00100000:2.0:1746142916.181947:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4582 00000100:00100000:2.0:1746142916.181957:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867545088:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142916.190545:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867878272:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.190573:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131322a00/0x2fa243e067ccdfcc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b163 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.190585:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131322a00/0x2fa243e067ccdfcc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b163 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.190611:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322a00, rc 0) 00000100:00100000:1.0:1746142916.190651:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867544832:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 14915us (15273us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.190659:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14642 00000100:00100000:3.0:1746142916.202301:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.202323:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545600 00000100:00100000:3.0:1746142916.202330:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545600 00000100:00100000:3.0:1746142916.202367:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5315 00000100:00100000:3.0:1746142916.202374:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32644:x1830962867545600:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142916.202555:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32644:x1830962867545600:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 179us (261us total) trans 8589936708 rc 0/0 00000100:00100000:3.0:1746142916.202565:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5315 00000100:00100000:3.0:1746142916.202722:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867545088:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 20767us (21005us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142916.202948:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.203050:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545344 00000100:00100000:1.0:1746142916.203054:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545344 00000100:00100000:1.0:1746142916.203084:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14523 00000100:00100000:1.0:1746142916.203088:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+7:32647:x1830962867545344:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142916.203098:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.203112:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c200/0x2fa243e067ccdfd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b16a expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.203200:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867544448:12345-192.168.204.50@tcp:3:cat.0 Request processed in 32886us (33091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.203206:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4580 00002000:00100000:2.0:1746142916.203213:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88013644f480 x1830962867544448/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.203221:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f480 with x1830962867544448 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.203225:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644f480 00010000:00010000:1.0:1746142916.203229:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.203242:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.203253:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.203283:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.203293:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 8 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.203302:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878400:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.203369:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.205348:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4582 00002000:00100000:3.0:1746142916.205358:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88011e13c380 x1830962867545088/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.205366:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13c380 with x1830962867545088 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.205370:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13c380 00000100:00100000:0.0:1746142916.218766:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.219524:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545856 00000100:00100000:3.0:1746142916.219534:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545856 00002000:00100000:3.0:1746142916.219579:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1417216->2097151) req@ffff88011e13e300 x1830962867545856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.219589:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13e300 with x1830962867545856 ext(1417216->2097151) 00002000:00010000:3.0:1746142916.219594:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13e300 00000100:00100000:3.0:1746142916.219641:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4583 00000100:00100000:3.0:1746142916.219651:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867545856:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142916.228735:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.228768:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878400:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.228778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142916.228788:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.228811:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546112 00000100:00100000:2.0:1746142916.228816:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546112 00000100:00100000:2.0:1746142916.228848:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14643 00000100:00100000:2.0:1746142916.228854:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32646:x1830962867546112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.228869:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142916.228871:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867545984 00000100:00100000:3.0:1746142916.228877:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867545984 00010000:00010000:2.0:1746142916.228882:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b171 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.228913:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 9 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.228922:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 16 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.228929:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.228931:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746142916.228933:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6637 00010000:00010000:2.0:1746142916.228934:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.228941:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867545984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.228951:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.228956:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 16 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.228957:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 9 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.228965:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 16 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.228966:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 9 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.228974:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867878528:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.228984:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067ccdfb7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b14e expref: 9 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.229002:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.229007:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.229014:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.229019:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142916.229027:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00010000:00010000:3.0:1746142916.229030:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.229049:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:2003:x1830962867545984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.229054:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6637 00010000:00010000:1.0:1746142916.229553:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.229561:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142916.229579:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142916.229694:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c200/0x2fa243e067ccdfd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.229740:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.229747:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.229751:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746142916.229753:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495da00, rc 0) 00000100:00100000:1.0:1746142916.229782:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32647:x1830962867545344:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 26691us (26837us total) trans 8589936709 rc 0/0 00000100:00100000:1.0:1746142916.229789:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14523 00000100:00100000:2.0:1746142916.237656:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867878528:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.237683:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.237698:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36a00, rc 0) 00000100:00100000:2.0:1746142916.237746:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32646:x1830962867546112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8890us (8965us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.237754:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14643 00000100:00100000:0.0:1746142916.238293:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.238610:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2003:x1830962867545856:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 18960us (19854us total) trans 0 rc 679936/679936 00000100:00100000:3.0:1746142916.238617:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4583 00002000:00100000:3.0:1746142916.238625:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1417216->2097151) req@ffff88011e13e300 x1830962867545856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 679936/679936 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.238632:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13e300 with x1830962867545856 ext(1417216->2097151) 00010000:00010000:3.0:1746142916.238640:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 15 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.238652:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 15 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.238657:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e13e300 00000100:00100000:3.0:1746142916.238670:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546240 00000100:00100000:3.0:1746142916.238674:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546240 00002000:00100000:3.0:1746142916.238696:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1417215) req@ffff88011e13dc00 x1830962867546240/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.238703:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13dc00 with x1830962867546240 ext(1048576->1417215) 00010000:00010000:3.0:1746142916.238706:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 15 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.238714:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 15 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.238718:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e13dc00 00000100:00100000:3.0:1746142916.238745:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1423 00000100:00100000:3.0:1746142916.238752:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867546240:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142916.238870:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.239033:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546368 00000100:00100000:1.0:1746142916.239036:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546368 00000100:00100000:1.0:1746142916.239069:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14524 00000100:00100000:1.0:1746142916.239075:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32647:x1830962867546368:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142916.239086:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.239098:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c400/0x2fa243e067ccdfef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b178 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.239151:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.239162:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.239167:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.239187:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.239195:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 9 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.239204:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878656:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.239253:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.245285:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.245436:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.245457:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.245546:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546752 00000100:00100000:1.0:1746142916.245546:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546496 00000100:00100000:3.0:1746142916.245554:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546752 00000100:00100000:1.0:1746142916.245554:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546496 00000100:00100000:0.0:1746142916.245626:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.245669:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867878656:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142916.245687:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142916.245712:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546624 00000100:00100000:0.0:1746142916.245715:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546624 00000100:00100000:2.0:1746142916.245723:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14644 00000100:00100000:2.0:1746142916.245731:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867546752:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.245749:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.245762:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b18d expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.245780:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.245781:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.245788:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.245800:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.245808:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37200, rc 0) 00000100:00100000:2.0:1746142916.245839:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867546752:12345-192.168.204.50@tcp:101:cat.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.245921:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14645 00000100:00100000:0.0:1746142916.245928:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867546496:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.245934:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.245942:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098444600/0x2fa243e067cce004 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b17f expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.245973:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867878784:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.245989:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14646 00000100:00100000:1.0:1746142916.245995:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867546624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.246001:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.246007:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b186 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.246011:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746142916.246015:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.246016:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.246020:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.246028:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.246035:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495c000, rc 0) 00000100:00100000:1.0:1746142916.246049:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867546624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 55us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.246054:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14646 00000100:00100000:1.0:1746142916.246176:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867546880 00000100:00100000:1.0:1746142916.246179:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867546880 00010000:00010000:1.0:1746142916.246193:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 10 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.246215:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6638 00000100:00100000:1.0:1746142916.246220:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867546880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.246229:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.246234:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 10 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.246242:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 10 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.246256:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495da00/0x2fa243e067ccdfda lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b16a expref: 10 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.246278:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.246282:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.246289:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.246295:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142916.246305:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.246322:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2006:x1830962867546880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.246328:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6638 00000100:00100000:2.0:1746142916.246455:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14644 00010000:00010000:0.0:1746142916.246492:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.246498:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142916.246541:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:0.0:1746142916.246545:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142916.246556:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.246580:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495c400/0x2fa243e067ccdfef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.246605:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.246611:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.246613:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142916.246615:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009495d400, rc 0) 00000100:00100000:0.0:1746142916.246638:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32647:x1830962867546368:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 7563us (7768us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.246763:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14524 00000100:00100000:3.0:1746142916.247568:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867546240:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 8815us (9274us total) trans 21474841269 rc 0/0 00000100:00100000:3.0:1746142916.247575:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1423 00002000:00100000:3.0:1746142916.247582:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1417215) req@ffff88011e13dc00 x1830962867546240/t21474841269(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.247590:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13dc00 with x1830962867546240 ext(1048576->1417215) 00010000:00010000:3.0:1746142916.247596:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.247726:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.247734:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011e13dc00 00000100:00100000:2.0:1746142916.248506:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867878784:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.248526:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098444600/0x2fa243e067cce004 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b17f expref: 19 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.248535:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098444600/0x2fa243e067cce004 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b17f expref: 19 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.248556:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098444600, rc 0) 00000100:00100000:2.0:1746142916.248586:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867546496:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2658us (3308us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.248594:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14645 00000100:00100000:0.0:1746142916.248880:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.249084:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547008 00000100:00100000:2.0:1746142916.249089:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547008 00000100:00100000:2.0:1746142916.249113:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14647 00000100:00100000:2.0:1746142916.249118:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867547008:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142916.249128:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.249136:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cce012 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b194 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.249177:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867878912:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142916.249232:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.250946:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867878912:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.250966:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cce012 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b194 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.250976:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067cce012 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b194 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.250984:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37c00, rc 0) 00000100:00100000:2.0:1746142916.251007:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867547008:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1888us (2128us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.251014:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14647 00000100:00100000:0.0:1746142916.251784:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.251875:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547136 00000100:00100000:1.0:1746142916.251881:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547136 00010000:00010000:1.0:1746142916.252140:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 18 pid: 1852 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.252165:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6639 00000100:00100000:1.0:1746142916.252172:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867547136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.252181:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.252189:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 18 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.252198:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 18 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.252213:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37400/0x2fa243e067ccdf9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1417215) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b147 expref: 18 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.252221:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.252223:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.252228:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.252234:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.252270:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 35 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.252279:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867879040:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142916.252605:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.252659:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547392 00000100:00100000:2.0:1746142916.252662:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547392 00000100:00100000:1.0:1746142916.252738:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.252925:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14525 00000100:00100000:2.0:1746142916.252931:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32647:x1830962867547392:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142916.252942:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.252953:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x2fa243e067cce019 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b19b expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.253019:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253028:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253035:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253043:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253048:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253052:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253056:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a37600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142916.253059:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253064:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253070:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.253072:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142916.253075:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253079:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37600/0x2fa243e067cce020 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.253097:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x2fa243e067cce019 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b19b expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.253103:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a37a00/0x2fa243e067cce019 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b19b expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.253109:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37a00, rc 0) 00000100:00100000:2.0:1746142916.253135:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32647:x1830962867547392:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 203us (530us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.253140:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14525 00000100:00100000:2.0:1746142916.255274:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.255665:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867879040:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142916.255681:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.255709:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867547136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3538us (3926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.255716:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6639 00000100:00100000:3.0:1746142916.255956:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547648 00000100:00100000:3.0:1746142916.255962:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547648 00000100:00100000:3.0:1746142916.255988:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5316 00000100:00100000:3.0:1746142916.255995:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:32647:x1830962867547648:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1746142916.256445:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32647:x1830962867547648:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 450us (1183us total) trans 8589936710 rc 0/0 00000100:00100000:3.0:1746142916.256452:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5316 00000100:00100000:0.0:1746142916.257934:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.258048:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867547776 00000100:00100000:2.0:1746142916.258054:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867547776 00000100:00100000:2.0:1746142916.258083:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14648 00000100:00100000:2.0:1746142916.258089:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32640:x1830962867547776:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142916.258100:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.258113:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1a2 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.258136:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.258143:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.258154:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.258160:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.258162:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.258166:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [122880->1048575] (req 122880->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.258467:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142916.258524:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 16 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.258535:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 16 pid: 1397 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.258546:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009862dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867879168:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.258637:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548032 00000100:00100000:3.0:1746142916.258641:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548032 00002000:00100000:3.0:1746142916.258667:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093bcdf80 x1830962867548032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.258676:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcdf80 with x1830962867548032 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.258680:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcdf80 00000100:00100000:3.0:1746142916.258694:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4584 00000100:00100000:3.0:1746142916.258699:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867548032:12345-192.168.204.50@tcp:3:multiop.0 00010000:00010000:2.0:1746142916.259126:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 39 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.259134:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 39 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.259141:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867879296:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.259166:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 11 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.259177:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 11 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.259185:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867879424:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.259547:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.264801:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.264835:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.264928:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.264977:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009862dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867879168:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.265218:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867879296:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.265225:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867879424:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.265250:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [122880->1048575] (req 122880->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 39 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.265274:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a36e00, rc 0) 00000100:00100000:3.0:1746142916.265315:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32640:x1830962867547776:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7226us (7385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.265322:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14648 00000100:00100000:2.0:1746142916.265427:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548416 00000100:00100000:2.0:1746142916.265433:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548416 00000100:00100000:1.0:1746142916.265451:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548544 00000100:00100000:1.0:1746142916.265454:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548544 00002000:00100000:2.0:1746142916.265461:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13d880 x1830962867548416/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.265466:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88011e13d180 x1830962867548544/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.265469:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d880 with x1830962867548416 ext(2097152->4194303) 00002000:00100000:1.0:1746142916.265472:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d180 with x1830962867548544 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.265473:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13d880 00002000:00010000:1.0:1746142916.265475:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13d180 00000100:00100000:2.0:1746142916.265487:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4585 00000100:00100000:2.0:1746142916.265493:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867548416:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142916.265498:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4586 00000100:00100000:1.0:1746142916.265501:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867548544:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.266242:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548672 00000100:00100000:0.0:1746142916.266246:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548672 00010000:00010000:0.0:1746142916.266272:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 19 pid: 1397 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.266290:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6640 00000100:00100000:0.0:1746142916.266294:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867548672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.266302:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.266313:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 19 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.266323:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 19 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.266341:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d951a00/0x2fa243e067ccdf2b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0fa expref: 19 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.266361:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.266383:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867548672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.266387:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6640 00000100:00100000:0.0:1746142916.269369:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.269392:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.269413:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548928 00000100:00100000:0.0:1746142916.269420:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548928 00010000:00010000:0.0:1746142916.269446:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 12 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746142916.269473:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867548800 00000100:00100000:0.0:1746142916.269475:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867548800 00010000:00010000:0.0:1746142916.269483:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 39 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.269499:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6641 00000100:00100000:0.0:1746142916.269505:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867548928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.269515:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.269530:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 12 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.269543:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 12 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.269564:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e690600/0x2fa243e067ccde6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0bb expref: 12 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.269576:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.269601:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867548928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.269607:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6641 00000100:00100000:0.0:1746142916.269621:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6642 00000100:00100000:0.0:1746142916.269626:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867548800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.269631:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.269640:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 39 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.269648:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 39 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.269658:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098290000/0x2fa243e067ccdf32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b108 expref: 39 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.269667:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.269668:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.269673:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 38 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.269681:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 38 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.269711:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 38 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.269720:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092407800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867879552:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142916.269756:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.271799:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867548032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 13093us (13326us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.271809:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4584 00002000:00100000:3.0:1746142916.271818:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093bcdf80 x1830962867548032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.271826:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcdf80 with x1830962867548032 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.271830:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcdf80 00000100:00100000:2.0:1746142916.277357:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092407800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867879552:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.277379:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.277444:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867548800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7816us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.277453:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6642 00000100:00100000:0.0:1746142916.278587:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.278628:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.278632:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867549184 00000100:00100000:3.0:1746142916.278638:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867549184 00002000:00100000:3.0:1746142916.278670:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (122880->126975) req@ffff880092407100 x1830962867549184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.278679:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407100 with x1830962867549184 ext(122880->126975) 00002000:00010000:3.0:1746142916.278683:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407100 00000100:00100000:0.0:1746142916.278686:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.278699:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867549312 00000100:00100000:3.0:1746142916.278701:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4587 00000100:00100000:0.0:1746142916.278702:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867549312 00000100:00100000:3.0:1746142916.278707:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867549184:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142916.278717:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867549440 00000100:00100000:0.0:1746142916.278718:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867549440 00000100:00100000:0.0:1746142916.278729:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14649 00000100:00100000:0.0:1746142916.278733:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867549312:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.278740:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.278752:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1a9 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.278766:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.278767:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.278773:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 38 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.278785:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 38 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.278793:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445e00, rc 0) 00000100:00100000:3.0:1746142916.278800:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867549184:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 92us (215us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142916.278806:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867549312:12345-192.168.204.50@tcp:101:cat.0 Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.278811:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14649 00000100:00100000:0.0:1746142916.278820:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14650 00000100:00100000:0.0:1746142916.278824:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2005:x1830962867549440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.278830:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.278838:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1b0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.278848:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.278850:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.278854:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.278866:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.278873:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098444400, rc 0) 00000100:00100000:0.0:1746142916.278886:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867549440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 61us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.278890:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14650 00000100:00100000:3.0:1746142916.279208:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4587 00002000:00100000:3.0:1746142916.279214:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (122880->126975) req@ffff880092407100 x1830962867549184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.279221:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092407100 with x1830962867549184 ext(122880->126975) 00002000:00010000:3.0:1746142916.279224:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092407100 00000100:00100000:1.0:1746142916.285373:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867548544:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19859us (20526us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142916.285383:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4586 00002000:00100000:1.0:1746142916.285393:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88011e13d180 x1830962867548544/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.285402:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d180 with x1830962867548544 ext(2097152->4194303) 00002000:00010000:1.0:1746142916.285407:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13d180 00000100:00100000:0.0:1746142916.295737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.295766:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.296000:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:2003:x1830962867548416:12345-192.168.204.50@tcp:3:cat.0 Request processed in 30505us (31204us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142916.296009:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4585 00002000:00100000:2.0:1746142916.296018:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88011e13d880 x1830962867548416/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.296033:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13d880 with x1830962867548416 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.296037:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13d880 00000100:00100000:2.0:1746142916.296053:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867549696 00000100:00100000:2.0:1746142916.296058:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867549696 00002000:00100000:2.0:1746142916.296080:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880092404700 x1830962867549696/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.296086:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404700 with x1830962867549696 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.296088:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404700 00000100:00100000:2.0:1746142916.296097:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867549952 00000100:00100000:2.0:1746142916.296099:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867549952 00002000:00100000:2.0:1746142916.296106:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092404000 x1830962867549952/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.296112:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404000 with x1830962867549952 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.296114:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092404000 00000100:00100000:2.0:1746142916.296122:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4588 00000100:00100000:2.0:1746142916.296127:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867549696:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.296948:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4589 00000100:00100000:3.0:1746142916.296956:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867549952:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.315393:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867549696:12345-192.168.204.50@tcp:3:cat.0 Request processed in 19258us (19657us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142916.315403:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4588 00002000:00100000:2.0:1746142916.315412:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880092404700 x1830962867549696/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.315421:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404700 with x1830962867549696 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.315426:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404700 00000100:00100000:0.0:1746142916.320409:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.320442:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.320663:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550080 00000100:00100000:3.0:1746142916.320672:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550080 00000100:00100000:3.0:1746142916.320704:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550208 00000100:00100000:3.0:1746142916.320705:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550208 00000100:00100000:3.0:1746142916.320718:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14651 00000100:00100000:3.0:1746142916.320725:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867550080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.320763:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.320778:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cce03c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1b7 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.320820:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867879680:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142916.320895:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3540 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.320940:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14652 00000100:00100000:3.0:1746142916.320945:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867550208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.320952:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.320958:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1be expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.320969:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.320971:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.320978:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 19 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.323010:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 19 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.323021:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6600, rc 0) 00000100:00100000:3.0:1746142916.323069:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867550208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2123us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.323075:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14652 00000100:00100000:3.0:1746142916.323720:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867549952:12345-192.168.204.50@tcp:3:cat.0 Request processed in 26764us (27952us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142916.323727:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4589 00002000:00100000:3.0:1746142916.323733:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880092404000 x1830962867549952/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.323742:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404000 with x1830962867549952 ext(2097152->4194303) 00002000:00010000:3.0:1746142916.323745:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092404000 00000100:00100000:0.0:1746142916.324289:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.324371:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550336 00000100:00100000:2.0:1746142916.324377:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550336 00000100:00100000:2.0:1746142916.324402:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14653 00000100:00100000:2.0:1746142916.324408:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32640:x1830962867550336:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142916.324420:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.324432:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1c5 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.324451:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.324458:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.324464:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.324470:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.324471:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.324474:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 37 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.324496:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.324506:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 21 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.324521:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867879808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.324580:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 37 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.324588:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.324595:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867879936:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.324618:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 15 pid: 1853 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142916.324762:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867879680:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.324780:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cce03c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b7 expref: 18 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.324788:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cce03c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b7 expref: 18 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.324801:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe7400, rc 0) 00000100:00100000:3.0:1746142916.324830:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867550080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4105us (4427us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.324835:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14651 00010000:00010000:2.0:1746142916.325017:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 15 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.325025:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867880064:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.325358:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.329042:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867879808:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.329052:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867879936:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142916.331850:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.331882:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.332130:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550592 00000100:00100000:2.0:1746142916.332137:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550592 00010000:00010000:2.0:1746142916.332168:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 38 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.332194:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550464 00000100:00100000:2.0:1746142916.332197:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550464 00010000:00010000:2.0:1746142916.332205:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 22 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.332218:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6643 00000100:00100000:2.0:1746142916.332229:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867550592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.332239:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.332266:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 38 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.332327:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6644 00000100:00100000:3.0:1746142916.332335:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867550464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.332341:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.332351:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 22 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.332361:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 22 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.332394:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebec00/0x2fa243e067ccdf71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b124 expref: 22 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.332411:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.334299:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867550464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1957us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.334308:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6644 00000100:00100000:3.0:1746142916.334385:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867880064:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.334410:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->1093631] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 38 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.334427:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4a00, rc 0) 00010000:00010000:2.0:1746142916.334502:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 38 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.334519:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebfc00/0x2fa243e067ccdf86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b139 expref: 38 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.334532:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.336972:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.336994:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550720 00000100:00100000:0.0:1746142916.337000:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550720 00010000:00010000:0.0:1746142916.337022:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 16 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:0.0:1746142916.337043:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6645 00000100:00100000:0.0:1746142916.337049:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867550720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.337060:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.337075:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 16 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.337089:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 16 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.337105:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e690e00/0x2fa243e067ccde8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c2 expref: 16 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.337114:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.337116:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.337122:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 37 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.337129:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 37 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.337152:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 37 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.337162:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092405c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867880192:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142916.337208:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.337607:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32640:x1830962867550336:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 13197us (13316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.337615:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14653 00000100:00100000:2.0:1746142916.337822:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962867550592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5592us (5976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.337829:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6643 00000100:00100000:0.0:1746142916.338596:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.338648:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.338732:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867551104 00000100:00100000:3.0:1746142916.338736:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867551104 00002000:00100000:3.0:1746142916.338763:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092405180 x1830962867551104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.338771:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405180 with x1830962867551104 ext(4194304->5066751) 00002000:00010000:3.0:1746142916.338775:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405180 00000100:00100000:3.0:1746142916.338789:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4590 00000100:00100000:3.0:1746142916.338794:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867551104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.339268:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867550848 00000100:00100000:3.0:1746142916.339271:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867550848 00000100:00100000:3.0:1746142916.339289:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14654 00000100:00100000:3.0:1746142916.339293:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867550848:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.339301:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.339316:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cce051 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1cc expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.340456:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092405c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867880192:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142916.340471:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.340495:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867550720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3446us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.340505:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6645 00000100:00100000:3.0:1746142916.341608:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867880320:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142916.342838:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098dd3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.343824:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.343889:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867551360 00000100:00100000:2.0:1746142916.343917:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867551360 00002000:00100000:2.0:1746142916.343950:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1089536->1093631) req@ffff880092405c00 x1830962867551360/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.343965:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405c00 with x1830962867551360 ext(1089536->1093631) 00002000:00010000:2.0:1746142916.343969:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092405c00 00000100:00100000:2.0:1746142916.343986:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4591 00000100:00100000:2.0:1746142916.343994:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867551360:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.344133:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867551360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 139us (312us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142916.344139:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4591 00002000:00100000:2.0:1746142916.344144:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1089536->1093631) req@ffff880092405c00 x1830962867551360/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.344150:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405c00 with x1830962867551360 ext(1089536->1093631) 00002000:00010000:2.0:1746142916.344153:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092405c00 00000100:00100000:2.0:1746142916.346079:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867880320:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.346105:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cce051 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1cc expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.346122:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6200/0x2fa243e067cce051 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1cc expref: 37 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.346135:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6200, rc 0) 00000100:00100000:3.0:1746142916.346143:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867551104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7348us (7494us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142916.346153:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4590 00002000:00100000:3.0:1746142916.346160:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092405180 x1830962867551104/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.346167:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092405180 with x1830962867551104 ext(4194304->5066751) 00002000:00010000:3.0:1746142916.346171:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092405180 00000100:00100000:2.0:1746142916.346363:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867550848:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7067us (7765us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.346369:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14654 00000100:00100000:0.0:1746142916.346413:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.346531:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867551616 00000100:00100000:3.0:1746142916.346535:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867551616 00000100:00100000:3.0:1746142916.346563:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5317 00000100:00100000:3.0:1746142916.346569:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32640:x1830962867551616:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142916.346723:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32640:x1830962867551616:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 153us (309us total) trans 8589936711 rc 0/0 00000100:00100000:3.0:1746142916.346729:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5317 00000100:00100000:0.0:1746142916.349783:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.349948:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.349994:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867551872 00000100:00100000:2.0:1746142916.350002:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867551872 00000100:00100000:0.0:1746142916.350014:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.350414:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867551744 00000100:00100000:2.0:1746142916.350417:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867551744 00000100:00100000:2.0:1746142916.350433:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14655 00000100:00100000:2.0:1746142916.350439:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867551872:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142916.350440:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14656 00000100:00100000:0.0:1746142916.350445:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867551744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.350453:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.350453:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.350466:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2800/0x2fa243e067cce058 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1da expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.350466:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098445800/0x2fa243e067cce05f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1d3 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.350501:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867880576:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142916.350501:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867880448:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142916.350552:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.350602:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867552128 00000100:00100000:3.0:1746142916.350605:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867552128 00002000:00100000:3.0:1746142916.350624:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092404a80 x1830962867552128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.350632:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404a80 with x1830962867552128 ext(4194304->5066751) 00002000:00010000:3.0:1746142916.350636:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404a80 00000100:00100000:3.0:1746142916.350652:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4592 00000100:00100000:3.0:1746142916.350657:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867552128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.350665:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.353173:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867880448:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142916.353200:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098445800/0x2fa243e067cce05f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1d3 expref: 18 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.353212:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098445800/0x2fa243e067cce05f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1d3 expref: 18 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.353236:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445800, rc 0) 00000100:00100000:0.0:1746142916.353280:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867551744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2834us (3264us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142916.353290:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14656 00000100:00100000:2.0:1746142916.355298:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867880576:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.355323:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2800/0x2fa243e067cce058 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1da expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.355334:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2800/0x2fa243e067cce058 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1da expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.355343:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d2800, rc 0) 00000100:00100000:2.0:1746142916.355385:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867551872:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4945us (5436us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.355392:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14655 00000100:00100000:3.0:1746142916.356870:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867552128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6208us (7091us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142916.356878:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4592 00002000:00100000:3.0:1746142916.356888:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092404a80 x1830962867552128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.356895:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404a80 with x1830962867552128 ext(4194304->5066751) 00002000:00010000:3.0:1746142916.356916:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092404a80 00000100:00100000:0.0:1746142916.357748:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.357816:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.357933:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867552256 00000100:00100000:2.0:1746142916.357940:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867552256 00000100:00100000:2.0:1746142916.357973:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867552384 00000100:00100000:2.0:1746142916.357976:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867552384 00000100:00100000:2.0:1746142916.358000:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14657 00000100:00100000:2.0:1746142916.358006:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867552256:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1746142916.358013:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14658 00000100:00100000:1.0:1746142916.358018:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867552384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.358019:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.358025:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.358031:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067cce066 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1e1 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.358032:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092130600/0x2fa243e067cce06d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1e8 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.358065:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867880832:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142916.358066:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867880704:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.358418:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.358448:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.362492:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.362544:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867552640 00000100:00100000:3.0:1746142916.362552:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867552640 00000100:00100000:3.0:1746142916.362594:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5318 00000100:00100000:3.0:1746142916.362600:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32646:x1830962867552640:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142916.362692:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867880832:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.362718:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092130600/0x2fa243e067cce06d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1e8 expref: 22 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.362727:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092130600/0x2fa243e067cce06d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1e8 expref: 22 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.362738:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092130600, rc 0) 00000100:00100000:3.0:1746142916.362741:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32646:x1830962867552640:12345-192.168.204.50@tcp:35:cat.0 Request processed in 142us (257us total) trans 8589936712 rc 0/0 00000100:00100000:3.0:1746142916.362747:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5318 00000100:00100000:1.0:1746142916.362752:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2003:x1830962867552384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4735us (4967us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.362757:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14658 00000100:00100000:2.0:1746142916.362833:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867880704:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.362848:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067cce066 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1e1 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.362856:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3000/0x2fa243e067cce066 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1e1 expref: 18 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.362863:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3000, rc 0) 00000100:00100000:2.0:1746142916.362888:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867552256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4882us (5141us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.362896:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14657 00000100:00100000:0.0:1746142916.368483:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.368529:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867552896 00000100:00100000:3.0:1746142916.368537:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867552896 00000100:00100000:3.0:1746142916.368580:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5319 00000100:00100000:3.0:1746142916.368588:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:32645:x1830962867552896:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142916.368736:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:32645:x1830962867552896:12345-192.168.204.50@tcp:35:cat.0 Request processed in 149us (260us total) trans 8589936713 rc 0/0 00000100:00100000:3.0:1746142916.368742:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5319 00000100:00100000:0.0:1746142916.375660:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.376575:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553024 00000100:00100000:3.0:1746142916.376583:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553024 00000100:00100000:3.0:1746142916.376743:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14526 00000100:00100000:3.0:1746142916.376750:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:32652:x1830962867553024:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142916.376770:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.376783:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067cce074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1ef expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.376830:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376840:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376848:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376858:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376863:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376868:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376962:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376970:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.376975:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142916.377003:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142916.377006:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142916.377017:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377025:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377031:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377036:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377040:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377045:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377050:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe6a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.377053:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377058:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377066:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.377068:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.377072:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377076:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6a00/0x2fa243e067cce07b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377085:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377089:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377093:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377098:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe7a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.377100:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377105:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377110:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b4b46300) 00010000:00010000:3.0:1746142916.377112:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.377114:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377118:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe7a00/0x2fa243e067cce082 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.377141:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6400/0x2fa243e067cce074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1ef expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.377150:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1ef expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.377155:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.377157:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.377159:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cd200, rc 0) 00000100:00100000:3.0:1746142916.377205:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:32652:x1830962867553024:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 455us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.377211:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14526 00000100:00100000:0.0:1746142916.379995:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.380251:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.380351:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553280 00000100:00100000:3.0:1746142916.380358:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553280 00000100:00100000:3.0:1746142916.380399:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14659 00000100:00100000:3.0:1746142916.380405:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867553280:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142916.380418:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.380431:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974cc200/0x2fa243e067cce090 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1f6 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.380468:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867880960:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142916.380479:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.380506:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553152 00000100:00100000:2.0:1746142916.380510:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553152 00000100:00100000:2.0:1746142916.380534:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 783 00000100:00100000:2.0:1746142916.380538:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867553152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.380546:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.380566:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd200/0x2fa243e067cce089 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1ef expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.380585:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.380589:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.380768:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553408 00000100:00100000:2.0:1746142916.380770:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:2004:x1830962867553152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 230us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.380771:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553408 00000100:00100000:2.0:1746142916.380775:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 783 00000100:00100000:1.0:1746142916.380789:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14660 00000100:00100000:1.0:1746142916.380793:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867553408:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142916.380799:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142916.380815:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746142916.380881:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092131200/0x2fa243e067cce097 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b1fd expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.380919:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867881088:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.380944:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.381059:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.381137:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553536 00000100:00100000:1.0:1746142916.381141:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553536 00000100:00100000:1.0:1746142916.381166:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14661 00000100:00100000:1.0:1746142916.381171:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867553536:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142916.381177:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.381183:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b204 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.381193:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.381195:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.381201:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.381213:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 14 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.381220:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fb200, rc 0) 00000100:00100000:1.0:1746142916.381248:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867553536:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.381265:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14661 00000100:00100000:1.0:1746142916.382380:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867881088:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142916.382381:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867880960:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.382399:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974cc200/0x2fa243e067cce090 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1f6 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.382399:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092131200/0x2fa243e067cce097 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1fd expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.382408:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974cc200/0x2fa243e067cce090 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1f6 expref: 13 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.382408:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092131200/0x2fa243e067cce097 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1fd expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.382416:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc200, rc 0) 00000100:00100000:3.0:1746142916.382438:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867553280:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2033us (2187us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.382444:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14659 00010000:00010000:1.0:1746142916.382658:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092131200, rc 0) 00000100:00100000:1.0:1746142916.382689:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867553408:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1894us (2391us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.382693:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14660 00000100:00100000:0.0:1746142916.384055:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.384504:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553792 00000100:00100000:2.0:1746142916.384510:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553792 00000100:00100000:2.0:1746142916.384564:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14527 00000100:00100000:2.0:1746142916.384570:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32652:x1830962867553792:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142916.384582:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.384595:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cce0a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b20b expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.384662:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.384672:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.384679:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.384701:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.384711:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 10 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.384719:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867881216:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.385109:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.385989:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.386050:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867881216:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.386064:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142916.386103:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867553920 00000100:00100000:3.0:1746142916.386107:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867553920 00010000:00010000:3.0:1746142916.386124:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.386140:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6646 00000100:00100000:3.0:1746142916.386145:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867553920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.386153:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.386157:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.386164:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.386178:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009495d400/0x2fa243e067ccdff6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b178 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.386190:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.386198:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.386204:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.386210:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.386344:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142916.386402:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.386408:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142916.386419:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142916.386501:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cce0a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.386502:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867553920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 356us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.386509:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6646 00010000:00010000:0.0:1746142916.386586:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.386592:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.386594:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142916.386596:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3200, rc 0) 00000100:00100000:0.0:1746142916.386618:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32652:x1830962867553792:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2048us (2565us total) trans 8589936714 rc 0/0 00000100:00100000:0.0:1746142916.386623:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14527 00000100:00100000:2.0:1746142916.388233:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.388300:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554048 00000100:00100000:0.0:1746142916.388305:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554048 00000100:00100000:0.0:1746142916.388370:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14528 00000100:00100000:0.0:1746142916.388377:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32652:x1830962867554048:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142916.388393:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.388404:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067cce0ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b212 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.388458:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.388466:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.388471:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.388491:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.388500:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.388509:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867881344:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142916.388845:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.390072:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867881344:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.390094:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142916.390553:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.390677:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554176 00000100:00100000:3.0:1746142916.390682:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554176 00010000:00010000:3.0:1746142916.390698:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 12 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.390726:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6647 00000100:00100000:3.0:1746142916.390733:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867554176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.390741:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.390745:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 12 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.390754:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 12 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.390769:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3200/0x2fa243e067cce0ac lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b20b expref: 12 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.390780:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.390784:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.390791:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.390796:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.390820:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.390856:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867554176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 123us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.390862:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6647 00010000:00010000:0.0:1746142916.390926:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.390932:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142916.390964:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:0.0:1746142916.390968:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142916.390979:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142916.390999:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098444600/0x2fa243e067cce0ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b212 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.391009:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b212 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.391015:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.391017:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142916.391020:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098445000, rc 0) 00000100:00100000:0.0:1746142916.391051:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32652:x1830962867554048:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2674us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.391057:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14528 00000100:00100000:0.0:1746142916.392881:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.393128:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.393199:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554432 00000100:00100000:1.0:1746142916.393204:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554432 00000100:00100000:1.0:1746142916.393769:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554304 00000100:00100000:1.0:1746142916.393773:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554304 00000100:00100000:1.0:1746142916.393795:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14662 00000100:00100000:1.0:1746142916.393801:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867554432:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142916.393815:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.393827:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4fae00/0x2fa243e067cce0c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b220 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.393863:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867881472:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.393928:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.394052:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14663 00000100:00100000:0.0:1746142916.394059:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867554304:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1746142916.394067:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.394079:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f38e600/0x2fa243e067cce0cf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b219 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.394102:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867881600:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142916.394132:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.395489:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9579:1830962867881472:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.395508:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4fae00/0x2fa243e067cce0c8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b220 expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.395518:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4fae00/0x2fa243e067cce0c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b220 expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.395529:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4fae00, rc 0) 00000100:00100000:1.0:1746142916.395551:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867554432:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1750us (2675us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.395557:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14662 00000100:00100000:2.0:1746142916.395759:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867881600:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.395775:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f38e600/0x2fa243e067cce0cf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b219 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.395783:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f38e600/0x2fa243e067cce0cf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b219 expref: 13 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.395792:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f38e600, rc 0) 00000100:00100000:2.0:1746142916.396059:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867554304:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2000us (2930us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.396065:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14663 00000100:00100000:0.0:1746142916.398206:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.398363:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554688 00000100:00100000:2.0:1746142916.398369:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554688 00000100:00100000:2.0:1746142916.398507:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14529 00000100:00100000:2.0:1746142916.398516:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32652:x1830962867554688:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142916.398529:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.398544:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067cce0d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b227 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.398625:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.398636:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.398645:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142916.398655:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142916.398730:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3400/0x2fa243e067cce0d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.398742:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.398748:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.398751:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142916.398753:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3e00, rc 0) 00000100:00100000:2.0:1746142916.398800:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32652:x1830962867554688:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 285us (598us total) trans 8589936715 rc 0/0 00000100:00100000:2.0:1746142916.398805:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14529 00000100:00100000:0.0:1746142916.400524:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.400558:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.400667:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.400781:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.400796:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554944 00000100:00100000:3.0:1746142916.400802:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554944 00000100:00100000:3.0:1746142916.400826:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555200 00000100:00100000:3.0:1746142916.400828:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555200 00000100:00100000:3.0:1746142916.400843:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555456 00000100:00100000:3.0:1746142916.400846:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555456 00000100:00100000:3.0:1746142916.400858:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14664 00000100:00100000:3.0:1746142916.400865:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867554944:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142916.400893:0:9578:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.400927:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.400934:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142916.400935:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142916.400938:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.400961:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.400972:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 35 pid: 1397 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.400983:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867881728:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.401030:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.401047:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14665 00000100:00100000:3.0:1746142916.401052:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867555200:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142916.401069:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.401081:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.401088:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401095:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401100:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.401101:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.401103:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.401116:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401123:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 16 pid: 9579 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.401131:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867881856:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.401154:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 12 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401162:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 12 pid: 9578 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.401172:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867881984:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.401194:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 36 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.401201:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 36 pid: 1854 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.401209:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867882112:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.401224:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.401247:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14666 00000100:00100000:3.0:1746142916.401252:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867555456:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142916.401276:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.401285:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401291:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 35 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401297:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 20 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401301:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.401302:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.401304:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.401318:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 20 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401326:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 20 pid: 1397 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.401333:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867882240:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.401356:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 35 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401363:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 35 pid: 1397 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.401370:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867882368:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.401390:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 16 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.401397:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 16 pid: 11943 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.401404:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867882496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.401418:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f77a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.401806:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867554816 00000100:00100000:1.0:1746142916.401811:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867554816 00000100:00100000:0.0:1746142916.401839:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.401975:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.402071:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555072 00000100:00100000:3.0:1746142916.402074:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555072 00000100:00100000:3.0:1746142916.402086:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555328 00000100:00100000:3.0:1746142916.402088:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555328 00000100:00100000:3.0:1746142916.402097:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14667 00000100:00100000:3.0:1746142916.402102:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867554816:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142916.402116:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402125:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 36 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402131:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142916.402132:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142916.402134:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402148:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 36 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402155:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 36 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.402162:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867882624:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.402209:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.402222:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14668 00000100:00100000:3.0:1746142916.402228:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867555072:12345-192.168.204.50@tcp:1:lfs.0 00000100:00100000:2.0:1746142916.402229:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14669 00000100:00100000:2.0:1746142916.402238:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867555328:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142916.402242:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402251:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.402268:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402274:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402279:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.402280:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.402282:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402297:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 35 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402303:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 35 pid: 1852 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.402311:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867882752:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.402337:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.402344:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.402356:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867882880:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.402377:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 17 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.402384:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 17 pid: 1854 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.402391:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867883008:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.402407:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f77cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746142916.403469:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.403485:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.403494:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.403501:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 16 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.403507:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.403508:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.403510:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.403530:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 16 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.403566:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 16 pid: 1852 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.403575:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867883136:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.404095:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 36 pid: 1397 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746142916.404273:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.404304:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142916.404349:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 36 pid: 1397 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.404357:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867883264:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.404394:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.404403:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 14 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.404410:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867883392:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.404426:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009864d300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.404441:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555584 00000100:00100000:2.0:1746142916.404446:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555584 00000100:00100000:3.0:1746142916.404880:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867881856:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.404889:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867881984:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.404916:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555712 00000100:00100000:3.0:1746142916.404919:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555712 00010000:00010000:3.0:1746142916.404937:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 15 pid: 9578 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.404970:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6648 00000100:00100000:3.0:1746142916.404977:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867555712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.404987:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.406864:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 17 pid: 9579 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.406896:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6649 00000100:00100000:2.0:1746142916.406918:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2003:x1830962867555584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.406927:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.406937:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 17 pid: 9579 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.406947:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 17 pid: 9579 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.406965:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6600/0x2fa243e067cce043 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1be expref: 17 pid: 9579 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.406979:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142916.407065:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 15 pid: 9578 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.407076:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 15 pid: 9578 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.407088:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c4fb200/0x2fa243e067cce09e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b204 expref: 15 pid: 9578 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.407365:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2003:x1830962867555584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 448us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.407372:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6649 00010000:00010000:3.0:1746142916.407427:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.407739:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867555712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2760us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.407745:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6648 00000100:00100000:3.0:1746142916.413252:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867883008:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.413290:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867882112:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142916.413317:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142916.413318:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.413351:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555840 00000100:00100000:3.0:1746142916.413356:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555840 00000100:00100000:0.0:1746142916.413375:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.413376:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11421:1830962867882624:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.413388:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.413389:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.413402:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.413407:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867882752:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.413414:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867882880:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142916.413416:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142916.413426:0:12211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.413444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.413446:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556224 00000100:00100000:3.0:1746142916.413448:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556224 00000100:00100000:0.0:1746142916.413457:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.413468:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556608 00000100:00100000:0.0:1746142916.413471:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556608 00002000:00100000:3.0:1746142916.413477:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (122880->1048575) req@ffff880092135f80 x1830962867556224/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.413487:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135f80 with x1830962867556224 ext(122880->1048575) 00010000:00010000:0.0:1746142916.413487:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 21 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.413492:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.413502:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.413504:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556096 00000100:00100000:0.0:1746142916.413506:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556096 00002000:00010000:3.0:1746142916.413508:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092135f80 00010000:00010000:0.0:1746142916.413515:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 38 pid: 1854 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.413521:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867555968 00000100:00100000:0.0:1746142916.413522:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556352 00000100:00100000:3.0:1746142916.413523:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867555968 00000100:00100000:0.0:1746142916.413524:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556352 00010000:00010000:0.0:1746142916.413530:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 19 pid: 11943 timeout: 790 lvb_type: 1 00002000:00100000:3.0:1746142916.413533:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1093631) req@ffff880092135880 x1830962867555968/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.413540:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135880 with x1830962867555968 ext(1048576->1093631) 00000100:00100000:0.0:1746142916.413541:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556480 00000100:00100000:0.0:1746142916.413542:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556480 00010000:00010000:3.0:1746142916.413545:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 37 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.413548:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 37 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.413553:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 37 pid: 1397 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.413557:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6650 00002000:00010000:3.0:1746142916.413558:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092135880 00000100:00100000:0.0:1746142916.413564:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867556608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142916.413570:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1424 00010000:00010000:0.0:1746142916.413573:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142916.413575:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867556224:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:0.0:1746142916.413589:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 21 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.413597:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 21 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.413615:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.413645:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867556608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.413651:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6650 00000100:00100000:0.0:1746142916.413663:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6651 00000100:00100000:0.0:1746142916.413668:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867556096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.413674:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.413682:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 39 pid: 1854 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.413694:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 39 pid: 1854 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.413700:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6652 00010000:00010000:0.0:1746142916.413705:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36a00/0x2fa243e067ccdfe1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b171 expref: 39 pid: 1854 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.413706:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+19:2004:x1830962867556352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.413712:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.413719:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.413721:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 19 pid: 11943 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.413721:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.413724:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.413730:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 19 pid: 11943 timeout: 790 lvb_type: 1 00010000:00010000:0.0:1746142916.413731:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.413742:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142916.413746:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.413757:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+19:2004:x1830962867556352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 52us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.413762:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6652 00000100:00100000:0.0:1746142916.413762:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867556096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.413768:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6651 00000100:00100000:3.0:1746142916.413774:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6653 00000100:00100000:3.0:1746142916.413779:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867556480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.413785:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142916.413786:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1425 00000100:00100000:0.0:1746142916.413792:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867555968:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:3.0:1746142916.413793:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 37 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.413800:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 37 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.413811:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e600/0x2fa243e067ccdfbe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b155 expref: 37 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.413835:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.413925:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867881728:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.413937:0:9578:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.414706:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 18 pid: 1854 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.414728:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6654 00000100:00100000:1.0:1746142916.414733:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867555840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.414739:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.414747:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 18 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.414754:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 18 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.414765:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009710ce00/0x2fa243e067ccde75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0c9 expref: 18 pid: 1854 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.414772:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.414893:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867556480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1112us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.414913:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6653 00010000:00010000:3.0:1746142916.414938:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a37200/0x2fa243e067ccdffd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b18d expref: 20 pid: 1397 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.414945:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867882240:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.414953:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867882368:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.414960:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82000/0x2fa243e067ccde91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0de expref: 17 pid: 11943 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.414966:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867882496:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.414981:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415027:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415034:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415047:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415053:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415058:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415064:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974cc800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142916.415066:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415071:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415080:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.415084:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974cc800/0x2fa243e067cce0f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.415128:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867555200:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 14075us (14569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.415134:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14665 00000100:00100000:1.0:1746142916.415188:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867555840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 454us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.415194:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6654 00000100:00100000:0.0:1746142916.415296:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.415330:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.415455:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.415481:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.415533:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556736 00000100:00100000:3.0:1746142916.415537:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556736 00010000:00010000:3.0:1746142916.415548:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.415558:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556864 00000100:00100000:3.0:1746142916.415560:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556864 00010000:00010000:3.0:1746142916.415566:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 37 pid: 1397 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.415578:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867556992 00000100:00100000:3.0:1746142916.415579:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867556992 00010000:00010000:3.0:1746142916.415586:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 16 pid: 1852 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.415592:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557120 00000100:00100000:3.0:1746142916.415593:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557120 00010000:00010000:3.0:1746142916.415599:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 13 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.415607:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6655 00000100:00100000:3.0:1746142916.415612:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867556736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.415618:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.415624:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.415632:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.415642:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3e800/0x2fa243e067ccdfc5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b15c expref: 20 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.415650:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.415651:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.415654:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415665:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415677:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.415692:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867556736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.415698:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6655 00000100:00100000:3.0:1746142916.415706:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6656 00000100:00100000:3.0:1746142916.415710:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867556864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.415715:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.415721:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 37 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415729:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 37 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415738:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098444400/0x2fa243e067cce035 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1b0 expref: 37 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415745:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.415746:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.415749:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415755:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415769:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.415780:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867556864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 69us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.415785:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6656 00000100:00100000:3.0:1746142916.415807:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6657 00000100:00100000:3.0:1746142916.415811:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867556992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.415816:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.415823:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 16 pid: 1852 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415831:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 16 pid: 1852 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415841:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.415850:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867556992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 39us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.415854:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6657 00000100:00100000:3.0:1746142916.415861:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6658 00000100:00100000:3.0:1746142916.415865:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867557120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.415869:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.415874:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 13 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415880:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 13 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.415888:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.415912:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867557120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.415916:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6658 00010000:00010000:3.0:1746142916.415927:0:12211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415932:0:12211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415942:0:12211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415948:0:12211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415952:0:12211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415956:0:12211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ebce00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142916.415958:0:12211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415963:0:12211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415978:0:12211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.415983:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ebce00/0x2fa243e067cce107 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.416247:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867555072:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 14019us (14408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.416252:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14668 00010000:00010000:3.0:1746142916.416289:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009495c000/0x2fa243e067cce00b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b186 expref: 15 pid: 1852 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.416296:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867883136:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.416304:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867883264:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.416310:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e691000/0x2fa243e067ccde7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b0d7 expref: 12 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.416316:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867883392:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.416340:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416350:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416359:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416368:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416373:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416378:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416383:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe6400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142916.416386:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416391:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416399:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.416405:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6400/0x2fa243e067cce0f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.416428:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867555456:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 15176us (15762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.416433:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14666 00000100:00100000:2.0:1746142916.419634:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.419915:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557248 00000100:00100000:1.0:1746142916.419922:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557248 00010000:00010000:1.0:1746142916.419949:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 38 pid: 1397 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.419984:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6659 00000100:00100000:1.0:1746142916.419991:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867557248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.420006:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.420020:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 38 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.420029:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 38 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.420047:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098445e00/0x2fa243e067cce02e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a9 expref: 38 pid: 1397 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.420060:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.420062:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.420066:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.420073:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.420101:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.420135:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867557248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 144us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.420141:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6659 00010000:00010000:3.0:1746142916.421096:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421105:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421119:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421126:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421132:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421138:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d2a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142916.421141:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421147:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421157:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.421162:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cce10e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.421213:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867555328:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 18976us (19236us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.421220:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14669 00000100:00100000:1.0:1746142916.425380:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867555968:12345-192.168.204.50@tcp:4:cat.0 Request processed in 11580us (11982us total) trans 17179874013 rc 0/0 00000100:00100000:1.0:1746142916.425390:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1425 00002000:00100000:1.0:1746142916.425399:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->1093631) req@ffff880092135880 x1830962867555968/t17179874013(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.425407:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135880 with x1830962867555968 ext(1048576->1093631) 00010000:00010000:1.0:1746142916.425415:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 36 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.425425:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 36 pid: 1397 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746142916.425431:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092135880 00000100:00100000:3.0:1746142916.425433:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867556224:12345-192.168.204.50@tcp:4:cat.0 Request processed in 11858us (12058us total) trans 21474841270 rc 0/0 00000100:00100000:3.0:1746142916.425439:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1424 00002000:00100000:3.0:1746142916.425443:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x97:0x0] (122880->1048575) req@ffff880092135f80 x1830962867556224/t21474841270(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.425450:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092135f80 with x1830962867556224 ext(122880->1048575) 00010000:00010000:3.0:1746142916.425455:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.425462:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.425468:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092135f80 00000100:00100000:0.0:1746142916.429545:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.429619:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557376 00000100:00100000:1.0:1746142916.429627:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557376 00010000:00010000:1.0:1746142916.429654:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 36 pid: 1397 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.429685:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6660 00000100:00100000:1.0:1746142916.429692:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2006:x1830962867557376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.429702:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.429718:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 36 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.429728:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 36 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.429751:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce04a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1093631) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1c5 expref: 36 pid: 1397 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.429764:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.429765:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.429769:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.429776:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430007:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430015:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430027:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430038:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430044:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430048:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800974ccc00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142916.430051:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430057:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.430066:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.430100:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974ccc00/0x2fa243e067cce0eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.430130:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867554944:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 29264us (29609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.430137:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14664 00010000:00010000:1.0:1746142916.430216:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.430235:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867557376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 543us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.430240:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6660 00000100:00100000:0.0:1746142916.430896:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.430965:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557504 00000100:00100000:1.0:1746142916.430968:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557504 00010000:00010000:1.0:1746142916.430982:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.431007:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6661 00000100:00100000:1.0:1746142916.431012:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867557504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.431019:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.431029:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.431038:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.431050:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a36e00/0x2fa243e067cce027 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 122880->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b1a2 expref: 37 pid: 9579 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.431060:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.431061:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.431064:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.431925:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.431948:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142916.431992:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432000:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432012:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432018:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432024:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432029:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ebd400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142916.432032:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432038:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432046:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.432052:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ebd400/0x2fa243e067cce100 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.432087:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867554816:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 29983us (31305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.432093:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14667 00000100:00100000:1.0:1746142916.432132:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2005:x1830962867557504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1119us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.432138:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6661 00000100:00100000:2.0:1746142916.433235:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.433334:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867557760 00000100:00100000:3.0:1746142916.433339:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867557760 00000100:00100000:3.0:1746142916.433363:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14530 00000100:00100000:3.0:1746142916.433368:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32655:x1830962867557760:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.433384:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.433398:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7200/0x2fa243e067cce115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b22e expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.433447:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433456:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433462:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433471:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433475:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433480:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433550:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433559:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.433565:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.433586:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.433600:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.433609:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867883520:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.434186:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff880098f77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.434488:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.434522:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867558016 00000100:00100000:3.0:1746142916.434525:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867558016 00000100:00100000:3.0:1746142916.434593:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14531 00000100:00100000:3.0:1746142916.434600:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32652:x1830962867558016:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1746142916.434622:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.434760:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098445000/0x2fa243e067cce0c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b212 expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.434771:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.434775:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.434780:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.434821:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:32652:x1830962867558016:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 221us (333us total) trans 0 rc -16/-16 00000100:00100000:3.0:1746142916.434826:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14531 00000100:00100000:3.0:1746142916.435988:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867883520:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.436002:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:3.0:1746142916.436405:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.436482:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867558144 00000100:00100000:1.0:1746142916.436486:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867558144 00010000:00010000:1.0:1746142916.436498:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.436511:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6662 00000100:00100000:1.0:1746142916.436514:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867558144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.436522:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.436525:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.436534:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.436547:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cce0dd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b227 expref: 11 pid: 13326 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.436555:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.436558:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142916.436565:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142916.436570:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142916.436584:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.436603:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867558144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.436609:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6662 00000100:00100000:3.0:1746142916.436619:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.436654:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867558400 00000100:00100000:0.0:1746142916.436658:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867558400 00010000:00010000:3.0:1746142916.436671:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.436676:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142916.436684:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5320 00000004:00200000:3.0:1746142916.436686:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000100:00100000:0.0:1746142916.436689:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32652:x1830962867558400:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1746142916.436802:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:32652:x1830962867558400:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 112us (182us total) trans 8589936716 rc 0/0 00000100:00100000:0.0:1746142916.436808:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5320 00010000:00010000:3.0:1746142916.437137:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437144:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437149:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437154:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d7e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.437156:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437162:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437169:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.437171:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142916.437174:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437178:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce12a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437190:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437198:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437202:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437207:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437210:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d6a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.437212:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437217:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437223:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.437225:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.437227:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437232:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437238:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437242:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437246:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437250:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d6c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.437252:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437268:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437273:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462900) 00010000:00010000:3.0:1746142916.437275:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.437278:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437282:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.437310:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7200/0x2fa243e067cce115 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b22e expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.437317:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7200/0x2fa243e067cce115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b22e expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.437323:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d7200, rc 0) 00000100:00100000:3.0:1746142916.437342:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:32655:x1830962867557760:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3973us (4109us total) trans 8589936717 rc 301/301 00000100:00100000:3.0:1746142916.437348:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14530 00000100:00100000:0.0:1746142916.438715:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.438758:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867558656 00000100:00100000:2.0:1746142916.438762:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867558656 00000100:00100000:2.0:1746142916.438824:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5321 00000100:00100000:2.0:1746142916.438830:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+11:32652:x1830962867558656:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142916.439646:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:32652:x1830962867558656:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 815us (931us total) trans 8589936718 rc 0/0 00000100:00100000:2.0:1746142916.439652:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5321 00000100:00100000:0.0:1746142916.441049:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.441105:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867558784 00000100:00100000:3.0:1746142916.441109:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867558784 00000100:00100000:3.0:1746142916.441131:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14670 00000100:00100000:3.0:1746142916.441136:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:32655:x1830962867558784:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.441144:0:11421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.441157:0:11421:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b235 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142916.441174:0:11421:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x1008 00010000:00010000:3.0:1746142916.441186:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.441187:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.441193:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.441204:0:11421:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 20 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.441211:0:11421:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d7600, rc 0) 00000100:00100000:3.0:1746142916.441240:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad4f1515-ae46-4d91-8f96-492179af7039+20:32655:x1830962867558784:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 104us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.441244:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14670 00000100:00100000:0.0:1746142916.443651:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.443714:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867559040 00000100:00100000:3.0:1746142916.443720:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867559040 00002000:00100000:3.0:1746142916.443745:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2404352->2408447) req@ffff880096141180 x1830962867559040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.443754:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141180 with x1830962867559040 ext(2404352->2408447) 00002000:00010000:3.0:1746142916.443758:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141180 00000100:00100000:3.0:1746142916.443782:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4593 00000100:00100000:3.0:1746142916.443788:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867559040:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142916.443875:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867559040:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 87us (228us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142916.443881:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4593 00002000:00100000:3.0:1746142916.443887:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2404352->2408447) req@ffff880096141180 x1830962867559040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.443894:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141180 with x1830962867559040 ext(2404352->2408447) 00002000:00010000:3.0:1746142916.443896:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141180 00000100:00100000:0.0:1746142916.445487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.445536:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867559296 00000100:00100000:3.0:1746142916.445541:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867559296 00002000:00100000:3.0:1746142916.445559:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2416640->2420735) req@ffff880096141c00 x1830962867559296/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.445567:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141c00 with x1830962867559296 ext(2416640->2420735) 00002000:00010000:3.0:1746142916.445570:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141c00 00000100:00100000:3.0:1746142916.445595:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4594 00000100:00100000:3.0:1746142916.445601:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867559296:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142916.445678:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867559296:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 76us (191us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142916.445683:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4594 00002000:00100000:3.0:1746142916.445688:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (2416640->2420735) req@ffff880096141c00 x1830962867559296/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.445695:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141c00 with x1830962867559296 ext(2416640->2420735) 00002000:00010000:3.0:1746142916.445698:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141c00 00000100:00100000:0.0:1746142916.446767:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.446803:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867559552 00000100:00100000:2.0:1746142916.446807:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867559552 00000100:00100000:2.0:1746142916.446868:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5322 00000100:00100000:2.0:1746142916.446874:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:32655:x1830962867559552:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142916.447081:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+13:32655:x1830962867559552:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 207us (314us total) trans 8589936719 rc 0/0 00000100:00100000:2.0:1746142916.447091:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5322 00000100:00100000:0.0:1746142916.475592:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.475646:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867559808 00000100:00100000:3.0:1746142916.475654:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867559808 00000100:00100000:3.0:1746142916.475711:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14532 00000100:00100000:3.0:1746142916.475718:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:32659:x1830962867559808:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.475737:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.475755:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7200/0x2fa243e067cce13f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b23c expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.475810:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475820:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475829:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475839:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475843:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475848:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475942:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475950:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.475955:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142916.475962:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.476020:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476025:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476030:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476035:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476041:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d6c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.476044:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476050:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476058:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.476061:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.476064:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476068:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6c00/0x2fa243e067cce146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476095:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476100:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476105:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476108:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d6a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.476110:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476118:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476123:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462e00) 00010000:00010000:3.0:1746142916.476125:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.476127:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476131:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce14d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.476160:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7200/0x2fa243e067cce13f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 32 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.476171:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 31 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.476175:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.476177:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.476179:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d7e00, rc 0) 00000100:00100000:3.0:1746142916.476228:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32659:x1830962867559808:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 510us (643us total) trans 8589936720 rc 0/0 00000100:00100000:3.0:1746142916.476234:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14532 00000100:00100000:0.0:1746142916.494996:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.495677:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560064 00000100:00100000:2.0:1746142916.495685:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560064 00000100:00100000:2.0:1746142916.495739:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14533 00000100:00100000:2.0:1746142916.495747:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32662:x1830962867560064:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.495767:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.495784:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b243 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.495865:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.495875:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142916.495884:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142916.495892:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142916.495995:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 34 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.496012:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 33 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.496019:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.496021:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746142916.496023:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881e00, rc 0) 00000100:00100000:2.0:1746142916.496079:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32662:x1830962867560064:12345-192.168.204.50@tcp:101:cat.0 Request processed in 332us (1089us total) trans 8589936721 rc 0/0 00000100:00100000:2.0:1746142916.496085:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14533 00000100:00100000:0.0:1746142916.498100:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.498136:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.498158:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.498173:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.498182:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.498208:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.498238:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560192 00000100:00100000:0.0:1746142916.498245:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560192 00000100:00100000:0.0:1746142916.498293:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560320 00000100:00100000:0.0:1746142916.498296:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560320 00000100:00100000:0.0:1746142916.498306:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560448 00000100:00100000:0.0:1746142916.498308:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560448 00000100:00100000:0.0:1746142916.498316:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560576 00000100:00100000:0.0:1746142916.498318:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560576 00000100:00100000:0.0:1746142916.498325:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560704 00000100:00100000:0.0:1746142916.498327:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560704 00000100:00100000:0.0:1746142916.498332:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867560832 00000100:00100000:0.0:1746142916.498333:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867560832 00000100:00100000:0.0:1746142916.498342:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14671 00000100:00100000:0.0:1746142916.498347:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867560192:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.498358:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.498372:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b24a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142916.498390:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x7f0 00010000:00010000:0.0:1746142916.498404:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.498406:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.498412:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 39 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.498423:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 39 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.498432:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4400, rc 0) 00000100:00100000:0.0:1746142916.498463:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867560192:12345-192.168.204.50@tcp:101:cat.0 Request processed in 115us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.498468:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14671 00000100:00100000:0.0:1746142916.498481:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14672 00000100:00100000:0.0:1746142916.498486:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867560320:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.498492:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.498502:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b251 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142916.498513:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x808 00010000:00010000:0.0:1746142916.498520:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.498521:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.498525:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.498533:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.498538:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5c00, rc 0) 00000100:00100000:0.0:1746142916.498553:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867560320:12345-192.168.204.50@tcp:101:cat.0 Request processed in 67us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.498558:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14672 00000100:00100000:3.0:1746142916.498603:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14673 00000100:00100000:3.0:1746142916.498610:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867560448:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.498616:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.498623:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b258 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142916.498642:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x800 00010000:00010000:3.0:1746142916.498649:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.498650:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.498654:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.498663:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.498668:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6400, rc 0) 00000100:00100000:3.0:1746142916.498684:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867560448:12345-192.168.204.50@tcp:101:cat.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.498689:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14673 00000100:00100000:3.0:1746142916.498699:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14674 00000100:00100000:3.0:1746142916.498703:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867560576:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.498708:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.498715:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b25f expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142916.498724:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x808 00010000:00010000:3.0:1746142916.498731:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.498732:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.498735:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 39 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.498743:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 39 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.498749:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d7200, rc 0) 00000100:00100000:3.0:1746142916.498763:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867560576:12345-192.168.204.50@tcp:101:cat.0 Request processed in 59us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.498768:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14674 00000100:00100000:3.0:1746142916.498777:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14675 00000100:00100000:3.0:1746142916.498781:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867560704:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.498787:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.498793:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b266 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142916.498802:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x16b0 00010000:00010000:3.0:1746142916.498808:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.498809:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.498812:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 39 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.498818:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 39 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.498823:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6a00, rc 0) 00000100:00100000:3.0:1746142916.498835:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867560704:12345-192.168.204.50@tcp:101:cat.0 Request processed in 54us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.498839:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14675 00000100:00100000:3.0:1746142916.498848:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14676 00000100:00100000:3.0:1746142916.498852:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867560832:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.498856:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.498862:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d6c00/0x2fa243e067cce19a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b26d expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.498890:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867883648:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142916.498963:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06000 going to sleep for 11 seconds 00002000:00010000:3.0:1746142916.500769:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142916 -> 1746142917 00002000:00010000:3.0:1746142916.500772:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142916 -> 1746142917 00000100:00100000:3.0:1746142916.500783:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867883648:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.500800:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800927d6c00/0x2fa243e067cce19a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b26d expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.500808:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6c00/0x2fa243e067cce19a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b26d expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.500822:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d6c00, rc 0) 00000100:00100000:3.0:1746142916.500859:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867560832:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2005us (2649us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.500865:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14676 00000100:00100000:0.0:1746142916.515137:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.515720:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.515789:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.515829:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.515927:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867561216 00000100:00100000:1.0:1746142916.515934:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867561216 00002000:00100000:1.0:1746142916.515969:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012c0e1c00 x1830962867561216/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.515977:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1c00 with x1830962867561216 ext(0->1048575) 00000100:00100000:2.0:1746142916.515978:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867561344 00000100:00100000:2.0:1746142916.515982:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867561344 00002000:00010000:1.0:1746142916.515982:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e1c00 00000100:00100000:1.0:1746142916.515996:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867561728 00000100:00100000:1.0:1746142916.515998:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867561728 00002000:00100000:2.0:1746142916.515999:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c0e0e00 x1830962867561344/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.516006:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0e00 with x1830962867561344 ext(1048576->2097151) 00002000:00100000:1.0:1746142916.516007:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c0e2d80 x1830962867561728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746142916.516009:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e0e00 00002000:00100000:1.0:1746142916.516013:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e2d80 with x1830962867561728 ext(1048576->2097151) 00002000:00010000:1.0:1746142916.516016:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e2d80 00000100:00100000:1.0:1746142916.516024:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867561600 00000100:00100000:1.0:1746142916.516025:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867561600 00000100:00100000:2.0:1746142916.516029:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4595 00002000:00100000:1.0:1746142916.516033:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012c0e3800 x1830962867561600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142916.516036:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867561216:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:1.0:1746142916.516038:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e3800 with x1830962867561600 ext(1048576->2097151) 00002000:00010000:1.0:1746142916.516040:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e3800 00000100:00100000:1.0:1746142916.516049:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4596 00000100:00100000:1.0:1746142916.516054:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867561344:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.516473:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4597 00000100:00100000:3.0:1746142916.516480:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867561728:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.516917:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4598 00000100:00100000:2.0:1746142916.516925:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867561600:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.531064:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867561216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15020us (15926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.531074:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4595 00002000:00100000:3.0:1746142916.531083:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012c0e1c00 x1830962867561216/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.531092:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1c00 with x1830962867561216 ext(0->1048575) 00002000:00010000:3.0:1746142916.531097:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e1c00 00000100:00100000:2.0:1746142916.539932:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867561344:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23868us (24204us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.539943:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4596 00002000:00100000:2.0:1746142916.539953:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012c0e0e00 x1830962867561344/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.539962:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e0e00 with x1830962867561344 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.539968:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e0e00 00000100:00100000:0.0:1746142916.555743:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.556177:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867561984 00000100:00100000:3.0:1746142916.556185:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867561984 00000100:00100000:3.0:1746142916.556218:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14677 00000100:00100000:3.0:1746142916.556226:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32659:x1830962867561984:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.556240:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.556283:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b274 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.556307:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.556315:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.556316:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.556319:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.556343:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.556353:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.556364:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867883776:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.556418:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867561600:12345-192.168.204.50@tcp:3:cat.0 Request processed in 39492us (40586us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.556427:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4598 00002000:00100000:2.0:1746142916.556434:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88012c0e3800 x1830962867561600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.556449:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e3800 with x1830962867561600 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.556452:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e3800 00000100:00100000:3.0:1746142916.556612:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06000 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.561518:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867883776:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.561547:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2588672->3145727] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 40 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.561563:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab28400, rc 0) 00000100:00100000:2.0:1746142916.561584:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32659:x1830962867561984:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5359us (5848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.561586:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867561728:12345-192.168.204.50@tcp:3:cat.0 Request processed in 45104us (45794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.561592:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14677 00000100:00100000:3.0:1746142916.561595:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4597 00002000:00100000:3.0:1746142916.561603:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012c0e2d80 x1830962867561728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.561610:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e2d80 with x1830962867561728 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.561614:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c0e2d80 00000100:00100000:0.0:1746142916.565149:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.566293:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867562112 00000100:00100000:1.0:1746142916.566303:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867562112 00010000:00010000:1.0:1746142916.566335:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.566373:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6663 00000100:00100000:1.0:1746142916.566380:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867562112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.566390:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.566405:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.566419:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.566436:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d6a00/0x2fa243e067cce193 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b266 expref: 40 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:1.0:1746142916.566457:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.566458:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.566463:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.566470:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.566496:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.566506:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867883904:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142916.566975:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.568841:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.568985:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867562240 00000100:00100000:3.0:1746142916.568992:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867562240 00000100:00100000:3.0:1746142916.569036:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14534 00000100:00100000:3.0:1746142916.569043:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:32663:x1830962867562240:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142916.569062:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142916.569593:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.569730:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867562496 00000100:00100000:2.0:1746142916.569734:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867562496 00002000:00100000:2.0:1746142916.569759:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2588672->2592767) req@ffff88012c0e1f80 x1830962867562496/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.569768:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1f80 with x1830962867562496 ext(2588672->2592767) 00002000:00010000:2.0:1746142916.569773:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e1f80 00000100:00100000:2.0:1746142916.569787:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4599 00000100:00100000:2.0:1746142916.569793:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867562496:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142916.569894:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867562496:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 101us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142916.569918:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4599 00002000:00100000:2.0:1746142916.569923:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2588672->2592767) req@ffff88012c0e1f80 x1830962867562496/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.569940:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1f80 with x1830962867562496 ext(2588672->2592767) 00002000:00010000:2.0:1746142916.569942:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c0e1f80 00010000:00010000:3.0:1746142916.569991:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce1a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b27b expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.570035:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570045:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570052:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570061:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570066:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570073:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570118:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570124:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570128:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142916.570153:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142916.570155:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142916.570165:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.570171:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00000100:00100000:1.0:1746142916.570220:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7217:1830962867883904:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142916.570231:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142916.570251:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867562112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3872us (5110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.570266:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6663 00010000:00010000:3.0:1746142916.571313:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571323:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571329:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571335:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571340:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab28600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.571343:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571349:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571360:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.571362:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.571366:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571370:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571430:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571435:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571439:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571442:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ebec00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.571444:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571448:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571454:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462600) 00010000:00010000:3.0:1746142916.571455:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.571457:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571460:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebec00/0x2fa243e067cce1b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.571489:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce1a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.571500:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 13 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.571505:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.571507:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.571509:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebfc00, rc 0) 00000100:00100000:3.0:1746142916.571557:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:32663:x1830962867562240:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 2514us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.571563:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14534 00000100:00100000:0.0:1746142916.574698:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.574776:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867562752 00000100:00100000:2.0:1746142916.574784:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867562752 00002000:00100000:2.0:1746142916.574819:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2588671) req@ffff8800924a0700 x1830962867562752/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.574828:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a0700 with x1830962867562752 ext(2097152->2588671) 00002000:00010000:2.0:1746142916.574833:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a0700 00000100:00100000:2.0:1746142916.574863:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4600 00000100:00100000:2.0:1746142916.574870:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867562752:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.581476:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.581538:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867562880 00000100:00100000:2.0:1746142916.581546:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867562880 00000100:00100000:2.0:1746142916.581594:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14678 00000100:00100000:2.0:1746142916.581599:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32659:x1830962867562880:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142916.581614:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.581628:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b282 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.581650:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 19 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.581658:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.581659:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.581662:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.581689:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 19 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.581699:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 19 pid: 11421 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.581709:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867884032:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.582172:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.582363:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.582446:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563008 00000100:00100000:2.0:1746142916.582450:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563008 00000100:00100000:2.0:1746142916.582469:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14679 00000100:00100000:2.0:1746142916.582474:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867563008:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142916.582482:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.582492:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b289 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.582506:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.582507:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.582512:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 11 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.582523:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 11 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.582532:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711ae00, rc 0) 00000100:00100000:2.0:1746142916.582568:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867563008:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 93us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.582573:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14679 00000100:00100000:0.0:1746142916.583621:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.583652:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.583687:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.583697:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.583711:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563136 00000100:00100000:0.0:1746142916.583715:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563136 00000100:00100000:0.0:1746142916.583732:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563392 00000100:00100000:0.0:1746142916.583734:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563392 00000100:00100000:0.0:1746142916.583742:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563648 00000100:00100000:0.0:1746142916.583744:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563648 00000100:00100000:0.0:1746142916.583754:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14680 00000100:00100000:0.0:1746142916.583759:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867563136:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142916.583767:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.583775:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b290 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.583783:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14681 00010000:00010000:0.0:1746142916.583789:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142916.583791:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867563392:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142916.583791:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.583795:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 15 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.583799:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.583805:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 15 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.583806:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b29e expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.583812:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5600, rc 0) 00010000:00010000:1.0:1746142916.583817:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.583818:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.583823:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.583832:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142916.583835:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867563136:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 75us (181us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142916.583839:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6800, rc 0) 00000100:00100000:0.0:1746142916.583840:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14680 00000100:00100000:0.0:1746142916.583850:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14682 00000100:00100000:0.0:1746142916.583855:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867563648:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:1.0:1746142916.583856:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867563392:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.583862:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14681 00010000:00010000:0.0:1746142916.583862:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.583868:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5800/0x2fa243e067cce1e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2ac expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.583892:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.583894:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867884160:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.583921:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563264 00000100:00100000:1.0:1746142916.583924:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563264 00000100:00100000:1.0:1746142916.583939:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14683 00000100:00100000:1.0:1746142916.583944:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867563264:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142916.583949:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142916.583951:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00010000:00010000:1.0:1746142916.583955:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b297 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.583964:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.583966:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.583970:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 17 pid: 12211 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142916.583974:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142916.583983:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 17 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.583989:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7c00, rc 0) 00000100:00100000:1.0:1746142916.584004:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+17:2006:x1830962867563264:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.584009:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14683 00000100:00100000:1.0:1746142916.584018:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563520 00000100:00100000:1.0:1746142916.584020:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563520 00000100:00100000:1.0:1746142916.584031:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14684 00000100:00100000:1.0:1746142916.584035:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867563520:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142916.584046:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.584051:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800982c6600/0x2fa243e067cce1ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2a5 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.584072:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867884288:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.584091:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.584122:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867562752:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9251us (9430us total) trans 0 rc 491520/491520 00000100:00100000:2.0:1746142916.584129:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4600 00002000:00100000:2.0:1746142916.584136:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->2588671) req@ffff8800924a0700 x1830962867562752/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 491520/491520 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.584144:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a0700 with x1830962867562752 ext(2097152->2588671) 00002000:00010000:2.0:1746142916.584148:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a0700 00000100:00100000:2.0:1746142916.584186:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867884032:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.584203:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.584210:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881400, rc 0) 00000100:00100000:2.0:1746142916.584227:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32659:x1830962867562880:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2628us (2758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.584232:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14678 00000100:00100000:3.0:1746142916.584294:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867563904 00000100:00100000:3.0:1746142916.584298:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867563904 00000100:00100000:3.0:1746142916.584322:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14535 00000100:00100000:3.0:1746142916.584327:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:32665:x1830962867563904:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142916.584339:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.584348:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce1f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2b3 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.584399:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584408:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584415:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584426:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584431:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584435:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584508:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584516:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584522:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142916.584528:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.584583:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584588:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584592:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584597:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584602:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab28600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.584605:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584610:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584618:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142916.584620:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.584622:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584627:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28600/0x2fa243e067cce1fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584647:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584651:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584655:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584658:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab28800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142916.584662:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584666:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584671:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462400) 00010000:00010000:3.0:1746142916.584673:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142916.584674:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584678:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab28800/0x2fa243e067cce203 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142916.584705:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce1f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 16 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.584713:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 15 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.584718:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.584720:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142916.584722:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ebd400, rc 0) 00000100:00100000:3.0:1746142916.584755:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+15:32665:x1830962867563904:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 428us (1136us total) trans 8589936722 rc 0/0 00000100:00100000:3.0:1746142916.584761:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14535 00000100:00100000:0.0:1746142916.587112:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.587337:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867564032 00000100:00100000:3.0:1746142916.587344:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867564032 00002000:00100000:3.0:1746142916.587374:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2404352->2420735) req@ffff8800924a0a80 x1830962867564032/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 16872/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.587382:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a0a80 with x1830962867564032 ext(2404352->2420735) 00010000:00010000:3.0:1746142916.587389:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 20 pid: 11421 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.587399:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 20 pid: 11421 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.587405:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924a0a80 00000100:00100000:3.0:1746142916.587421:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1426 00000100:00100000:3.0:1746142916.587426:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867564032:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142916.590757:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867884160:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.590787:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5800/0x2fa243e067cce1e0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ac expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.590798:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5800/0x2fa243e067cce1e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ac expref: 16 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.590817:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5800, rc 0) 00000100:00100000:1.0:1746142916.590857:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867563648:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 7000us (7157us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.590864:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14682 00002000:00010000:1.0:1746142916.590923:0:12211:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142916 -> 1746142917 00002000:00010000:1.0:1746142916.590926:0:12211:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142916 -> 1746142917 00002000:00010000:1.0:1746142916.590928:0:12211:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142916 -> 1746142917 00000100:00100000:1.0:1746142916.590939:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867884288:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.590954:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800982c6600/0x2fa243e067cce1ee lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2a5 expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.590963:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982c6600/0x2fa243e067cce1ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2a5 expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.590970:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c6600, rc 0) 00000100:00100000:1.0:1746142916.590988:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867563520:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 6951us (7013us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.590992:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14684 00000100:00100000:1.0:1746142916.591074:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.591092:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867564160 00000100:00100000:1.0:1746142916.591098:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867564160 00000100:00100000:1.0:1746142916.591124:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14685 00000100:00100000:1.0:1746142916.591131:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32662:x1830962867564160:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.591142:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.591153:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2ba expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.591170:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142916.591175:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.591180:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746142916.591183:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.591206:0:12211:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2109439] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.591216:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.591223:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77a00, rc 0) 00000100:00100000:1.0:1746142916.591239:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32662:x1830962867564160:12345-192.168.204.50@tcp:101:cat.0 Request processed in 109us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.591244:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14685 00000100:00100000:3.0:1746142916.591486:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867564032:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 4057us (4376us total) trans 17179874014 rc 0/0 00000100:00100000:3.0:1746142916.591493:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1426 00002000:00100000:3.0:1746142916.591501:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2404352->2420735) req@ffff8800924a0a80 x1830962867564032/t17179874014(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 16872/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.591508:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a0a80 with x1830962867564032 ext(2404352->2420735) 00010000:00010000:3.0:1746142916.591514:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 22 pid: 11421 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.591523:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 22 pid: 11421 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.591529:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924a0a80 00000100:00100000:0.0:1746142916.593507:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.595432:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867564288 00000100:00100000:1.0:1746142916.595443:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867564288 00010000:00010000:1.0:1746142916.595483:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 22 pid: 11421 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.595790:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.595868:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.596131:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867564544 00000100:00100000:3.0:1746142916.596135:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867564544 00000100:00100000:3.0:1746142916.596158:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867564800 00000100:00100000:3.0:1746142916.596160:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867564800 00000100:00100000:3.0:1746142916.596176:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14536 00000100:00100000:3.0:1746142916.596183:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:32663:x1830962867564544:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142916.596196:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.596210:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974ccc00/0x2fa243e067cce21f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2c1 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596311:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142916.596322:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 32 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596328:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596333:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 15 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596339:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142916.596361:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 15 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596369:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 15 pid: 7230 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.596377:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867884544:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.596431:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596437:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 14 pid: 7230 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.596443:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867884672:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.596459:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 32 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596464:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 32 pid: 7230 timeout: 790 lvb_type: 0 00000100:00100000:3.0:1746142916.596470:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867884800:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.596481:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06000 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.596495:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14537 00000100:00100000:3.0:1746142916.596499:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:32668:x1830962867564800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.596508:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.596512:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067cce22d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2c8 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596538:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.596545:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142916.596554:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142916.596561:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000100:00100000:1.0:1746142916.596611:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6664 00000100:00100000:1.0:1746142916.596617:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867564288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.596628:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.596635:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc600/0x2fa243e067cce22d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 18 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.596642:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 22 pid: 11421 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.596650:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 22 pid: 11421 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.596656:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596662:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.596662:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d7600/0x2fa243e067cce138 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2404352->2420735) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b235 expref: 22 pid: 11421 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.596665:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746142916.596667:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142916.596671:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.596673:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.596674:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142916.596678:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.596679:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cca00, rc 0) 00010000:00010000:1.0:1746142916.596684:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.596701:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.596702:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:32668:x1830962867564800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 201us (832us total) trans 8589936723 rc 0/0 00000100:00100000:3.0:1746142916.596707:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14537 00010000:00010000:1.0:1746142916.596709:0:7217:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 38 pid: 1853 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.596716:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867884928:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142916.596736:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.599615:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.599782:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867564928 00000100:00100000:1.0:1746142916.599789:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867564928 00000100:00100000:1.0:1746142916.599823:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14686 00000100:00100000:1.0:1746142916.599830:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:32665:x1830962867564928:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142916.599847:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.599862:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2cf expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.599889:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.599896:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 14 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.599921:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.599922:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.599925:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2064384->2097151] (req 2064384->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.599941:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867884544:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.599946:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 14 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142916.599949:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867884672:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.599955:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 14 pid: 9580 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.599956:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867884800:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.599964:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867885056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.599975:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746142916.600013:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867884928:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142916.600021:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142916.600028:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 38 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142916.600040:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867564288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3423us (6539us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142916.600041:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 38 pid: 9580 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.600048:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6664 00000100:00100000:1.0:1746142916.600049:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867885184:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.600064:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.601743:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.601760:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.601786:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.601798:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.601822:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.601967:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565312 00000100:00100000:2.0:1746142916.601973:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565312 00010000:00010000:2.0:1746142916.601995:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 15 pid: 7230 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.602014:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565184 00000100:00100000:2.0:1746142916.602017:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565184 00010000:00010000:2.0:1746142916.602025:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 17 pid: 7230 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.602038:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565056 00000100:00100000:0.0:1746142916.602041:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565056 00000100:00100000:2.0:1746142916.602045:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565440 00000100:00100000:2.0:1746142916.602046:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565440 00010000:00010000:2.0:1746142916.602054:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 33 pid: 7230 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.602061:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14687 00000100:00100000:0.0:1746142916.602067:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+15:2005:x1830962867565056:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:2.0:1746142916.602071:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6665 00000100:00100000:2.0:1746142916.602075:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867565312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.602077:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.602083:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.602087:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 15 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.602087:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2d6 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.602095:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 15 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.602099:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.602100:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.602106:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.602110:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebfc00/0x2fa243e067cce1bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b27b expref: 15 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.602116:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 16 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.602122:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.602126:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.602128:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4200, rc 0) 00010000:00010000:2.0:1746142916.602133:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.602136:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142916.602160:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867565056:12345-192.168.204.50@tcp:101:cat.0 Request processed in 93us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.602165:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14687 00000100:00100000:3.0:1746142916.602244:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.602248:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6666 00000100:00100000:1.0:1746142916.602267:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867565184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142916.602274:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142916.602278:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 17 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.602285:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 17 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.602296:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ebd400/0x2fa243e067cce20a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2b3 expref: 17 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.602303:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142916.602306:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142916.602310:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142916.602315:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.602723:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867565312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 646us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.602729:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6665 00000100:00100000:2.0:1746142916.602741:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6667 00000100:00100000:2.0:1746142916.602746:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2005:x1830962867565440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.602752:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.602755:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 33 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.602763:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 33 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.602773:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7e00/0x2fa243e067cce154 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b23c expref: 33 pid: 7230 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.602781:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.602784:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.602790:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.602795:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.602810:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.602825:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2005:x1830962867565440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.602830:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6667 00000100:00100000:0.0:1746142916.602947:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565824 00000100:00100000:0.0:1746142916.602951:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565824 00000100:00100000:0.0:1746142916.602966:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14688 00000100:00100000:0.0:1746142916.602970:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867565824:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.602977:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.602984:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce250 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2dd expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.602994:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.602999:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce250 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2dd expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.603005:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c4a00/0x2fa243e067cce250 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2dd expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.603014:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4a00, rc 0) 00000100:00100000:0.0:1746142916.603027:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867565824:12345-192.168.204.50@tcp:101:cat.0 Request processed in 57us (1190us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142916.603032:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14688 00010000:00010000:3.0:1746142916.603206:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142916.603209:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+16:2005:x1830962867565184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 953us (1420us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142916.603212:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142916.603215:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6666 00000004:00200000:3.0:1746142916.603227:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142916.603330:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974ccc00/0x2fa243e067cce21f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c1 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.603341:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c1 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.603346:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142916.603348:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746142916.603350:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cd600, rc 0) 00000100:00100000:3.0:1746142916.603368:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:32663:x1830962867564544:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 7186us (7579us total) trans 8589936724 rc 0/0 00000100:00100000:3.0:1746142916.603374:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14536 00000100:00100000:3.0:1746142916.603415:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.603478:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565696 00000100:00100000:3.0:1746142916.603481:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565696 00002000:00100000:3.0:1746142916.603499:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2105344->2109439) req@ffff880096af0e00 x1830962867565696/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.603506:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0e00 with x1830962867565696 ext(2105344->2109439) 00010000:00010000:3.0:1746142916.603511:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.603519:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.603528:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096af0e00 00000100:00100000:3.0:1746142916.603538:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1427 00000100:00100000:3.0:1746142916.603543:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867565696:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.603632:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867565696:12345-192.168.204.50@tcp:3:cat.0 Request processed in 88us (1808us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142916.603637:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1427 00002000:00100000:3.0:1746142916.603641:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x7b:0x0] (2105344->2109439) req@ffff880096af0e00 x1830962867565696/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.603646:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af0e00 with x1830962867565696 ext(2105344->2109439) 00010000:00010000:3.0:1746142916.603650:0:20334:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:3.0:1746142916.603656:0:20334:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:3.0:1746142916.603661:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880096af0e00 00000100:00100000:0.0:1746142916.603888:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.603912:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867565952 00000100:00100000:0.0:1746142916.603916:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867565952 00000100:00100000:0.0:1746142916.603935:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566080 00000100:00100000:0.0:1746142916.603937:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566080 00000100:00100000:0.0:1746142916.603948:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14689 00000100:00100000:1.0:1746142916.603953:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14690 00000100:00100000:0.0:1746142916.603953:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867565952:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1746142916.603959:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867566080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.603959:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.603964:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.603964:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2e4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.603969:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2eb expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.603973:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.603974:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.603977:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.603978:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.603979:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.603981:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.603988:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 17 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.603988:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.603995:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d76a00, rc 0) 00010000:00010000:0.0:1746142916.603995:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5000, rc 0) 00000100:00100000:1.0:1746142916.604008:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867566080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.604008:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867565952:12345-192.168.204.50@tcp:101:cat.0 Request processed in 56us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.604013:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14690 00000100:00100000:2.0:1746142916.604077:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.604102:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.604143:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867885056:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.604174:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867885184:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.604189:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2064384->2097151] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 24 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.604197:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77200, rc 0) 00000100:00100000:2.0:1746142916.604213:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:32665:x1830962867564928:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4383us (4605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.604245:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566208 00000100:00100000:1.0:1746142916.604248:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566208 00000100:00100000:0.0:1746142916.604868:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14689 00000100:00100000:0.0:1746142916.604878:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566336 00000100:00100000:0.0:1746142916.604881:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566336 00000100:00100000:2.0:1746142916.604894:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14686 00000100:00100000:2.0:1746142916.604960:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.604973:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566464 00000100:00100000:2.0:1746142916.604975:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566464 00010000:00010000:2.0:1746142916.604987:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 15 pid: 9580 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.605001:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6668 00000100:00100000:2.0:1746142916.605006:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867566464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.605012:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.605023:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 15 pid: 9580 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.605030:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 15 pid: 9580 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.605042:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5600/0x2fa243e067cce1d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b290 expref: 15 pid: 9580 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.605053:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.605068:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867566464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 62us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.605073:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6668 00000100:00100000:1.0:1746142916.605612:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14691 00000100:00100000:1.0:1746142916.605619:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867566208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.605627:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.605634:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d77c00/0x2fa243e067cce26c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2f2 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.605667:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867885312:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.605719:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.605835:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14692 00000100:00100000:0.0:1746142916.605841:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867566336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142916.605848:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.605853:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5400/0x2fa243e067cce273 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b2f9 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.605878:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867885440:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142916.605922:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.607927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.607977:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.608003:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.608033:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.608215:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566976 00000100:00100000:3.0:1746142916.608220:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566976 00000100:00100000:3.0:1746142916.608247:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5323 00000100:00100000:3.0:1746142916.608262:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32659:x1830962867566976:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142916.608398:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32659:x1830962867566976:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 145us (394us total) trans 8589936725 rc 0/0 00000100:00100000:3.0:1746142916.608404:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5323 00000100:00100000:2.0:1746142916.608568:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867566592 00000100:00100000:2.0:1746142916.608572:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867566592 00010000:00010000:2.0:1746142916.608589:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 39 pid: 9580 timeout: 790 lvb_type: 1 00000100:00100000:2.0:1746142916.608618:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6669 00000100:00100000:2.0:1746142916.608624:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867566592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.608632:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.608648:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 39 pid: 9580 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.608657:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 39 pid: 9580 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.608674:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5c00/0x2fa243e067cce17e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b251 expref: 39 pid: 9580 timeout: 790 lvb_type: 1 00010000:00010000:2.0:1746142916.608684:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.608685:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.608692:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 24 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.608703:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 24 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.608727:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 24 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.608736:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867885568:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.608775:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.609046:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867567232 00000100:00100000:0.0:1746142916.609049:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867567232 00000100:00100000:0.0:1746142916.609071:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14538 00000100:00100000:0.0:1746142916.609076:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+14:32663:x1830962867567232:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142916.609085:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142916.609087:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1746142916.609090:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867885312:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142916.609098:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cd600/0x2fa243e067cce226 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c1 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.609107:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d77c00/0x2fa243e067cce26c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2f2 expref: 18 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.609111:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.609114:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142916.609115:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d77c00/0x2fa243e067cce26c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2f2 expref: 18 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.609121:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4a00/0x2fa243e067cce27a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b300 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.609122:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77c00, rc 0) 00000100:00100000:1.0:1746142916.609140:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867566208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3522us (5063us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.609145:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14691 00010000:00010000:0.0:1746142916.609168:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609177:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609184:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609193:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609198:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609203:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609207:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab29200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142916.609211:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609216:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609222:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142916.609224:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142916.609227:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609231:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab29200/0x2fa243e067cce281 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142916.609250:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4a00/0x2fa243e067cce27a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b300 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.609267:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4a00/0x2fa243e067cce27a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b300 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.609274:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c4a00, rc 0) 00000100:00100000:0.0:1746142916.609293:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:32663:x1830962867567232:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 217us (1315us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142916.609299:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14538 00000100:00100000:0.0:1746142916.609318:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867567360 00000100:00100000:0.0:1746142916.609321:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867567360 00002000:00100000:0.0:1746142916.609339:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2109439) req@ffff8800979b3b80 x1830962867567360/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 12776/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.609347:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3b80 with x1830962867567360 ext(2097152->2109439) 00010000:00010000:0.0:1746142916.609353:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.609362:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746142916.609368:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979b3b80 00000100:00100000:0.0:1746142916.609391:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1428 00000100:00100000:0.0:1746142916.609397:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867567360:12345-192.168.204.50@tcp:4:cat.0 00002000:00010000:0.0:1746142916.609582:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142916 -> 1746142917 00000100:00100000:0.0:1746142916.609589:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867885440:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142916.609602:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5400/0x2fa243e067cce273 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2f9 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.609608:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5400/0x2fa243e067cce273 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2f9 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142916.609614:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5400, rc 0) 00000100:00100000:0.0:1746142916.609643:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867566336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3802us (5540us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142916.609649:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14692 00000100:00100000:0.0:1746142916.610034:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867567360:12345-192.168.204.50@tcp:4:cat.0 Request processed in 636us (1999us total) trans 17179874015 rc 0/0 00000100:00100000:0.0:1746142916.610039:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1428 00002000:00100000:0.0:1746142916.610044:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2109439) req@ffff8800979b3b80 x1830962867567360/t17179874015(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 12776/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.610051:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3b80 with x1830962867567360 ext(2097152->2109439) 00010000:00010000:0.0:1746142916.610055:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 41 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.610067:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 41 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746142916.610072:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800979b3b80 00000100:00100000:2.0:1746142916.611370:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867885568:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.611383:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.611406:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867566592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2782us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.611414:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6669 00000100:00100000:0.0:1746142916.612520:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.612576:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.612642:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867567616 00000100:00100000:1.0:1746142916.612647:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867567616 00000100:00100000:1.0:1746142916.612687:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5324 00000100:00100000:1.0:1746142916.612693:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:32663:x1830962867567616:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:1.0:1746142916.612815:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:32663:x1830962867567616:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 122us (295us total) trans 8589936726 rc 0/0 00000100:00100000:1.0:1746142916.612821:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5324 00000100:00100000:2.0:1746142916.613019:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867567744 00000100:00100000:2.0:1746142916.613022:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867567744 00010000:00010000:2.0:1746142916.613037:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 40 pid: 1853 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.613054:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6670 00000100:00100000:2.0:1746142916.613059:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867567744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.613067:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.613079:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 40 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.613092:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 40 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.613107:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce1c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2109439) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b282 expref: 40 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.613117:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.613119:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.613124:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.613130:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.613151:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.613161:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867885696:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.613203:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.623603:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.623716:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867885696:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.623721:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867568128 00000100:00100000:2.0:1746142916.623727:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867568128 00010000:00010000:3.0:1746142916.623733:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746142916.623760:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2064384->2068479) req@ffff8800979b1f80 x1830962867568128/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142916.623766:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867567744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10707us (11189us total) trans 0 rc 0/0 00002000:00100000:2.0:1746142916.623769:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1f80 with x1830962867568128 ext(2064384->2068479) 00002000:00010000:2.0:1746142916.623773:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b1f80 00000100:00100000:3.0:1746142916.623775:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6670 00000100:00100000:2.0:1746142916.623788:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4601 00000100:00100000:2.0:1746142916.623793:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867568128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.623896:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867568128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 102us (299us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142916.623922:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4601 00002000:00100000:2.0:1746142916.623928:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2064384->2068479) req@ffff8800979b1f80 x1830962867568128/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.623934:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1f80 with x1830962867568128 ext(2064384->2068479) 00002000:00010000:2.0:1746142916.623937:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b1f80 00000100:00100000:0.0:1746142916.629028:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.629162:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867568384 00000100:00100000:0.0:1746142916.629164:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.629169:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867568384 00000100:00100000:0.0:1746142916.629191:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.629207:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.629218:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867568640 00000100:00100000:3.0:1746142916.629221:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867568640 00000100:00100000:0.0:1746142916.629224:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.629633:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569024 00000100:00100000:3.0:1746142916.629635:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569024 00000100:00100000:0.0:1746142916.629652:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1746142916.629664:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800979b0380 x1830962867569024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.629672:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0380 with x1830962867569024 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.629677:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0380 00000100:00100000:3.0:1746142916.629695:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569152 00000100:00100000:3.0:1746142916.629698:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569152 00000100:00100000:1.0:1746142916.629702:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569408 00000100:00100000:1.0:1746142916.629705:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569408 00002000:00100000:3.0:1746142916.629709:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800979b3480 x1830962867569152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.629714:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3480 with x1830962867569152 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.629717:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b3480 00002000:00100000:1.0:1746142916.629717:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800979b0700 x1830962867569408/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142916.629725:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569664 00000100:00100000:3.0:1746142916.629726:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569664 00002000:00100000:1.0:1746142916.629728:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0700 with x1830962867569408 ext(2097152->4194303) 00002000:00010000:1.0:1746142916.629731:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0700 00002000:00100000:3.0:1746142916.629735:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800979b1500 x1830962867569664/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.629740:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1500 with x1830962867569664 ext(3145728->4194303) 00000100:00100000:1.0:1746142916.629742:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4602 00002000:00010000:3.0:1746142916.629743:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b1500 00000100:00100000:1.0:1746142916.629747:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867569024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.629750:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4603 00000100:00100000:3.0:1746142916.629753:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867569152:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.629917:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4604 00000100:00100000:0.0:1746142916.629924:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867569408:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:2.0:1746142916.630240:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800979b0a80 x1830962867568384/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.630248:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0a80 with x1830962867568384 ext(0->1048575) 00002000:00010000:2.0:1746142916.630263:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b0a80 00000100:00100000:2.0:1746142916.630278:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4605 00000100:00100000:2.0:1746142916.630284:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867569664:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.630465:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4606 00000100:00100000:3.0:1746142916.630471:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867568384:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:2.0:1746142916.630839:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800979b3100 x1830962867568640/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 504/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.630848:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3100 with x1830962867568640 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.630852:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b3100 00000100:00100000:2.0:1746142916.630867:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4607 00000100:00100000:2.0:1746142916.630872:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867568640:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.644009:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867569152:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14244us (14790us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.644020:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4603 00002000:00100000:3.0:1746142916.644032:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800979b3480 x1830962867569152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.644041:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3480 with x1830962867569152 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.644046:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b3480 00000100:00100000:3.0:1746142916.651161:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867569664:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20867us (21498us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.651171:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4605 00002000:00100000:3.0:1746142916.651181:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff8800979b1500 x1830962867569664/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.651190:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1500 with x1830962867569664 ext(3145728->4194303) 00002000:00010000:3.0:1746142916.651196:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b1500 00000100:00100000:2.0:1746142916.665789:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867569408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 35857us (36554us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142916.665799:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4604 00002000:00100000:2.0:1746142916.665808:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800979b0700 x1830962867569408/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.665816:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0700 with x1830962867569408 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.665821:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0700 00000100:00100000:3.0:1746142916.672743:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:2005:x1830962867568384:12345-192.168.204.50@tcp:3:cat.0 Request processed in 42262us (43712us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.672754:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4606 00002000:00100000:3.0:1746142916.672765:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800979b0a80 x1830962867568384/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.672774:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0a80 with x1830962867568384 ext(0->1048575) 00002000:00010000:3.0:1746142916.672779:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b0a80 00000100:00100000:1.0:1746142916.673181:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867569024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 43431us (43987us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142916.673188:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4602 00002000:00100000:1.0:1746142916.673194:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800979b0380 x1830962867569024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.673202:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0380 with x1830962867569024 ext(1048576->2097151) 00002000:00010000:1.0:1746142916.673205:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b0380 00000100:00100000:0.0:1746142916.677615:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.677741:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569792 00000100:00100000:1.0:1746142916.677749:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569792 00000100:00100000:1.0:1746142916.677800:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14693 00000100:00100000:1.0:1746142916.677807:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867569792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.677822:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.677835:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f200/0x2fa243e067cce288 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b307 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.677878:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867885824:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.677973:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.678000:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867568640:12345-192.168.204.50@tcp:3:cat.0 Request processed in 47126us (48833us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746142916.678106:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4607 00002000:00100000:2.0:1746142916.678115:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800979b3100 x1830962867568640/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 504/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.678124:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3100 with x1830962867568640 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.678127:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b3100 00002000:00010000:1.0:1746142916.680471:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142916 -> 1746142917 00002000:00010000:1.0:1746142916.680477:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142916 -> 1746142917 00002000:00010000:1.0:1746142916.680480:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142916 -> 1746142917 00000100:00100000:1.0:1746142916.680495:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867885824:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.680520:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f200/0x2fa243e067cce288 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b307 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.680532:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f200/0x2fa243e067cce288 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b307 expref: 40 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.680730:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3f200, rc 0) 00000100:00100000:1.0:1746142916.681039:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867569792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3231us (3431us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.681047:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14693 00000100:00100000:0.0:1746142916.682719:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.682789:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867569920 00000100:00100000:1.0:1746142916.682796:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867569920 00000100:00100000:1.0:1746142916.682826:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14694 00000100:00100000:1.0:1746142916.682831:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+23:32665:x1830962867569920:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142916.682844:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.682858:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b30e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.682883:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.682890:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.682896:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.682921:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.682922:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.682925:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.682949:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 13 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.682959:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 13 pid: 12211 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.682968:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867885952:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.684016:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.684026:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.684033:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867886080:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.685041:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 38 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.685050:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 38 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:1.0:1746142916.685063:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867886208:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.685084:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.685609:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867885952:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142916.690543:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.691270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.691335:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570176 00000100:00100000:3.0:1746142916.691343:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570176 00010000:00010000:3.0:1746142916.691371:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 14 pid: 12211 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.693523:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6671 00000100:00100000:3.0:1746142916.693538:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867570176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.693553:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.693574:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 14 pid: 12211 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.693585:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 14 pid: 12211 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.693603:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7c00/0x2fa243e067cce1e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b297 expref: 14 pid: 12211 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.693621:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.693657:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867570176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 125us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.693663:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6671 00000100:00100000:1.0:1746142916.693758:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.693838:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867886080:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142916.693847:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867886208:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142916.693869:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1048576->1273855] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.693878:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3f400, rc 0) 00000100:00100000:0.0:1746142916.693896:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+24:32665:x1830962867569920:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 11065us (11182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142916.693929:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14694 00000100:00100000:2.0:1746142916.693985:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570304 00000100:00100000:2.0:1746142916.693991:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570304 00002000:00100000:2.0:1746142916.694020:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800979b1180 x1830962867570304/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.694028:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1180 with x1830962867570304 ext(4194304->5066751) 00002000:00010000:2.0:1746142916.694032:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b1180 00000100:00100000:2.0:1746142916.694052:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4608 00000100:00100000:2.0:1746142916.694058:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867570304:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.695639:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.697423:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570432 00000100:00100000:3.0:1746142916.697432:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570432 00010000:00010000:3.0:1746142916.697462:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.697484:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570560 00000100:00100000:3.0:1746142916.697486:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570560 00010000:00010000:3.0:1746142916.697493:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 39 pid: 1853 timeout: 790 lvb_type: 1 00000100:00100000:3.0:1746142916.697507:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6672 00000100:00100000:3.0:1746142916.697513:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867570432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.697523:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.697538:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.697546:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.697561:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0c5000/0x2fa243e067cce25e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2e4 expref: 24 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.697572:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.697604:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867570432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (3847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.697610:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6672 00000100:00100000:3.0:1746142916.697624:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6673 00000100:00100000:3.0:1746142916.697628:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2006:x1830962867570560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142916.697635:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142916.697641:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 39 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.697650:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 39 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.697660:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d6400/0x2fa243e067cce185 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b258 expref: 39 pid: 1853 timeout: 790 lvb_type: 1 00010000:00010000:3.0:1746142916.697668:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.697669:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142916.697674:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.697680:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.697705:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.697714:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867886336:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142916.697768:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.698559:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.698582:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.698714:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570688 00000100:00100000:2.0:1746142916.698720:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570688 00000100:00100000:2.0:1746142916.698750:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570816 00000100:00100000:2.0:1746142916.698752:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570816 00000100:00100000:2.0:1746142916.698767:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14695 00000100:00100000:2.0:1746142916.698772:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867570688:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.698784:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.698804:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009711b800/0x2fa243e067cce296 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b315 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.698837:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867886464:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142916.698891:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009819c180 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.698929:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14696 00000100:00100000:2.0:1746142916.698935:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867570816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.698942:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.698949:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711a600/0x2fa243e067cce29d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b31c expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.698971:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867886592:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142916.699004:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.701861:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.702043:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867570944 00000100:00100000:2.0:1746142916.702050:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867570944 00000100:00100000:2.0:1746142916.702091:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14697 00000100:00100000:2.0:1746142916.702098:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867570944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.702113:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.702126:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b323 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.702149:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.702151:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.702158:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.702185:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.702194:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711a000, rc 0) 00000100:00100000:2.0:1746142916.702241:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867570944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.702247:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14697 00000100:00100000:3.0:1746142916.704578:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867886336:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142916.704600:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142916.704633:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867570560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 7003us (8998us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.704642:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6673 00002000:00010000:3.0:1746142916.704686:0:11943:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142916 -> 1746142917 00002000:00010000:3.0:1746142916.704689:0:11943:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142916 -> 1746142917 00002000:00010000:3.0:1746142916.704691:0:11943:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142916 -> 1746142917 00000100:00100000:3.0:1746142916.704703:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867886464:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.704723:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009711b800/0x2fa243e067cce296 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b315 expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.704733:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711b800/0x2fa243e067cce296 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b315 expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.704741:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711b800, rc 0) 00000100:00100000:3.0:1746142916.704760:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867570688:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5988us (6203us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.704766:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14695 00000100:00100000:3.0:1746142916.705498:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867886592:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.705515:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009711a600/0x2fa243e067cce29d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b31c expref: 18 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.705563:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711a600/0x2fa243e067cce29d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b31c expref: 18 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.705571:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711a600, rc 0) 00000100:00100000:3.0:1746142916.705594:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+17:2006:x1830962867570816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6659us (7011us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.705599:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14696 00000100:00100000:2.0:1746142916.708200:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867570304:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14135us (16923us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142916.708209:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4608 00002000:00100000:2.0:1746142916.708217:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800979b1180 x1830962867570304/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.708225:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1180 with x1830962867570304 ext(4194304->5066751) 00002000:00010000:2.0:1746142916.708230:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b1180 00000100:00100000:2.0:1746142916.709801:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.710415:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571200 00000100:00100000:0.0:1746142916.710422:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571200 00002000:00100000:0.0:1746142916.710453:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1269760->1273855) req@ffff8800924f6300 x1830962867571200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.710461:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f6300 with x1830962867571200 ext(1269760->1273855) 00002000:00010000:0.0:1746142916.710464:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f6300 00000100:00100000:0.0:1746142916.710484:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4609 00000100:00100000:0.0:1746142916.710489:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867571200:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.710589:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2003:x1830962867571200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 99us (791us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142916.710596:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4609 00002000:00100000:0.0:1746142916.710601:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1269760->1273855) req@ffff8800924f6300 x1830962867571200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.710607:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f6300 with x1830962867571200 ext(1269760->1273855) 00002000:00010000:0.0:1746142916.710610:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924f6300 00000100:00100000:0.0:1746142916.724590:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.724627:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.724682:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571328 00000100:00100000:2.0:1746142916.724689:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571328 00000100:00100000:0.0:1746142916.724702:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.724721:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571584 00000100:00100000:2.0:1746142916.724723:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571584 00000100:00100000:2.0:1746142916.724743:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571456 00000100:00100000:2.0:1746142916.724745:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571456 00000100:00100000:2.0:1746142916.724758:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14698 00000100:00100000:2.0:1746142916.724764:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+17:32668:x1830962867571328:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142916.724775:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14699 00010000:00010000:2.0:1746142916.724779:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142916.724780:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867571584:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.724786:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.724792:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b32a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.724793:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974cc600/0x2fa243e067cce2b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b338 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.724812:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.724817:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.724819:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.724821:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.724829:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867886720:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.724835:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.724844:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 38 pid: 1853 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.724851:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867886848:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142916.724889:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.724918:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14700 00000100:00100000:1.0:1746142916.724925:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867571456:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.724931:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.724937:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067cce2b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b331 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.724957:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867886976:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142916.725403:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.725442:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.728238:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.728414:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867886976:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.728439:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067cce2b9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b331 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142916.728446:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571840 00010000:00010000:1.0:1746142916.728449:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3e600/0x2fa243e067cce2b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b331 expref: 41 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142916.728450:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571840 00010000:00010000:1.0:1746142916.728462:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e600, rc 0) 00000100:00100000:3.0:1746142916.728480:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5325 00000100:00100000:3.0:1746142916.728487:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:32665:x1830962867571840:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142916.728516:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867571456:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3592us (3814us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.728522:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14700 00000100:00100000:2.0:1746142916.728603:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867886848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.728621:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.728631:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711ac00, rc 0) 00000100:00100000:2.0:1746142916.728647:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:32668:x1830962867571328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3883us (4635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.728651:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14698 00000100:00100000:2.0:1746142916.728681:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867886720:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.728696:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974cc600/0x2fa243e067cce2b2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b338 expref: 39 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.728704:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974cc600/0x2fa243e067cce2b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b338 expref: 39 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.728716:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc600, rc 0) 00000100:00100000:2.0:1746142916.728732:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867571584:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3952us (4104us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.728737:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14699 00000100:00100000:3.0:1746142916.729623:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:32665:x1830962867571840:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 1133us (1389us total) trans 8589936727 rc 0/0 00000100:00100000:3.0:1746142916.729629:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5325 00000100:00100000:0.0:1746142916.730217:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.730940:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867571968 00000100:00100000:1.0:1746142916.730945:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867571968 00002000:00100000:1.0:1746142916.730975:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2588672->3145727) req@ffff880097433100 x1830962867571968/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.730983:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433100 with x1830962867571968 ext(2588672->3145727) 00010000:00010000:1.0:1746142916.730991:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.731002:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 39 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746142916.731008:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097433100 00000100:00100000:1.0:1746142916.731028:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1429 00000100:00100000:1.0:1746142916.731034:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867571968:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142916.738676:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.739078:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867572096 00000100:00100000:3.0:1746142916.739087:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867572096 00000100:00100000:3.0:1746142916.739135:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14701 00000100:00100000:3.0:1746142916.739142:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32662:x1830962867572096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.739158:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.739172:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b33f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.739194:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142916.739196:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142916.739200:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5062656->5242879] (req 5062656->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.739210:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5062656->5242879] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.739224:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc000, rc 0) 00000100:00100000:3.0:1746142916.739271:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32662:x1830962867572096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 129us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.739276:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14701 00000100:00100000:1.0:1746142916.748987:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867571968:12345-192.168.204.50@tcp:4:cat.0 Request processed in 17945us (18762us total) trans 21474841271 rc 0/0 00000100:00100000:1.0:1746142916.748997:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1429 00002000:00100000:1.0:1746142916.749008:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2588672->3145727) req@ffff880097433100 x1830962867571968/t21474841271(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.749016:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433100 with x1830962867571968 ext(2588672->3145727) 00010000:00010000:1.0:1746142916.749024:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 42 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.749041:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 42 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746142916.749047:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097433100 00000100:00100000:0.0:1746142916.754276:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.757452:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867572352 00000100:00100000:2.0:1746142916.757462:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867572352 00000100:00100000:2.0:1746142916.757523:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14539 00000100:00100000:2.0:1746142916.757531:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32674:x1830962867572352:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142916.757549:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.757563:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711be00/0x2fa243e067cce2c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b346 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.757617:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757656:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757665:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757674:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757679:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757683:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757751:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757757:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757761:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142916.757767:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142916.757814:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757819:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757824:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757828:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757832:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009711bc00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142916.757835:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757840:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757848:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142916.757850:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142916.757853:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757857:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711bc00/0x2fa243e067cce2ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757879:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757883:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757886:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757890:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009711aa00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142916.757891:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757895:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757914:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9fea00) 00010000:00010000:2.0:1746142916.757915:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142916.757917:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757924:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711aa00/0x2fa243e067cce2d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142916.757950:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711be00/0x2fa243e067cce2c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 36 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.757958:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 35 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.757964:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.757965:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142916.757967:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711a200, rc 0) 00000100:00100000:2.0:1746142916.758008:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32674:x1830962867572352:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 478us (3739us total) trans 8589936728 rc 0/0 00000100:00100000:2.0:1746142916.758014:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14539 00000100:00100000:3.0:1746142916.758546:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.758590:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867572480 00000100:00100000:0.0:1746142916.758593:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867572480 00010000:00010000:0.0:1746142916.758612:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 42 pid: 1853 timeout: 790 lvb_type: 0 00000100:00100000:0.0:1746142916.758639:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6674 00000100:00100000:0.0:1746142916.758644:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867572480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142916.758652:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142916.758665:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 42 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.758674:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 42 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.758692:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab28400/0x2fa243e067cce1a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2588672->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b274 expref: 42 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.758975:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.758977:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.758983:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 17 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.758990:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 17 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.758997:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.758998:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142916.759000:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 41 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.759005:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 41 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142916.759026:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 41 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.759035:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867887104:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142916.759098:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 17 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142916.759109:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867887232:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142916.759123:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.760653:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.760684:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.760748:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097430e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867887104:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.760756:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097433800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867887232:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.760771:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.760798:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867572480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2154us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.760805:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6674 00000100:00100000:2.0:1746142916.760834:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867572736 00000100:00100000:2.0:1746142916.760838:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867572736 00000100:00100000:2.0:1746142916.762238:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867572608 00000100:00100000:2.0:1746142916.762245:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867572608 00000100:00100000:3.0:1746142916.762292:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14702 00000100:00100000:3.0:1746142916.762300:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867572736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.762314:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142916.762326:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cce2ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b354 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142916.762363:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867887360:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142916.762420:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.762560:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14703 00000100:00100000:1.0:1746142916.762568:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867572608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.762575:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.762581:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b34d expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142916.762602:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867887488:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.762628:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:3.0:1746142916.764110:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867887360:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.764131:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cce2ea lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b354 expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.764141:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974cd600/0x2fa243e067cce2ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b354 expref: 41 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.764163:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cd600, rc 0) 00000100:00100000:3.0:1746142916.764358:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867572736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2058us (3707us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.764363:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14702 00000100:00100000:1.0:1746142916.770784:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867887488:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142916.770811:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b34d expref: 39 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.770822:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b34d expref: 39 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142916.770847:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3f000, rc 0) 00000100:00100000:1.0:1746142916.770896:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867572608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8329us (10211us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142916.770919:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14703 00000100:00100000:0.0:1746142916.772132:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.772194:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867573120 00000100:00100000:1.0:1746142916.772201:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867573120 00002000:00100000:1.0:1746142916.772229:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880097431500 x1830962867573120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.772237:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431500 with x1830962867573120 ext(2097152->4194303) 00002000:00010000:1.0:1746142916.772241:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097431500 00000100:00100000:1.0:1746142916.772266:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4610 00000100:00100000:1.0:1746142916.772273:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867573120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142916.775572:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.776441:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.776478:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867573248 00000100:00100000:0.0:1746142916.776485:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867573248 00002000:00100000:0.0:1746142916.776518:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880097432300 x1830962867573248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.776527:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432300 with x1830962867573248 ext(2097152->4194303) 00002000:00010000:0.0:1746142916.776531:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097432300 00000100:00100000:0.0:1746142916.776552:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867573504 00000100:00100000:0.0:1746142916.776555:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867573504 00002000:00100000:0.0:1746142916.776566:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff880097430a80 x1830962867573504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.776572:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430a80 with x1830962867573504 ext(5062656->5066751) 00002000:00010000:0.0:1746142916.776575:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430a80 00000100:00100000:0.0:1746142916.776586:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4611 00000100:00100000:0.0:1746142916.776592:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867573248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.779030:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4612 00000100:00100000:3.0:1746142916.779041:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867573504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.779137:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867573504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 100us (2698us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142916.779143:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4612 00002000:00100000:3.0:1746142916.779149:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff880097430a80 x1830962867573504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.779157:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430a80 with x1830962867573504 ext(5062656->5066751) 00002000:00010000:3.0:1746142916.779161:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097430a80 00000100:00100000:0.0:1746142916.804080:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.804609:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867573248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28015us (29042us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142916.804620:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4611 00002000:00100000:2.0:1746142916.804629:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880097432300 x1830962867573248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.804638:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432300 with x1830962867573248 ext(2097152->4194303) 00002000:00010000:2.0:1746142916.804642:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097432300 00000100:00100000:1.0:1746142916.804777:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867573632 00000100:00100000:1.0:1746142916.804783:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867573632 00000100:00100000:1.0:1746142916.805236:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14704 00000100:00100000:1.0:1746142916.805243:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32674:x1830962867573632:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142916.805264:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.805279:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b35b expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.805301:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 19 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.805309:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.805315:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.805316:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142916.805319:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3776512->4030463] (req 3776512->4030463) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.805341:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.805352:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.805362:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867887616:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.805429:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 19 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.805436:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 19 pid: 11943 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.805443:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867887744:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.805458:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.807135:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867573120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 34859us (35002us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142916.807143:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4610 00002000:00100000:1.0:1746142916.807151:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880097431500 x1830962867573120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.807158:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431500 with x1830962867573120 ext(2097152->4194303) 00010000:00010000:1.0:1746142916.807163:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.807172:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746142916.807182:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097431500 00000100:00100000:1.0:1746142916.811738:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867887616:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.811750:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867887744:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.811772:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3776512->4030463] (req 3776512->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 42 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.811786:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3f000, rc 0) 00000100:00100000:1.0:1746142916.811835:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32674:x1830962867573632:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6592us (7761us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.811842:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14704 00000100:00100000:0.0:1746142916.812965:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.813044:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867573760 00000100:00100000:2.0:1746142916.813050:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867573760 00010000:00010000:2.0:1746142916.813074:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.813096:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6675 00000100:00100000:2.0:1746142916.813103:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867573760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.813113:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.813129:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.813138:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.813155:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800974cc000/0x2fa243e067cce2c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b33f expref: 42 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.813204:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.813230:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867573760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 127us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.813239:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6675 00000100:00100000:0.0:1746142916.816836:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.816957:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867573888 00000100:00100000:2.0:1746142916.816965:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867573888 00010000:00010000:2.0:1746142916.816991:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.817022:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6676 00000100:00100000:2.0:1746142916.817029:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867573888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.817044:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.817061:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.817071:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.817089:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711ac00/0x2fa243e067cce2ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b32a expref: 18 pid: 11943 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.817100:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.817102:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.817107:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.817114:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.817140:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.817149:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867887872:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142916.818268:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.818483:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179240 going to sleep for 11 seconds 00000100:00100000:1.0:1746142916.818569:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867574016 00000100:00100000:1.0:1746142916.818574:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867574016 00000100:00100000:1.0:1746142916.818606:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14705 00000100:00100000:1.0:1746142916.818612:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:32668:x1830962867574016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142916.818623:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142916.818633:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b362 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.818648:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.818653:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142916.818655:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142916.818657:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.818677:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 40 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.818686:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 40 pid: 1852 timeout: 790 lvb_type: 0 00000100:00100000:1.0:1746142916.818693:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867888000:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142916.818737:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18600 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.820258:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867887872:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.820275:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.820313:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867573888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3284us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.820321:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6676 00000100:00100000:1.0:1746142916.820407:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867888000:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142916.820421:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 18 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142916.820432:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bd3e200, rc 0) 00000100:00100000:1.0:1746142916.820449:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+18:32668:x1830962867574016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1838us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142916.820455:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14705 00000100:00100000:0.0:1746142916.821627:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.821677:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867574272 00000100:00100000:1.0:1746142916.821683:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867574272 00002000:00100000:1.0:1746142916.821713:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3776512->3780607) req@ffff880097431f80 x1830962867574272/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.821722:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431f80 with x1830962867574272 ext(3776512->3780607) 00010000:00010000:1.0:1746142916.821729:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.821743:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746142916.821748:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097431f80 00000100:00100000:1.0:1746142916.821770:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1430 00000100:00100000:1.0:1746142916.821775:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867574272:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142916.821879:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867574272:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 103us (256us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142916.821885:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1430 00002000:00100000:1.0:1746142916.821890:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3776512->3780607) req@ffff880097431f80 x1830962867574272/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142916.821896:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097431f80 with x1830962867574272 ext(3776512->3780607) 00010000:00010000:1.0:1746142916.821922:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:1.0:1746142916.821930:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:1.0:1746142916.821935:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097431f80 00000100:00100000:0.0:1746142916.825558:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.825644:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867574528 00000100:00100000:2.0:1746142916.825652:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867574528 00002000:00100000:2.0:1746142916.825687:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4026368->4030463) req@ffff880097433800 x1830962867574528/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.825696:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433800 with x1830962867574528 ext(4026368->4030463) 00010000:00010000:2.0:1746142916.825704:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.825715:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.825721:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097433800 00000100:00100000:2.0:1746142916.825774:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1431 00000100:00100000:2.0:1746142916.825782:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867574528:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142916.825891:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867574528:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 110us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142916.825916:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1431 00002000:00100000:2.0:1746142916.825920:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4026368->4030463) req@ffff880097433800 x1830962867574528/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/4536 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.825925:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433800 with x1830962867574528 ext(4026368->4030463) 00010000:00010000:2.0:1746142916.825929:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.825935:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.825938:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097433800 00000100:00100000:0.0:1746142916.828859:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142916.828933:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.828937:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867574912 00000100:00100000:3.0:1746142916.828944:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867574912 00000100:00100000:2.0:1746142916.829152:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867575040 00000100:00100000:2.0:1746142916.829156:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867575040 00002000:00100000:2.0:1746142916.829180:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3776512->4030463) req@ffff880097430e00 x1830962867575040/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.829188:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430e00 with x1830962867575040 ext(3776512->4030463) 00010000:00010000:2.0:1746142916.829195:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.829206:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 41 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.829211:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097430e00 00000100:00100000:2.0:1746142916.829227:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1432 00000100:00100000:2.0:1746142916.829232:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2004:x1830962867575040:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142916.829368:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5326 00000100:00100000:0.0:1746142916.829374:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f3a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32674:x1830962867574912:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:0.0:1746142916.829494:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f3a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32674:x1830962867574912:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 121us (642us total) trans 8589936729 rc 0/0 00000100:00100000:0.0:1746142916.829500:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5326 00000100:00100000:2.0:1746142916.833030:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867575040:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 3783us (4082us total) trans 21474841272 rc 0/0 00000100:00100000:2.0:1746142916.833041:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1432 00002000:00100000:2.0:1746142916.833051:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3776512->4030463) req@ffff880097430e00 x1830962867575040/t21474841272(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.833060:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430e00 with x1830962867575040 ext(3776512->4030463) 00010000:00010000:2.0:1746142916.833069:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 43 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.833081:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 43 pid: 1852 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.833088:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097430e00 00000100:00100000:0.0:1746142916.842160:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.842773:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867575168 00000100:00100000:2.0:1746142916.842781:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867575168 00010000:00010000:2.0:1746142916.842814:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 43 pid: 1852 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.842849:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6677 00000100:00100000:2.0:1746142916.842857:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867575168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.842868:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.842885:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 43 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.842895:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 43 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.842941:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3f000/0x2fa243e067cce2f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3776512->4030463) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b35b expref: 43 pid: 1852 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.842965:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.842967:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.842973:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.842981:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.843009:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 17 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.843019:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867888128:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.843643:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.848562:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.848631:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867575424 00000100:00100000:3.0:1746142916.848640:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867575424 00000100:00100000:2.0:1746142916.848658:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867888128:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.848676:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746142916.848679:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880097432d80 x1830962867575424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.848688:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432d80 with x1830962867575424 ext(3145728->4194303) 00002000:00010000:3.0:1746142916.848692:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097432d80 00000100:00100000:2.0:1746142916.848709:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867575168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5853us (6556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.848717:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6677 00000100:00100000:3.0:1746142916.848721:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4613 00000100:00100000:3.0:1746142916.848729:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867575424:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.858641:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867575424:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9904us (10077us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142916.858651:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4613 00002000:00100000:3.0:1746142916.858662:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880097432d80 x1830962867575424/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.858677:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097432d80 with x1830962867575424 ext(3145728->4194303) 00002000:00010000:3.0:1746142916.858682:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097432d80 00000100:00100000:0.0:1746142916.866982:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.867095:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867575680 00000100:00100000:3.0:1746142916.867104:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867575680 00002000:00100000:3.0:1746142916.867140:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880097433480 x1830962867575680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.867148:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433480 with x1830962867575680 ext(4194304->5066751) 00002000:00010000:3.0:1746142916.867153:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097433480 00000100:00100000:3.0:1746142916.867183:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4614 00000100:00100000:3.0:1746142916.867190:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867575680:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142916.877520:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867575680:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9894us (10111us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142916.877532:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4614 00002000:00100000:3.0:1746142916.877543:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880097433480 x1830962867575680/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.877551:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097433480 with x1830962867575680 ext(4194304->5066751) 00002000:00010000:3.0:1746142916.877556:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097433480 00000100:00100000:1.0:1746142916.928330:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142916.928981:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.929104:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867575808 00000100:00100000:2.0:1746142916.929111:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867575808 00000100:00100000:2.0:1746142916.929140:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867575936 00000100:00100000:2.0:1746142916.929142:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867575936 00000100:00100000:2.0:1746142916.929160:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14706 00000100:00100000:2.0:1746142916.929167:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867575808:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.929182:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.929195:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130a00/0x2fa243e067cce306 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b369 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.929235:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867888256:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142916.929270:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.929318:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.929330:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867576064 00000100:00100000:2.0:1746142916.929332:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867576064 00000100:00100000:3.0:1746142916.929335:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14707 00000100:00100000:3.0:1746142916.929342:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867575936:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:2.0:1746142916.929348:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14708 00010000:00010000:3.0:1746142916.929349:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746142916.929353:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867576064:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142916.929356:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800974cc800/0x2fa243e067cce30d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b370 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.929359:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.929367:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b377 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.929377:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.929379:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142916.929383:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867888384:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.929385:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.929397:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142916.929403:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9480 going to sleep for 11 seconds 00010000:00010000:2.0:1746142916.929405:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096131c00, rc 0) 00000100:00100000:2.0:1746142916.929424:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867576064:12345-192.168.204.50@tcp:101:cat.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.929429:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14708 00000100:00100000:3.0:1746142916.932577:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867888384:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142916.932605:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800974cc800/0x2fa243e067cce30d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b370 expref: 41 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.932617:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800974cc800/0x2fa243e067cce30d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b370 expref: 41 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142916.932675:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc800, rc 0) 00000100:00100000:3.0:1746142916.932723:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867575936:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3381us (3742us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142916.932730:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14707 00000100:00100000:2.0:1746142916.933615:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867888256:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142916.933633:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130a00/0x2fa243e067cce306 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b369 expref: 39 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.933643:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130a00/0x2fa243e067cce306 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b369 expref: 39 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142916.933662:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130a00, rc 0) 00000100:00100000:2.0:1746142916.933693:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2003:x1830962867575808:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4525us (5369us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142916.933698:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14706 00000100:00100000:0.0:1746142916.937412:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.937543:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867576192 00000100:00100000:2.0:1746142916.937550:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867576192 00000100:00100000:2.0:1746142916.937594:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14709 00000100:00100000:2.0:1746142916.937601:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32681:x1830962867576192:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.937616:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.937629:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b37e expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.937651:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.937656:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.937657:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.937660:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.937685:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 23 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.937694:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 23 pid: 9580 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.937704:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867888512:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.937788:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.942651:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142916.942660:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867888512:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142916.942687:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142916.942702:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130400, rc 0) 00000100:00100000:0.0:1746142916.942722:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867576320 00000100:00100000:0.0:1746142916.942728:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867576320 00000100:00100000:3.0:1746142916.942753:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32681:x1830962867576192:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5152us (5347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142916.942760:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14709 00002000:00100000:0.0:1746142916.942770:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2064384->2097151) req@ffff8800924f7480 x1830962867576320/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142916.942777:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7480 with x1830962867576320 ext(2064384->2097151) 00010000:00010000:0.0:1746142916.942787:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 24 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:0.0:1746142916.942798:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 24 pid: 9580 timeout: 790 lvb_type: 0 00002000:00010000:0.0:1746142916.942808:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924f7480 00000100:00100000:0.0:1746142916.942833:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1433 00000100:00100000:0.0:1746142916.942839:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867576320:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142916.950446:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867576320:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7599us (7809us total) trans 17179874016 rc 0/0 00000100:00100000:2.0:1746142916.950455:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1433 00002000:00100000:2.0:1746142916.950465:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2064384->2097151) req@ffff8800924f7480 x1830962867576320/t17179874016(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.950472:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f7480 with x1830962867576320 ext(2064384->2097151) 00010000:00010000:2.0:1746142916.950481:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 26 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.950494:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 26 pid: 9580 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.950697:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924f7480 00000100:00100000:0.0:1746142916.954400:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.954490:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867576448 00000100:00100000:2.0:1746142916.954498:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867576448 00010000:00010000:2.0:1746142916.954528:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 26 pid: 9580 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.954637:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6678 00000100:00100000:2.0:1746142916.954646:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2003:x1830962867576448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.954657:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.954673:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 26 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.954684:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 26 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.954704:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d77200/0x2fa243e067cce242 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2cf expref: 26 pid: 9580 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.954732:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.954734:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.954740:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 38 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.954747:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 38 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.954775:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 38 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.954784:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867888640:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.954862:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.956537:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867888640:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.956553:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.956582:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+25:2003:x1830962867576448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1937us (2189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.956599:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6678 00000100:00100000:0.0:1746142916.958216:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.958292:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867576704 00000100:00100000:2.0:1746142916.958299:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867576704 00002000:00100000:2.0:1746142916.958331:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097430380 x1830962867576704/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.958341:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430380 with x1830962867576704 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.958345:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097430380 00000100:00100000:2.0:1746142916.958376:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4615 00000100:00100000:2.0:1746142916.958383:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867576704:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142916.965310:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867576704:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6918us (7089us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142916.965321:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4615 00002000:00100000:2.0:1746142916.965332:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880097430380 x1830962867576704/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.965340:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430380 with x1830962867576704 ext(1048576->2097151) 00002000:00010000:2.0:1746142916.965345:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097430380 00000100:00100000:0.0:1746142916.974657:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.974828:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867576960 00000100:00100000:2.0:1746142916.974836:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867576960 00000100:00100000:2.0:1746142916.974883:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14540 00000100:00100000:2.0:1746142916.974890:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:32683:x1830962867576960:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142916.974922:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.974937:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cce322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b385 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.974996:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975007:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975015:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975026:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975031:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975037:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975121:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975130:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975135:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746142916.975142:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142916.975200:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975209:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975213:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975218:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975222:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096130000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142916.975225:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975231:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975239:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142916.975242:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142916.975255:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975259:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130000/0x2fa243e067cce329 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975272:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975276:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975280:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975284:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096131e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142916.975286:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975290:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975295:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880134572000) 00010000:00010000:2.0:1746142916.975297:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142916.975300:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975304:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096131e00/0x2fa243e067cce330 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142916.975339:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130e00/0x2fa243e067cce322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.975349:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.975354:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142916.975356:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142916.975358:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130200, rc 0) 00000100:00100000:2.0:1746142916.976455:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:32683:x1830962867576960:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1563us (1802us total) trans 8589936730 rc 0/0 00000100:00100000:2.0:1746142916.976462:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14540 00000100:00100000:1.0:1746142916.977433:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.977501:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867577088 00000100:00100000:2.0:1746142916.977507:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867577088 00000100:00100000:2.0:1746142916.977533:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14710 00000100:00100000:2.0:1746142916.977538:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32681:x1830962867577088:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142916.977553:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142916.977565:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b38c expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.977584:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.977591:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.977593:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142916.977596:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 40 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.977620:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 24 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.977630:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 24 pid: 1853 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.977639:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867888768:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142916.977692:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179240 going to sleep for 11 seconds 00000100:00100000:2.0:1746142916.980621:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867888768:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142916.980652:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 40 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.980669:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130800, rc 0) 00000100:00100000:2.0:1746142916.981669:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32681:x1830962867577088:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4125us (4233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.981680:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14710 00000100:00100000:0.0:1746142916.982156:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.982308:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867577216 00000100:00100000:2.0:1746142916.982314:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867577216 00002000:00100000:2.0:1746142916.982347:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1273855) req@ffff880097430700 x1830962867577216/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.982357:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430700 with x1830962867577216 ext(1048576->1273855) 00010000:00010000:2.0:1746142916.982365:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 25 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.982377:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 25 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.982382:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097430700 00000100:00100000:2.0:1746142916.982398:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1434 00000100:00100000:2.0:1746142916.982404:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867577216:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142916.986222:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867577216:12345-192.168.204.50@tcp:4:cat.0 Request processed in 3806us (4054us total) trans 17179874017 rc 0/0 00000100:00100000:2.0:1746142916.986233:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1434 00002000:00100000:2.0:1746142916.986255:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->1273855) req@ffff880097430700 x1830962867577216/t17179874017(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:67/0 lens 488/448 e 0 to 0 dl 1746142927 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142916.986266:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097430700 with x1830962867577216 ext(1048576->1273855) 00010000:00010000:2.0:1746142916.986276:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 27 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.986296:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 27 pid: 1853 timeout: 790 lvb_type: 0 00002000:00010000:2.0:1746142916.986302:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097430700 00000100:00100000:0.0:1746142916.988320:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.988532:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867577344 00000100:00100000:2.0:1746142916.988541:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867577344 00010000:00010000:2.0:1746142916.988574:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 27 pid: 1853 timeout: 790 lvb_type: 0 00000100:00100000:2.0:1746142916.988622:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6679 00000100:00100000:2.0:1746142916.988631:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867577344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142916.988645:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142916.988665:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 27 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.988675:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 27 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.988695:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bd3f400/0x2fa243e067cce28f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1273855) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b30e expref: 27 pid: 1853 timeout: 790 lvb_type: 0 00010000:00010000:2.0:1746142916.988733:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.988735:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142916.988743:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.988756:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142916.988788:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142916.988801:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867888896:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142916.988929:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142916.994074:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142916.994374:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7219:1830962867888896:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142916.994392:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142916.994433:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2004:x1830962867577344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5803us (6120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142916.994442:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6679 00000100:00100000:3.0:1746142916.995263:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867577600 00000100:00100000:3.0:1746142916.995270:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867577600 00002000:00100000:3.0:1746142916.995303:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800979b3800 x1830962867577600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/0 e 0 to 0 dl 1746142927 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142916.995311:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3800 with x1830962867577600 ext(1048576->2097151) 00002000:00010000:3.0:1746142916.995315:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b3800 00000100:00100000:3.0:1746142916.995334:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4616 00000100:00100000:3.0:1746142916.995340:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867577600:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.015857:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867577600:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20508us (21782us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142917.015866:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4616 00002000:00100000:3.0:1746142917.015875:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800979b3800 x1830962867577600/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:67/0 lens 488/440 e 0 to 0 dl 1746142927 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.015882:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b3800 with x1830962867577600 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.015888:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800979b3800 00000100:00100000:0.0:1746142917.034339:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.034430:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867577856 00000100:00100000:3.0:1746142917.034438:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867577856 00002000:00100000:3.0:1746142917.034492:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800979b0e00 x1830962867577856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.034500:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0e00 with x1830962867577856 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.034505:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b0e00 00000100:00080000:1.0:1746142917.034566:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142917.035760:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4617 00000100:00100000:1.0:1746142917.035817:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867577856:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142917.053880:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867577856:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18104us (19541us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746142917.053894:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4617 00002000:00100000:1.0:1746142917.053926:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800979b0e00 x1830962867577856/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142917.053937:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b0e00 with x1830962867577856 ext(2097152->4194303) 00002000:00010000:1.0:1746142917.053943:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800979b0e00 00000100:00100000:0.0:1746142917.063998:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.064103:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867577984 00000100:00100000:2.0:1746142917.064111:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867577984 00000100:00080000:1.0:1746142917.064237:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142917.066006:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.066040:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578240 00000100:00100000:0.0:1746142917.066045:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578240 00000100:00100000:0.0:1746142917.066086:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14541 00000100:00100000:0.0:1746142917.066092:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32685:x1830962867578240:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142917.066111:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.066125:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b39a expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.066206:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.066217:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 37 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.066224:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.066233:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.066279:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.066289:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 18 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.066299:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867889024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142917.066368:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 37 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.066375:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 37 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.066400:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800979b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867889152:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.066418:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324339c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746142917.066618:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746142917.066709:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14711 00000100:00100000:2.0:1746142917.066718:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32683:x1830962867577984:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.066725:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.066733:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b393 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.066748:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.066754:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 42 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.066760:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.066762:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.066764:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3350528->3907583] (req 3350528->3907583) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.066776:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 42 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.066783:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 42 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.066789:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867889280:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.066815:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.066822:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.066827:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867889408:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.066837:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.068785:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.071421:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578496 00000100:00100000:2.0:1746142917.071430:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578496 00002000:00100000:2.0:1746142917.071474:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88009734c000 x1830962867578496/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.071489:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c000 with x1830962867578496 ext(4194304->5066751) 00010000:00010000:2.0:1746142917.071498:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.071508:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00002000:00010000:2.0:1746142917.071514:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734c000 00000100:00100000:3.0:1746142917.072146:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1435 00000100:00100000:3.0:1746142917.072156:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867578496:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142917.077656:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.078106:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867889152:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.078171:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867889280:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.078180:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867889408:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.078203:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3350528->3907583] (req 3350528->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 19 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.078217:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06800, rc 0) 00000100:00100000:2.0:1746142917.078261:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32683:x1830962867577984:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 11545us (14269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.078267:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14711 00000100:00100000:1.0:1746142917.079108:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800979b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867889024:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.079126:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142917.079472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.079518:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.079544:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578624 00000100:00100000:0.0:1746142917.079548:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578624 00010000:00010000:0.0:1746142917.079572:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 38 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.079593:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578880 00000100:00100000:0.0:1746142917.079595:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578880 00000100:00100000:2.0:1746142917.079852:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867578496:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7698us (11073us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142917.079859:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1435 00002000:00100000:2.0:1746142917.079866:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88009734c000 x1830962867578496/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.079874:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734c000 with x1830962867578496 ext(4194304->5066751) 00010000:00010000:2.0:1746142917.079880:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.079891:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00002000:00010000:2.0:1746142917.079897:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009734c000 00000100:00100000:2.0:1746142917.079957:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867578752 00000100:00100000:2.0:1746142917.079960:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867578752 00010000:00010000:2.0:1746142917.079970:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.079984:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6680 00000100:00100000:2.0:1746142917.079990:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2004:x1830962867578624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142917.079999:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142917.080003:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 38 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.080012:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 38 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.080028:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009711a200/0x2fa243e067cce2dc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b346 expref: 38 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.080041:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.080045:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.080052:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.080057:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.080213:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6681 00000100:00100000:3.0:1746142917.080220:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:2005:x1830962867578752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.080227:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.080242:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.080261:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.080275:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bd3e200/0x2fa243e067cce2ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b362 expref: 19 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.080289:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142917.081407:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 19 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.081429:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6682 00000100:00100000:0.0:1746142917.081435:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867578880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.081443:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.081447:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 19 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.081454:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 19 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.081466:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce337 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b385 expref: 19 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.081478:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.081482:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.081488:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.081493:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00000100:00080000:1.0:1746142917.081874:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746142917.082830:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867578624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2834us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.082839:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6680 00010000:00010000:0.0:1746142917.083045:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.083120:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867578752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2898us (3599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.083126:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6681 00000100:00100000:0.0:1746142917.083217:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867578880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1782us (3745us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.083223:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6682 00010000:00010000:0.0:1746142917.083259:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.083265:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142917.083280:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142917.083376:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 38 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.083387:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 37 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.083393:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.083395:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142917.083397:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c200, rc 0) 00000100:00100000:0.0:1746142917.084391:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32685:x1830962867578240:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 18297us (18387us total) trans 8589936731 rc 0/0 00000100:00100000:0.0:1746142917.084397:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14541 00000100:00100000:0.0:1746142917.094610:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.094653:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579008 00000100:00100000:0.0:1746142917.094659:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579008 00000100:00100000:0.0:1746142917.094709:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14712 00000100:00100000:0.0:1746142917.094716:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867579008:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.094731:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.094753:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c880c00/0x2fa243e067cce368 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3a1 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.094781:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.094790:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c880c00/0x2fa243e067cce368 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a1 expref: 44 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.094815:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c880c00/0x2fa243e067cce368 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a1 expref: 44 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.094831:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880c00, rc 0) 00000100:00100000:0.0:1746142917.094870:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867579008:12345-192.168.204.50@tcp:101:cat.0 Request processed in 154us (271us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142917.094876:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14712 00000100:00100000:0.0:1746142917.104456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.104483:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579136 00000100:00100000:0.0:1746142917.104490:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579136 00010000:00010000:0.0:1746142917.104517:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.104538:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6683 00000100:00100000:0.0:1746142917.104544:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867579136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.104554:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.104570:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.104581:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.104602:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096131c00/0x2fa243e067cce314 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b377 expref: 43 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.104615:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.104617:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.104623:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.104630:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.104654:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.104665:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867889536:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142917.106345:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.108485:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.108565:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579392 00000100:00100000:2.0:1746142917.108573:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579392 00002000:00100000:2.0:1746142917.108609:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3350528->3354623) req@ffff88009cd5c000 x1830962867579392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.108617:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c000 with x1830962867579392 ext(3350528->3354623) 00002000:00010000:2.0:1746142917.108621:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5c000 00000100:00100000:2.0:1746142917.108638:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4618 00000100:00100000:2.0:1746142917.108645:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867579392:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142917.111000:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867579392:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 2348us (2513us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142917.111010:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4618 00002000:00100000:2.0:1746142917.111019:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3350528->3354623) req@ffff88009cd5c000 x1830962867579392/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.111026:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c000 with x1830962867579392 ext(3350528->3354623) 00002000:00010000:2.0:1746142917.111030:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5c000 00000100:00100000:0.0:1746142917.116441:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.116520:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867889536:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.116546:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142917.116582:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867579136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12038us (12133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.116591:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6683 00000100:00100000:3.0:1746142917.116870:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579648 00000100:00100000:3.0:1746142917.116875:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579648 00002000:00100000:3.0:1746142917.116925:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3903488->3907583) req@ffff88009cd5e680 x1830962867579648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.116933:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5e680 with x1830962867579648 ext(3903488->3907583) 00002000:00010000:3.0:1746142917.116938:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5e680 00000100:00100000:3.0:1746142917.116953:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4619 00000100:00100000:3.0:1746142917.116959:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867579648:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.117053:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+18:2005:x1830962867579648:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 94us (620us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.117059:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4619 00002000:00100000:3.0:1746142917.117063:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3903488->3907583) req@ffff88009cd5e680 x1830962867579648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.117075:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5e680 with x1830962867579648 ext(3903488->3907583) 00002000:00010000:3.0:1746142917.117078:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5e680 00010000:00010000:3.0:1746142917.124690:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142917.129022:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.129178:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867579776 00000100:00100000:2.0:1746142917.129185:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867579776 00000100:00100000:2.0:1746142917.129220:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14713 00000100:00100000:2.0:1746142917.129227:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32681:x1830962867579776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.129251:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.129266:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3a8 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.129288:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.129294:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142917.129295:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142917.129298:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [5062656->5242879] (req 5062656->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.129321:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 17 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.129330:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 17 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.129339:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867889664:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.129419:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.130620:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.131892:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580032 00000100:00100000:3.0:1746142917.131915:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580032 00000100:00100000:3.0:1746142917.131948:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5327 00000100:00100000:3.0:1746142917.131954:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+18:32683:x1830962867580032:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142917.134873:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:32683:x1830962867580032:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 2911us (4247us total) trans 8589936732 rc 0/0 00000100:00100000:3.0:1746142917.134884:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5327 00000100:00100000:1.0:1746142917.135125:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.135439:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580160 00000100:00100000:0.0:1746142917.135446:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580160 00000100:00100000:0.0:1746142917.136150:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14714 00000100:00100000:0.0:1746142917.136158:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32685:x1830962867580160:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142917.136169:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.136183:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3af expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.136203:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142917.136205:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142917.136208:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3756031] (req 3416064->3756031) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 45 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.136217:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3756031] (req 3416064->3756031) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 45 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.136225:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927fd400, rc 0) 00000100:00100000:0.0:1746142917.142560:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32685:x1830962867580160:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6393us (7425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.142569:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14714 00000100:00100000:0.0:1746142917.143362:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.143402:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.143419:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580416 00000100:00100000:0.0:1746142917.143425:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580416 00000100:00100000:0.0:1746142917.143454:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14542 00000100:00100000:0.0:1746142917.143459:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:32687:x1830962867580416:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142917.143477:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.143491:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927fc000/0x2fa243e067cce37d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3b6 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.143534:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143543:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143551:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143561:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143565:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143569:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143625:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143633:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 36 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.143639:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.143662:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 36 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.143672:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 36 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.143682:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867889792:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.143746:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.143918:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580288 00000100:00100000:1.0:1746142917.143922:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580288 00002000:00100000:1.0:1746142917.143946:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3350528->3907583) req@ffff88012dc63800 x1830962867580288/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142917.143960:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63800 with x1830962867580288 ext(3350528->3907583) 00010000:00010000:1.0:1746142917.143966:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 18 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.143974:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 18 pid: 9580 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746142917.143979:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc63800 00000100:00100000:1.0:1746142917.143992:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1436 00000100:00100000:1.0:1746142917.143997:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+18:2004:x1830962867580288:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142917.144195:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867889664:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.144212:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [5062656->5242879] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.144224:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07200, rc 0) 00000100:00100000:2.0:1746142917.144952:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32681:x1830962867579776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 15724us (15937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.144958:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14713 00000100:00100000:2.0:1746142917.146151:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.146240:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580544 00000100:00100000:1.0:1746142917.146253:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580544 00010000:00010000:1.0:1746142917.146275:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 37 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.146293:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6684 00000100:00100000:1.0:1746142917.146299:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867580544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142917.146307:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142917.146312:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 37 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.146320:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 37 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.146336:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.146340:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.146348:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.146354:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.146366:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142917.146390:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7fb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2004:x1830962867580544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.146396:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6684 00010000:00010000:0.0:1746142917.146778:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c200/0x2fa243e067cce353 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b39a expref: 36 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.146796:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867889792:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142917.146808:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146814:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146818:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142917.146852:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:0.0:1746142917.146855:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746142917.146866:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146872:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146880:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146885:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146889:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146894:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146924:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3d400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.146927:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146933:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146940:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142917.146942:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142917.146944:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146948:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d400/0x2fa243e067cce384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146955:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146959:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146963:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146966:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3c600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.146968:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146971:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146975:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880091eb9300) 00010000:00010000:0.0:1746142917.146977:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142917.146978:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.146982:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c600/0x2fa243e067cce38b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.147004:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927fc000/0x2fa243e067cce37d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.147013:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 15 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.147018:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.147020:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142917.147021:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3de00, rc 0) 00000100:00100000:0.0:1746142917.147050:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:32687:x1830962867580416:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 3590us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.147055:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14542 00000100:00100000:1.0:1746142917.153032:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867580288:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 9027us (9664us total) trans 21474841273 rc 0/0 00000100:00100000:1.0:1746142917.153042:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1436 00002000:00100000:1.0:1746142917.153052:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3350528->3907583) req@ffff88012dc63800 x1830962867580288/t21474841273(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142917.153061:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc63800 with x1830962867580288 ext(3350528->3907583) 00010000:00010000:1.0:1746142917.153069:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 20 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.153082:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 20 pid: 9580 timeout: 791 lvb_type: 0 00002000:00010000:1.0:1746142917.153088:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc63800 00000100:00100000:0.0:1746142917.154067:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.154289:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580672 00000100:00100000:2.0:1746142917.154295:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580672 00000100:00100000:2.0:1746142917.154338:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14715 00000100:00100000:2.0:1746142917.154345:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867580672:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142917.154356:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.154367:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3bd expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.154383:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.154385:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.154391:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.154402:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.154410:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07000, rc 0) 00000100:00100000:2.0:1746142917.154431:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867580672:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.154435:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14715 00000100:00080000:1.0:1746142917.154684:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142917.156847:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.157065:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.157346:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.157507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.157580:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580928 00000100:00100000:2.0:1746142917.157587:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580928 00000100:00100000:2.0:1746142917.157623:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867580800 00000100:00100000:2.0:1746142917.157625:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867580800 00000100:00100000:1.0:1746142917.157644:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581056 00000100:00100000:1.0:1746142917.157647:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581056 00000100:00100000:3.0:1746142917.157757:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581184 00000100:00100000:3.0:1746142917.157760:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581184 00010000:00010000:3.0:1746142917.157780:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 20 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.157800:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6685 00000100:00100000:3.0:1746142917.157807:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867581184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.157817:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.157833:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 20 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.157843:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 20 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.157862:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06800/0x2fa243e067cce35a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3350528->3907583) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b393 expref: 20 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.157878:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.157880:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.157886:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.157893:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.157915:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.157916:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.157920:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.157925:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.157950:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.157961:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867889920:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142917.158018:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.158026:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867890048:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142917.158042:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.160401:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14716 00000100:00100000:2.0:1746142917.160414:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867580928:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:1.0:1746142917.160557:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14717 00000100:00100000:1.0:1746142917.160565:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867580800:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142917.160576:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.160590:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3c4 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.160607:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.160608:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.160614:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.160627:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.160635:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2be00, rc 0) 00000100:00100000:1.0:1746142917.160669:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867580800:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 106us (3605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.160674:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14717 00000100:00100000:1.0:1746142917.160688:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14718 00000100:00100000:1.0:1746142917.160694:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867581056:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142917.160700:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.160705:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3d2 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.160714:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.160715:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.160720:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.160727:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 16 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.160734:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2bc00, rc 0) 00000100:00100000:1.0:1746142917.160747:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:2006:x1830962867581056:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 54us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.160752:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14718 00000100:00080000:1.0:1746142917.160769:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746142917.161523:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.161539:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06e00/0x2fa243e067cce3ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3cb expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.161558:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06e00/0x2fa243e067cce3ae lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3cb expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.161567:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06e00/0x2fa243e067cce3ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3cb expref: 13 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.161589:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06e00, rc 0) 00000100:00100000:2.0:1746142917.161612:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867580928:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 1203us (4772us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142917.161618:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14716 00000100:00100000:0.0:1746142917.163147:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.163167:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581440 00000100:00100000:0.0:1746142917.163173:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581440 00000100:00100000:0.0:1746142917.163203:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14543 00000100:00100000:0.0:1746142917.163210:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32690:x1830962867581440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.163226:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.163238:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067cce3b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3d9 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.163308:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163319:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163327:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163337:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163341:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163345:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163427:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163435:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163440:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:0.0:1746142917.163447:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142917.163510:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163515:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163519:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163524:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163530:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3ca00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.163533:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163539:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163547:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142917.163552:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142917.163555:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163559:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ca00/0x2fa243e067cce3bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163583:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163587:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163591:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163595:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3d200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.163597:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163601:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163608:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9fed00) 00010000:00010000:0.0:1746142917.163609:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142917.163612:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163616:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d200/0x2fa243e067cce3c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.163645:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d600/0x2fa243e067cce3b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 22 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.163653:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 21 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.163657:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.163659:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746142917.163661:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3dc00, rc 0) 00000100:00100000:0.0:1746142917.163687:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:32690:x1830962867581440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 478us (544us total) trans 8589936733 rc 0/0 00000100:00100000:0.0:1746142917.163693:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14543 00000100:00100000:0.0:1746142917.163775:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.163891:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581568 00000100:00100000:3.0:1746142917.163895:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867889920:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142917.163895:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581568 00000100:00100000:3.0:1746142917.163930:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:13297:1830962867890048:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142917.163943:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14719 00010000:00010000:3.0:1746142917.163947:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.163949:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867581568:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.163957:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.163966:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cce3d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3e0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.163970:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867581184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6163us (6462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.163978:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6685 00010000:00010000:2.0:1746142917.163983:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cce3d8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e0 expref: 45 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.163990:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06200/0x2fa243e067cce3d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e0 expref: 45 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.164002:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06200, rc 0) 00000100:00100000:2.0:1746142917.164019:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867581568:12345-192.168.204.50@tcp:101:cat.0 Request processed in 71us (244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142917.164024:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14719 00000100:00100000:2.0:1746142917.167015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.167058:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.167094:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.167115:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867581824 00000100:00100000:2.0:1746142917.167121:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867581824 00002000:00100000:2.0:1746142917.167152:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3420159) req@ffff8800924f5180 x1830962867581824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.167159:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f5180 with x1830962867581824 ext(3416064->3420159) 00002000:00010000:2.0:1746142917.167163:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f5180 00000100:00100000:2.0:1746142917.167175:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867582336 00000100:00100000:2.0:1746142917.167177:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867582336 00002000:00100000:2.0:1746142917.167184:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff8800924f4000 x1830962867582336/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.167190:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f4000 with x1830962867582336 ext(5062656->5066751) 00002000:00010000:2.0:1746142917.167192:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f4000 00000100:00100000:2.0:1746142917.167205:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4620 00000100:00100000:2.0:1746142917.167210:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867581824:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.167331:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4621 00000100:00100000:3.0:1746142917.167338:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867582336:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142917.167557:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867582080 00000100:00100000:0.0:1746142917.167561:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867582080 00000100:00100000:0.0:1746142917.167583:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14544 00000100:00100000:0.0:1746142917.167587:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:32687:x1830962867582080:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142917.167597:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.167609:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067cce3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3e7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.167677:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142917.167692:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.167698:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 20 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.167704:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142917.167727:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 20 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.167737:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 20 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.167746:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867890176:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.168029:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867582336:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 690us (932us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.168035:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4621 00002000:00100000:3.0:1746142917.168040:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (5062656->5066751) req@ffff8800924f4000 x1830962867582336/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.168047:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f4000 with x1830962867582336 ext(5062656->5066751) 00002000:00010000:3.0:1746142917.168050:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f4000 00000100:00100000:2.0:1746142917.168867:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867581824:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1656us (1858us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142917.168873:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4620 00002000:00100000:2.0:1746142917.168878:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3420159) req@ffff8800924f5180 x1830962867581824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.168884:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924f5180 with x1830962867581824 ext(3416064->3420159) 00002000:00010000:2.0:1746142917.168887:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924f5180 00010000:00010000:0.0:1746142917.169066:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 16 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.169074:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 16 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.169082:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d73800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867890304:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.169355:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.170872:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.171274:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867582592 00000100:00100000:3.0:1746142917.171281:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867582592 00000100:00100000:3.0:1746142917.171311:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5328 00000100:00100000:3.0:1746142917.171318:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:32690:x1830962867582592:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142917.171471:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:32690:x1830962867582592:12345-192.168.204.50@tcp:35:cat.0 Request processed in 153us (601us total) trans 8589936734 rc 0/0 00000100:00100000:3.0:1746142917.171478:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5328 00000100:00100000:0.0:1746142917.175975:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.176106:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867582848 00000100:00100000:2.0:1746142917.176113:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867582848 00002000:00100000:2.0:1746142917.176146:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3751936->3756031) req@ffff880135d73480 x1830962867582848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.176155:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d73480 with x1830962867582848 ext(3751936->3756031) 00002000:00010000:2.0:1746142917.176159:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d73480 00000100:00100000:2.0:1746142917.176179:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4622 00000100:00100000:2.0:1746142917.176186:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867582848:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142917.176303:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867582848:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 117us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142917.176309:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4622 00002000:00100000:2.0:1746142917.176314:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3751936->3756031) req@ffff880135d73480 x1830962867582848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.176320:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d73480 with x1830962867582848 ext(3751936->3756031) 00002000:00010000:2.0:1746142917.176323:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d73480 00000100:00100000:1.0:1746142917.176433:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867890176:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.179546:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.179594:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.179655:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867582976 00000100:00100000:3.0:1746142917.179662:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867582976 00000100:00100000:3.0:1746142917.179692:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14545 00000100:00100000:3.0:1746142917.179698:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:32690:x1830962867582976:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142917.179717:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.179732:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc000/0x2fa243e067cce3ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3ee expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.179777:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.179787:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.179792:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.179804:0:7232:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.179813:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:2.0:1746142917.180173:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867583104 00000100:00100000:2.0:1746142917.180177:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867583104 00010000:00010000:2.0:1746142917.180194:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 24 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.180219:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6686 00000100:00100000:2.0:1746142917.180225:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867583104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142917.180233:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142917.180237:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 24 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.180254:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 24 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.180269:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3dc00/0x2fa243e067cce3ca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d9 expref: 24 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.180291:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.180294:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142917.180300:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.180305:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142917.180309:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.180313:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.180352:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867583104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.180358:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6686 00000100:00100000:0.0:1746142917.181895:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.181960:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.182025:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d73800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867890304:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.182043:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746142917.182167:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867583360 00000100:00100000:2.0:1746142917.182171:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867583360 00000100:00100000:3.0:1746142917.182262:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867583488 00000100:00100000:3.0:1746142917.182265:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867583488 00010000:00010000:3.0:1746142917.182279:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 17 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.182296:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6687 00000100:00100000:3.0:1746142917.182301:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867583488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.182310:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.182314:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 17 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.182326:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 17 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.182341:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3de00/0x2fa243e067cce392 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3b6 expref: 17 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.182354:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.182358:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.182364:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.182369:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.182375:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.182380:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.182384:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.182396:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.182440:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5329 00000100:00100000:2.0:1746142917.182446:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32685:x1830962867583360:12345-192.168.204.50@tcp:35:multiop.0 00010000:00010000:1.0:1746142917.182603:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.182608:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142917.182620:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142917.182669:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3ce00/0x2fa243e067cce3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.182686:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 17 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.182692:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 17 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.182699:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c400, rc 0) 00000100:00100000:3.0:1746142917.183239:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+17:2005:x1830962867583488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 936us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.183254:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6687 00000100:00100000:2.0:1746142917.183341:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32685:x1830962867583360:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 894us (1448us total) trans 8589936735 rc 0/0 00000100:00100000:2.0:1746142917.183347:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5329 00000100:00100000:1.0:1746142917.183393:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:32687:x1830962867582080:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 15804us (16334us total) trans 8589936736 rc 0/0 00000100:00100000:1.0:1746142917.183398:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14544 00000100:00100000:0.0:1746142917.187813:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.187875:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867583744 00000100:00100000:1.0:1746142917.187882:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867583744 00000100:00100000:1.0:1746142917.187953:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14546 00000100:00100000:1.0:1746142917.187959:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+16:32687:x1830962867583744:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142917.187977:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.187991:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067cce402 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3f5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.188061:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.188072:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.188079:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746142917.189611:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.189813:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867583872 00000100:00100000:3.0:1746142917.189819:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867583872 00010000:00010000:3.0:1746142917.189838:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 18 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.189867:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6688 00000100:00100000:3.0:1746142917.189873:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+18:2004:x1830962867583872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.189883:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.189887:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 18 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.189897:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 18 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.189929:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce3e6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3e7 expref: 18 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.189949:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.189953:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.189960:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.189966:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.189973:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.189977:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.189985:0:13297:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.190011:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142917.190016:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.190020:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142917.190032:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000100:00100000:3.0:1746142917.190044:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867583872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 170us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.190049:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6688 00010000:00010000:1.0:1746142917.190110:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a800/0x2fa243e067cce402 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.190255:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.190261:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142917.190285:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:2.0:1746142917.190289:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142917.190298:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.190304:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.190319:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc000/0x2fa243e067cce3ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 23 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.190331:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 22 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.190336:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.190338:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142917.190340:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974cc800, rc 0) 00010000:00010000:1.0:1746142917.190379:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.190385:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.190386:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142917.190388:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a600, rc 0) 00000100:00100000:2.0:1746142917.190747:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:32690:x1830962867582976:12345-192.168.204.50@tcp:101:cat.0 Request processed in 11047us (11205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.190756:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14545 00000100:00100000:1.0:1746142917.190849:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:32687:x1830962867583744:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 2889us (3042us total) trans 8589936737 rc 0/0 00000100:00100000:1.0:1746142917.190853:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14546 00000100:00100000:0.0:1746142917.192968:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.193003:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.193061:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584000 00000100:00100000:1.0:1746142917.193067:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584000 00000100:00100000:1.0:1746142917.193099:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14547 00000100:00100000:1.0:1746142917.193104:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:32687:x1830962867584000:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142917.193120:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.193132:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067cce417 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b3fc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.193172:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067cce417 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3fc expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.193183:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067cce417 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3fc expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.193196:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.193198:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142917.193201:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2ae00, rc 0) 00000100:00100000:1.0:1746142917.193228:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+18:32687:x1830962867584000:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 124us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.193233:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14547 00000100:00100000:2.0:1746142917.193295:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584128 00000100:00100000:2.0:1746142917.193298:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584128 00000100:00100000:2.0:1746142917.193331:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14720 00000100:00100000:2.0:1746142917.193340:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867584128:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.193347:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.193355:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b403 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.193369:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.193371:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.193377:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 27 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.193387:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 27 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.193394:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06200, rc 0) 00000100:00100000:2.0:1746142917.193413:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867584128:12345-192.168.204.50@tcp:101:cat.0 Request processed in 77us (410us total) trans 0 rc 0/0 00000100:00080000:0.0:1746142917.193988:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746142917.194564:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14720 00000100:00100000:0.0:1746142917.197328:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.197357:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.197378:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.197390:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.197407:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584256 00000100:00100000:0.0:1746142917.197408:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.197415:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584256 00000100:00100000:0.0:1746142917.197433:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.197549:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584640 00000100:00100000:3.0:1746142917.197552:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584640 00000100:00100000:3.0:1746142917.197564:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584896 00000100:00100000:3.0:1746142917.197565:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584896 00000100:00100000:0.0:1746142917.197571:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.197576:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585152 00000100:00100000:3.0:1746142917.197578:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585152 00000100:00100000:3.0:1746142917.197583:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584512 00000100:00100000:0.0:1746142917.197583:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584768 00000100:00100000:3.0:1746142917.197584:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584512 00000100:00100000:0.0:1746142917.197585:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584768 00000100:00100000:3.0:1746142917.197590:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585024 00000100:00100000:3.0:1746142917.197591:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585024 00000100:00100000:3.0:1746142917.197598:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14721 00000100:00100000:3.0:1746142917.197604:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867584256:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142917.197604:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14722 00000100:00100000:0.0:1746142917.197608:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867584640:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:3.0:1746142917.197617:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.197629:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b40a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.197630:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.197643:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.197644:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.197646:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.197649:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 28 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197651:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.197655:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 18 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.197661:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.197662:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.197663:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.197667:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197674:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3e00, rc 0) 00010000:00010000:0.0:1746142917.197683:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 18 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.197691:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 18 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.197700:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867890432:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.197703:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867584256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 101us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.197708:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14721 00000100:00100000:3.0:1746142917.197720:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14723 00000100:00100000:3.0:1746142917.197724:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867584896:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:3.0:1746142917.197738:0:11943:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.197742:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 27 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197745:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.197749:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 27 pid: 9580 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.197752:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 18 pid: 1852 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746142917.197757:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867890560:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.197758:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197763:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.197764:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.197766:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.197774:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.197780:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 39 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.197782:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197788:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 14 pid: 11943 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.197792:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867890688:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.197796:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867890816:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.197804:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433000 going to sleep for 11 seconds 00010000:00010000:3.0:1746142917.197813:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 18 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197818:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 18 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.197825:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867890944:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.197845:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 43 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197852:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 43 pid: 1853 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.197858:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867891072:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.197869:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.197883:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14724 00000100:00100000:3.0:1746142917.197888:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867585152:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:3.0:1746142917.197920:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.197929:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.197935:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 18 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197941:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197945:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.197946:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.197948:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.197960:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.197966:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 27 pid: 1853 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.197973:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867891200:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.197987:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14725 00000100:00100000:2.0:1746142917.197997:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14726 00000100:00100000:2.0:1746142917.198003:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+18:2005:x1830962867584768:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:2.0:1746142917.198017:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198018:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 18 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198029:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198030:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 18 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.198035:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 27 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142917.198037:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867891328:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.198041:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 18 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198046:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.198048:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.198050:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198055:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198061:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 39 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.198061:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 18 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198067:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 18 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.198068:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867891456:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.198073:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867891584:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.198079:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.198092:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14727 00010000:00010000:2.0:1746142917.198093:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 27 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142917.198097:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867585024:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:2.0:1746142917.198100:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 27 pid: 11943 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.198110:0:1852:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.198110:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867891712:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.198118:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198124:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.198128:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 39 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198129:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142917.198131:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746142917.198133:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.198135:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 39 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.198142:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867891840:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.198144:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198150:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 43 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.198153:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179240 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.198157:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867891968:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.198165:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867584512:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:3.0:1746142917.198174:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.198178:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.198181:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.198186:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142917.198187:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867892096:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.198192:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 18 pid: 12211 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746142917.198198:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746142917.198199:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 14 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198204:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.198205:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.198207:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.198220:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 14 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198227:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.198234:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867892224:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.198268:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 18 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198276:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 18 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.198283:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867892352:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.198307:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 43 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.198314:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 43 pid: 9580 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.198320:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867892480:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.198333:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.208499:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.208720:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867584384 00000100:00100000:1.0:1746142917.208727:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867584384 00000100:00100000:1.0:1746142917.208764:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14728 00000100:00100000:1.0:1746142917.208770:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867584384:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.208786:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.208801:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a2a800/0x2fa243e067cce456 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b411 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.208823:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a2a800/0x2fa243e067cce456 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b411 expref: 20 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.208831:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a2a800/0x2fa243e067cce456 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b411 expref: 20 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.208843:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a800, rc 0) 00000100:00100000:1.0:1746142917.208875:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:2006:x1830962867584384:12345-192.168.204.50@tcp:101:cat.0 Request processed in 105us (383us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.208879:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14728 00000100:00100000:2.0:1746142917.208961:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867890432:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.208970:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867890560:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.208977:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867890688:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.208998:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.209033:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867890816:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.209041:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867890944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.209048:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867891072:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.209064:0:11943:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.216405:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.216420:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.216456:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.216476:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586048 00000100:00100000:0.0:1746142917.216482:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586048 00010000:00010000:0.0:1746142917.216510:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 19 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.216532:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586304 00000100:00100000:0.0:1746142917.216534:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586304 00010000:00010000:0.0:1746142917.216542:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 20 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.216552:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585920 00000100:00100000:0.0:1746142917.216554:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585920 00010000:00010000:0.0:1746142917.216562:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 28 pid: 1853 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.216575:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6689 00000100:00100000:0.0:1746142917.216581:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962867586048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.216591:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.216605:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 20 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.216618:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 20 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.216636:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.216665:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+20:2006:x1830962867586048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.216670:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6689 00000100:00100000:0.0:1746142917.216681:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6690 00000100:00100000:0.0:1746142917.216684:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962867586304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.216690:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.216696:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 19 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.216702:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 19 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.216709:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.216718:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+19:2006:x1830962867586304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.216721:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6690 00000100:00100000:0.0:1746142917.216727:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6691 00000100:00100000:0.0:1746142917.216730:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867585920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.216735:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.216739:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 28 pid: 1853 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.216745:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 28 pid: 1853 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.216753:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.216760:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc03c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867585920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.216763:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6691 00000100:00100000:0.0:1746142917.216805:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.216814:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586176 00000100:00100000:0.0:1746142917.216816:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586176 00010000:00010000:0.0:1746142917.216830:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 40 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.216840:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6692 00000100:00100000:0.0:1746142917.216843:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867586176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.216847:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.216852:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 40 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.216859:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 40 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.216867:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.216869:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.216873:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.216883:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.216895:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.216938:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867586176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.216942:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6692 00000100:00080000:0.0:1746142917.217924:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746142917.217962:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.217971:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586432 00000100:00100000:0.0:1746142917.217974:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586432 00010000:00010000:0.0:1746142917.217984:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 28 pid: 11943 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.217996:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6693 00000100:00100000:0.0:1746142917.218000:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867586432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218005:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218011:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 28 pid: 11943 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218018:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 28 pid: 11943 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218026:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218037:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867586432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 37us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218043:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6693 00000100:00100000:0.0:1746142917.218066:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218072:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585408 00000100:00100000:0.0:1746142917.218074:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585408 00010000:00010000:0.0:1746142917.218081:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 28 pid: 9580 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.218090:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6694 00000100:00100000:0.0:1746142917.218094:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+28:2003:x1830962867585408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218097:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218103:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 28 pid: 9580 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218109:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 28 pid: 9580 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218117:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06200/0x2fa243e067cce41e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b403 expref: 28 pid: 9580 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218126:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218135:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+27:2003:x1830962867585408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 41us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218139:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6694 00000100:00100000:0.0:1746142917.218170:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218176:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585664 00000100:00100000:0.0:1746142917.218178:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585664 00010000:00010000:0.0:1746142917.218185:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 15 pid: 11943 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.218195:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6695 00000100:00100000:0.0:1746142917.218198:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867585664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218203:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218212:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 15 pid: 11943 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218218:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 15 pid: 11943 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218228:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800982c6800/0x2fa243e067cce1d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b29e expref: 15 pid: 11943 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218236:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218258:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867585664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 59us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218263:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6695 00000100:00100000:0.0:1746142917.218291:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218300:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585280 00000100:00100000:0.0:1746142917.218302:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585280 00010000:00010000:0.0:1746142917.218310:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 19 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.218320:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6696 00000100:00100000:0.0:1746142917.218324:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+19:2003:x1830962867585280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218329:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218335:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 19 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218342:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 19 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218351:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc07000/0x2fa243e067cce399 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3bd expref: 19 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218358:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218370:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+18:2003:x1830962867585280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 46us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218374:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6696 00000100:00100000:0.0:1746142917.218404:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218412:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585536 00000100:00100000:0.0:1746142917.218415:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585536 00010000:00010000:0.0:1746142917.218423:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 40 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.218433:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6697 00000100:00100000:0.0:1746142917.218437:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2003:x1830962867585536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218442:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218447:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 40 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.218458:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 40 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.218468:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130400/0x2fa243e067cce31b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b37e expref: 40 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.218475:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.218476:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.218478:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.218484:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.218497:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218510:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2003:x1830962867585536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218515:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6697 00000100:00100000:0.0:1746142917.218546:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218555:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867585792 00000100:00100000:0.0:1746142917.218557:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867585792 00010000:00010000:0.0:1746142917.218566:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 19 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.218577:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6698 00000100:00100000:0.0:1746142917.218581:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867585792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218588:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218594:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 19 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218601:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 19 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218610:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d76a00/0x2fa243e067cce265 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2eb expref: 19 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218616:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218628:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+18:2003:x1830962867585792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218633:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6698 00000100:00100000:0.0:1746142917.218672:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218687:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218695:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586688 00000100:00100000:0.0:1746142917.218698:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586688 00010000:00010000:0.0:1746142917.218707:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.218718:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6699 00000100:00100000:0.0:1746142917.218721:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867586688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218727:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218733:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218744:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218752:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218764:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2006:x1830962867586688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218768:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6699 00000100:00100000:0.0:1746142917.218796:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218804:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586816 00000100:00100000:0.0:1746142917.218806:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586816 00010000:00010000:0.0:1746142917.218813:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 44 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.218822:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6700 00000100:00100000:0.0:1746142917.218826:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867586816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218830:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218837:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 44 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.218843:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 44 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.218852:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.218864:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867586816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 37us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.218871:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6700 00000100:00100000:0.0:1746142917.218948:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.218956:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586944 00000100:00100000:0.0:1746142917.218959:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586944 00010000:00010000:0.0:1746142917.218967:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 18 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.218979:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6701 00000100:00100000:0.0:1746142917.218983:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867586944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.218988:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.218994:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 18 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.218999:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 18 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.219008:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.219019:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867586944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 36us (71us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.219024:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6701 00000100:00100000:0.0:1746142917.219065:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.219075:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867587072 00000100:00100000:0.0:1746142917.219078:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867587072 00010000:00010000:0.0:1746142917.219088:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 44 pid: 9580 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.219100:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6702 00000100:00100000:0.0:1746142917.219105:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867587072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.219110:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.219116:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 44 pid: 9580 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.219122:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 44 pid: 9580 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.219131:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.219133:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.219135:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.219141:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.219149:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.219161:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867587072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.219165:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6702 00010000:00010000:2.0:1746142917.219394:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2be00/0x2fa243e067cce3a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3c4 expref: 17 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.219407:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867891584:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.219417:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc3e00/0x2fa243e067cce425 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b40a expref: 26 pid: 11943 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.219424:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867891712:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.219431:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867891840:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.219450:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219466:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219472:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219485:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219493:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219499:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219504:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880088f3d600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142917.219507:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219514:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219522:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219527:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880088f3d600/0x2fa243e067cce42c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.219565:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867584640:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 21955us (22207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.219572:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14722 00010000:00010000:2.0:1746142917.219599:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711ae00/0x2fa243e067cce1cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b289 expref: 13 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.219608:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867892224:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.219616:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce249 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2d6 expref: 17 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.219622:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867892352:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.219629:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce177 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b24a expref: 43 pid: 9580 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.219636:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867892480:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.219648:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219654:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219660:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219670:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219675:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219681:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219690:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880096130200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142917.219692:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219697:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219704:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.219708:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130200/0x2fa243e067cce44f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.219733:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867584512:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 21741us (22324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.219738:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14725 00000100:00100000:2.0:1746142917.219752:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867586560 00000100:00100000:2.0:1746142917.219755:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867586560 00002000:00100000:2.0:1746142917.219774:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3756031) req@ffff88009cfed880 x1830962867586560/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.219781:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfed880 with x1830962867586560 ext(3416064->3756031) 00010000:00010000:2.0:1746142917.219786:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.219793:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746142917.219798:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cfed880 00000100:00100000:2.0:1746142917.219811:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1437 00000100:00100000:2.0:1746142917.219815:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867586560:12345-192.168.204.50@tcp:4:multiop.0 00010000:00010000:2.0:1746142917.219990:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc07200/0x2fa243e067cce36f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3768320->18446744073709551615] (req 5062656->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3a8 expref: 44 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.219998:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867891968:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.220006:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867892096:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.220018:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220104:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711a000/0x2fa243e067cce2a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b323 expref: 25 pid: 1853 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.220116:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867891200:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.220125:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2bc00/0x2fa243e067cce3a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3d2 expref: 15 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.220132:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867891328:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.220139:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d77a00/0x2fa243e067cce218 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2ba expref: 38 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.220145:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867891456:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.220158:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220164:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220169:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220180:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220186:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220195:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220199:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc2e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142917.220201:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220206:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220213:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.220218:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce43a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.220258:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867585152:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 22370us (22866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.220263:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14724 00000100:00100000:2.0:1746142917.227855:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.228676:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.228694:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867587328 00000100:00100000:2.0:1746142917.228701:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867587328 00010000:00010000:2.0:1746142917.228728:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 38 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.228750:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6703 00000100:00100000:2.0:1746142917.228756:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867587328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142917.228766:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142917.228780:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 38 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.228794:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 38 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.228812:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880096130800/0x2fa243e067cce345 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b38c expref: 38 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.228824:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.228826:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.228829:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228838:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228856:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.228883:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2005:x1830962867587328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 127us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.228889:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6703 00010000:00010000:2.0:1746142917.228922:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228929:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228942:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228952:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228958:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228963:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc06400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142917.228966:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228973:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228981:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.228987:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06400/0x2fa243e067cce441 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.229019:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867584768:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 31017us (31584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.229025:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14726 00000100:00100000:2.0:1746142917.229035:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867587200 00000100:00100000:2.0:1746142917.229038:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867587200 00000100:00100000:2.0:1746142917.229051:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14729 00000100:00100000:2.0:1746142917.229055:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+17:32690:x1830962867587200:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.229067:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.229077:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b418 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142917.229090:0:1397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x7f0 00010000:00010000:2.0:1746142917.229102:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.229103:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.229108:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.229118:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 18 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.229125:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25400, rc 0) 00000100:00100000:2.0:1746142917.229140:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+18:32690:x1830962867587200:12345-192.168.204.50@tcp:101:cat.0 Request processed in 84us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.229144:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14729 00000100:00100000:0.0:1746142917.230092:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.230154:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867587456 00000100:00100000:3.0:1746142917.230158:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867587456 00010000:00010000:3.0:1746142917.230171:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 46 pid: 1853 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.231357:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6704 00000100:00100000:3.0:1746142917.231365:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962867587456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.231375:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.231387:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 46 pid: 1853 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.231397:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 46 pid: 1853 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.231410:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d7200/0x2fa243e067cce18c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b25f expref: 46 pid: 1853 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.231420:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.231422:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746142917.231518:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867586560:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 11702us (12845us total) trans 21474841274 rc 0/0 00000100:00100000:2.0:1746142917.231526:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1437 00002000:00100000:2.0:1746142917.231533:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3416064->3756031) req@ffff88009cfed880 x1830962867586560/t21474841274(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.231541:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfed880 with x1830962867586560 ext(3416064->3756031) 00010000:00010000:2.0:1746142917.231546:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 44 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.231558:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 44 pid: 9580 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746142917.231563:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cfed880 00010000:00010000:3.0:1746142917.232096:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.232106:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.232129:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142917.232161:0:11943:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232169:0:11943:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232183:0:11943:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232190:0:11943:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232196:0:11943:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232201:0:11943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091fc3600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142917.232204:0:11943:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232210:0:11943:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232219:0:11943:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.232224:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce433 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.232388:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867587456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1023us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.232394:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6704 00000100:00100000:0.0:1746142917.232554:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867584896:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 34827us (35173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.232561:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14723 00000100:00100000:0.0:1746142917.237567:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.238144:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867587712 00000100:00100000:2.0:1746142917.238151:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867587712 00002000:00100000:2.0:1746142917.238189:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009cfef100 x1830962867587712/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.238197:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfef100 with x1830962867587712 ext(0->1048575) 00002000:00010000:2.0:1746142917.238202:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfef100 00000100:00100000:2.0:1746142917.238218:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4623 00000100:00100000:2.0:1746142917.238224:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867587712:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142917.239080:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.240957:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867587840 00000100:00100000:3.0:1746142917.240967:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867587840 00010000:00010000:3.0:1746142917.240996:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.241191:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6705 00000100:00100000:3.0:1746142917.241199:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b7b43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867587840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.241210:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.241225:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.241236:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.241266:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927fd400/0x2fa243e067cce376 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3416064->3768319] (req 3416064->3756031) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3af expref: 43 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.241280:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.241281:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.241285:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.241292:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.241311:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.241346:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b7b43050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2003:x1830962867587840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 147us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.241352:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6705 00010000:00010000:2.0:1746142917.241697:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241705:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241719:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241725:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241731:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241737:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd8f200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142917.241740:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241745:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241753:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.241758:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce448 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.241793:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867585024:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 43696us (44221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.241799:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14727 00000100:00100000:0.0:1746142917.245995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.246131:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+18:2006:x1830962867587712:12345-192.168.204.50@tcp:3:cat.0 Request processed in 7905us (8570us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.246140:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4623 00002000:00100000:2.0:1746142917.246149:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009cfef100 x1830962867587712/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.246157:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfef100 with x1830962867587712 ext(0->1048575) 00002000:00010000:2.0:1746142917.246161:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfef100 00000100:00100000:3.0:1746142917.247197:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867588096 00000100:00100000:3.0:1746142917.247204:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867588096 00000100:00100000:3.0:1746142917.247253:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14548 00000100:00100000:3.0:1746142917.247259:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+18:32687:x1830962867588096:12345-192.168.204.50@tcp:36:mirror_io.0 00010000:00010000:3.0:1746142917.247296:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.247316:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2ae00/0x2fa243e067cce417 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3fc expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247330:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.247333:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142917.247352:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.247362:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 21 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247368:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247373:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247378:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 36 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247383:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247388:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 21 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247394:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.247420:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 21 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247429:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 21 pid: 13326 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.247440:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892608:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.247508:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 36 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.247515:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 36 pid: 13326 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.247522:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892736:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.248391:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 36 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.251168:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 36 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.251182:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892864:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.251285:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.251293:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 21 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.251309:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892992:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.251333:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.251340:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.251346:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867893120:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.251367:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 21 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.251373:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 21 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.251380:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867893248:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.251395:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.262496:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.262522:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867588480 00000100:00100000:2.0:1746142917.262529:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867588480 00000100:00100000:3.0:1746142917.262621:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892608:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.262630:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892736:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.262661:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.262681:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.262698:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892864:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.262714:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867892992:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.262738:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867893120:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.263078:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.263188:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867588864 00000100:00100000:3.0:1746142917.263191:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867588864 00000100:00100000:3.0:1746142917.263214:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14730 00000100:00100000:3.0:1746142917.263224:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+25:32690:x1830962867588864:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142917.263238:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.263261:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b426 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142917.263281:0:1852:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c5, atime: 0x681406c5, ctime: 0x681406c5, blocks: 0x808 00010000:00010000:3.0:1746142917.263297:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.263298:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.263304:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.263317:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 26 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.263325:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc2e00, rc 0) 00000100:00100000:3.0:1746142917.263362:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:32690:x1830962867588864:12345-192.168.204.50@tcp:101:cat.0 Request processed in 138us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.263367:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14730 00000100:00100000:3.0:1746142917.263431:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867588224 00000100:00100000:3.0:1746142917.263433:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867588224 00010000:00010000:3.0:1746142917.263447:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 22 pid: 13326 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.263463:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6706 00000100:00100000:3.0:1746142917.263467:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867588224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.263474:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.263478:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 22 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.263485:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 22 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.263499:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cca00/0x2fa243e067cce234 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b2c8 expref: 22 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.263513:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.263517:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.263524:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.263541:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2004:x1830962867588224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 73us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.263545:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6706 00000100:00100000:2.0:1746142917.263816:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5330 00000100:00100000:2.0:1746142917.263823:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:30464:x1830962867588480:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142917.264591:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867588736 00000100:00100000:1.0:1746142917.264596:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867588736 00000100:00100000:1.0:1746142917.264618:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14549 00000100:00100000:0.0:1746142917.264671:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.264684:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.264692:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589120 00000100:00100000:0.0:1746142917.264695:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589120 00010000:00010000:0.0:1746142917.264706:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 22 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.264719:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589376 00000100:00100000:0.0:1746142917.264720:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589376 00010000:00010000:0.0:1746142917.264726:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 23 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.264738:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6707 00000100:00100000:0.0:1746142917.264741:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867589120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.264748:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.264751:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 23 pid: 7230 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.264757:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 23 pid: 7230 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.264767:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732a00/0x2fa243e067ccdf8d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b132 expref: 23 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.264775:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:30464:x1830962867588480:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 953us (2287us total) trans 8589936738 rc 0/0 00010000:00010000:0.0:1746142917.264779:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00000100:00100000:2.0:1746142917.264781:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5330 00010000:00010000:0.0:1746142917.264782:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.264787:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.264799:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867589120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.264800:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6708 00000100:00100000:2.0:1746142917.264804:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867589376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142917.264807:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6707 00010000:00010000:2.0:1746142917.264810:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142917.264814:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 21 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.264820:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 21 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.264827:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142917.264829:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.264832:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142917.264835:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867588992 00010000:00010000:2.0:1746142917.264836:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.264837:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867588992 00010000:00010000:0.0:1746142917.264845:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 38 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.264847:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867589376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 43us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.264852:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6708 00000100:00100000:0.0:1746142917.264856:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6709 00000100:00100000:0.0:1746142917.264860:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2006:x1830962867588992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.264864:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.264867:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 38 pid: 7230 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.264874:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 38 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.264879:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142917.264883:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea41e00/0x2fa243e067ccdf94 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b140 expref: 38 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.264888:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589248 00000100:00100000:2.0:1746142917.264890:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589248 00010000:00010000:0.0:1746142917.264890:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.264893:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.264897:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142917.264923:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.264925:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2006:x1830962867588992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.264930:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6709 00000100:00100000:0.0:1746142917.264938:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6710 00000100:00100000:0.0:1746142917.264943:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867589248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.264948:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.264951:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.264958:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.264967:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0a1200/0x2fa243e067ccdf7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b12b expref: 21 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.264974:0:13297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.264977:0:13297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.264981:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.264992:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867589248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.264997:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6710 00000100:00100000:1.0:1746142917.265110:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+19:32694:x1830962867588736:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.265120:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.265128:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067cce472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b41f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.265166:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.265174:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.265182:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.265191:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.265195:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142917.265200:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.265356:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974cc800/0x2fa243e067cce3f4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3ee expref: 20 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.265366:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867893248:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.265391:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:3.0:1746142917.267233:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.267435:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589504 00000100:00100000:0.0:1746142917.267441:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589504 00000100:00100000:0.0:1746142917.267478:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14550 00000100:00100000:0.0:1746142917.267485:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:32690:x1830962867589504:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.267496:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.267507:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b42d expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.267541:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.267548:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.267561:0:7230:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.267570:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 21 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.267579:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.267581:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142917.267583:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.267588:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3d000, rc 0) 00000100:00100000:0.0:1746142917.267626:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:32690:x1830962867589504:12345-192.168.204.50@tcp:101:cat.0 Request processed in 142us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.267631:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14550 00000100:00100000:0.0:1746142917.268202:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.268288:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589632 00000100:00100000:3.0:1746142917.268291:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589632 00010000:00010000:3.0:1746142917.268307:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 37 pid: 13326 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.268336:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6711 00000100:00100000:3.0:1746142917.268342:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:2003:x1830962867589632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.268349:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.268354:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 37 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.268361:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 37 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.268374:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce169 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b243 expref: 37 pid: 13326 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.268383:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.268386:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.268391:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.268396:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.268403:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 20 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.268429:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.268448:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867589632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (247us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142917.268451:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00000100:00100000:3.0:1746142917.268456:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6711 00010000:00010000:2.0:1746142917.268457:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00000040:00080000:2.0:1746142917.268668:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].674, 88 off67032 00000004:00080000:2.0:1746142917.268674:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267773944ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268715:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].751, 88 off73904 00000004:00080000:2.0:1746142917.268720:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267820124ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268746:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].752, 88 off73992 00000004:00080000:2.0:1746142917.268749:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267849427ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268759:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].675, 88 off67120 00000004:00080000:2.0:1746142917.268761:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267861179ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268769:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].676, 88 off67208 00000004:00080000:2.0:1746142917.268771:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267871287ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268779:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].753, 88 off74080 00000004:00080000:2.0:1746142917.268782:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267882686ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268790:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].754, 88 off74168 00000004:00080000:2.0:1746142917.268792:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267892596ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268800:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].677, 88 off67296 00000004:00080000:2.0:1746142917.268802:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267902334ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268809:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].755, 88 off74256 00000004:00080000:2.0:1746142917.268811:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267911557ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268818:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].678, 88 off67384 00000004:00080000:2.0:1746142917.268821:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267921127ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268829:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].756, 88 off74344 00000004:00080000:2.0:1746142917.268831:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267931644ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268839:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].679, 88 off67472 00000004:00080000:2.0:1746142917.268841:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267941367ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268848:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].757, 88 off74432 00000004:00080000:2.0:1746142917.268850:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267949926ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268856:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].680, 88 off67560 00000004:00080000:2.0:1746142917.268859:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267959049ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142917.268866:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].758, 88 off74520 00000004:00080000:2.0:1746142917.268868:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267968662ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268875:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].759, 88 off74608 00000004:00080000:2.0:1746142917.268877:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691267977552ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142917.268885:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].681, 88 off67648 00000004:00080000:2.0:1746142917.268889:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691267988749ns, next at 629431245375ns, rc = 0 00000001:00080000:2.0:1746142917.271495:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936739 is committed 00000004:00080000:2.0:1746142917.271504:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 669 committed 00000004:00080000:2.0:1746142917.272730:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 747 committed 00000004:00080000:2.0:1746142917.272746:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 746 committed 00000004:00080000:2.0:1746142917.272748:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 668 committed 00000004:00080000:2.0:1746142917.272750:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 745 committed 00000004:00080000:2.0:1746142917.272751:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 667 committed 00000004:00080000:2.0:1746142917.272753:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 744 committed 00000004:00080000:2.0:1746142917.272754:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 666 committed 00000004:00080000:2.0:1746142917.272755:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 743 committed 00000004:00080000:2.0:1746142917.272757:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 665 committed 00000004:00080000:2.0:1746142917.272758:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 742 committed 00000004:00080000:2.0:1746142917.272760:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 741 committed 00000004:00080000:2.0:1746142917.272761:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 664 committed 00000004:00080000:2.0:1746142917.272763:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 663 committed 00000004:00080000:2.0:1746142917.272764:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 740 committed 00000004:00080000:2.0:1746142917.272766:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 739 committed 00000004:00080000:2.0:1746142917.272768:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 662 committed 00000001:00080000:2.0:1746142917.272774:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936738 is committed 00000001:00080000:2.0:1746142917.272782:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936734 is committed 00000004:00010000:2.0:1746142917.272852:0:7232:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cfeca80 reply state ffff880099e09c00 transno 8589936739 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.272867:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.272875:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.272877:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142917.272884:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.272891:0:7232:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.272897:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.272943:0:7232:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.272954:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867893376:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142917.273030:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.273094:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867893888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273125:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273141:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867894400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273156:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273170:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746142917.273175:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867893504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273187:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273197:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867894016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273209:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273222:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867893632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273236:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273255:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867894144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273267:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273278:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746142917.273282:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867893760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273293:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273303:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867894272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.273314:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.273332:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867893888 00000100:00100000:3.0:1746142917.273338:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867893888 00000100:00100000:3.0:1746142917.273358:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894400 00000100:00100000:3.0:1746142917.273359:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894400 00000100:00100000:3.0:1746142917.273367:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867893504 00000100:00100000:3.0:1746142917.273368:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867893504 00000100:00100000:3.0:1746142917.273373:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894016 00000100:00100000:3.0:1746142917.273374:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894016 00000100:00100000:3.0:1746142917.273378:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867893632 00000100:00100000:3.0:1746142917.273379:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867893632 00000100:00100000:3.0:1746142917.273383:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894144 00000100:00100000:3.0:1746142917.273385:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894144 00000100:00100000:3.0:1746142917.273389:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867893760 00000100:00100000:3.0:1746142917.273390:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867893760 00000100:00100000:3.0:1746142917.273394:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894272 00000100:00100000:3.0:1746142917.273395:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894272 00000100:00100000:3.0:1746142917.273402:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14731 00000100:00100000:3.0:1746142917.273406:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3764:x1830962867893888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.273474:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14732 00000100:00100000:1.0:1746142917.273480:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867894400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.273492:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14733 00000100:00100000:1.0:1746142917.273495:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867893504:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142917.273504:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142917.273506:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142917.273508:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142917.273510:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142917.273511:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00002000:00010000:1.0:1746142917.273532:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142917.273534:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00000100:00100000:3.0:1746142917.273535:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3764:x1830962867893888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (409us total) trans 17179874018 rc 0/0 00002000:00010000:1.0:1746142917.273536:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.273538:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00000100:00100000:3.0:1746142917.273540:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14731 00002000:00010000:1.0:1746142917.273540:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746142917.273551:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14734 00000100:00100000:3.0:1746142917.273555:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867894016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.273556:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867893504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (368us total) trans 17179874019 rc 0/0 00000100:00100000:1.0:1746142917.273561:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14733 00000100:00100000:1.0:1746142917.273568:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14735 00000100:00100000:1.0:1746142917.273572:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3762:x1830962867893632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142917.273587:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746142917.273589:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142917.273591:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142917.273592:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142917.273594:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:3.0:1746142917.273609:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3764:x1830962867894016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (399us total) trans 17179874020 rc 0/0 00000100:00100000:1.0:1746142917.273611:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867893632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (375us total) trans 17179874021 rc 0/0 00000100:00100000:3.0:1746142917.273614:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14734 00000100:00100000:1.0:1746142917.273616:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14735 00000100:00100000:3.0:1746142917.273622:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14736 00000100:00100000:3.0:1746142917.273626:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3762:x1830962867894144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142917.273659:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:3.0:1746142917.273661:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142917.273663:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142917.273664:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142917.273666:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142917.273679:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3762:x1830962867894144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (411us total) trans 17179874022 rc 0/0 00000100:00100000:0.0:1746142917.273844:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867894784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.273865:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.273877:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867895296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.273890:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.273915:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746142917.273920:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867894656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.273934:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.273941:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867895168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.273953:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.273963:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867894528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.273977:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.273983:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867895040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.273994:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.274001:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746142917.274004:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867894912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.274015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.274021:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880088d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867895424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.274033:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.276313:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894784 00000100:00100000:2.0:1746142917.276323:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894784 00000100:00100000:1.0:1746142917.279458:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14737 00000100:00100000:1.0:1746142917.279475:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3762:x1830962867893760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.279638:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867893760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (6342us total) trans 17179874023 rc 0/0 00000100:00100000:1.0:1746142917.279644:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14737 00000100:00100000:1.0:1746142917.279665:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867895296 00000100:00100000:1.0:1746142917.279670:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867895296 00000100:00100000:1.0:1746142917.279684:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894656 00000100:00100000:1.0:1746142917.279686:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894656 00000100:00100000:1.0:1746142917.279692:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14738 00000100:00100000:1.0:1746142917.279696:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3762:x1830962867894272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.279746:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867894272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (6430us total) trans 17179874024 rc 0/0 00000100:00100000:1.0:1746142917.279751:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14738 00000100:00100000:1.0:1746142917.279759:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867895168 00000100:00100000:1.0:1746142917.279761:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867895168 00000100:00100000:1.0:1746142917.279768:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894528 00000100:00100000:1.0:1746142917.279770:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894528 00000100:00100000:1.0:1746142917.279775:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867895040 00000100:00100000:1.0:1746142917.279777:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867895040 00000100:00100000:1.0:1746142917.279781:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867894912 00000100:00100000:1.0:1746142917.279783:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867894912 00000100:00100000:1.0:1746142917.279787:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867895424 00000100:00100000:1.0:1746142917.279789:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867895424 00000100:00100000:1.0:1746142917.279794:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14739 00000100:00100000:1.0:1746142917.279797:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3763:x1830962867895296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142917.279928:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14736 00000100:00100000:2.0:1746142917.279946:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14740 00000100:00100000:3.0:1746142917.279951:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14741 00000100:00100000:3.0:1746142917.279956:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3763:x1830962867895168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.279956:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3763:x1830962867894656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142917.280001:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142917.280004:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142917.280006:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142917.280008:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142917.280009:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:3.0:1746142917.280020:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3763:x1830962867895168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (6065us total) trans 21474841275 rc 0/0 00000100:00100000:3.0:1746142917.280025:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14741 00000100:00100000:2.0:1746142917.280032:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3763:x1830962867894656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (6096us total) trans 21474841276 rc 0/0 00000100:00100000:0.0:1746142917.280033:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3764:x1830962867894400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6554us (6875us total) trans 17179874025 rc 0/0 00000100:00100000:3.0:1746142917.280034:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14742 00000100:00100000:2.0:1746142917.280037:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14740 00000100:00100000:3.0:1746142917.280038:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3765:x1830962867894528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.280078:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14732 00000100:00100000:2.0:1746142917.280081:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14743 00002000:00010000:3.0:1746142917.280083:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746142917.280085:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.280087:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00000100:00100000:2.0:1746142917.280087:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3765:x1830962867895040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142917.280088:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00000100:00100000:0.0:1746142917.280089:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14744 00002000:00010000:3.0:1746142917.280090:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142917.280093:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3765:x1830962867894912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142917.280111:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3765:x1830962867894528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (6134us total) trans 21474841277 rc 0/0 00000100:00100000:3.0:1746142917.280116:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14742 00000100:00100000:3.0:1746142917.280125:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14745 00000100:00100000:3.0:1746142917.280129:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3765:x1830962867895424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.280137:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3765:x1830962867895040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (6141us total) trans 21474841278 rc 0/0 00000100:00100000:2.0:1746142917.280142:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14743 00000100:00100000:0.0:1746142917.280143:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3765:x1830962867894912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (6127us total) trans 21474841279 rc 0/0 00000100:00100000:0.0:1746142917.280148:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14744 00000100:00100000:2.0:1746142917.280151:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14746 00000100:00100000:2.0:1746142917.280156:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3763:x1830962867894784:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142917.280180:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097349c00/2, rc 0, transno 21474841276 00000100:00100000:0.0:1746142917.280185:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867894656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142917.280186:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3765:x1830962867895424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (6151us total) trans 21474841280 rc 0/0 00000100:00100000:3.0:1746142917.280190:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14745 00000004:00080000:0.0:1746142917.280194:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d7f480/2, rc 0, transno 21474841275 00000100:00100000:0.0:1746142917.280197:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867895168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142917.280203:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097349880/2, rc 0, transno 21474841281 00000100:00100000:2.0:1746142917.280205:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3763:x1830962867894784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (6338us total) trans 21474841281 rc 0/0 00000100:00100000:0.0:1746142917.280206:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097349880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867894784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.280210:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14746 00000004:00080000:3.0:1746142917.280218:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0a80/2, rc 0, transno 17179874019 00000004:00080000:0.0:1746142917.280219:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092433b80/2, rc 0, transno 21474841279 00000100:00100000:0.0:1746142917.280221:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867894912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142917.280224:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867893504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.280227:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d7fb80/2, rc 0, transno 21474841280 00000100:00100000:0.0:1746142917.280229:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867895424:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142917.280231:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0380/2, rc 0, transno 17179874020 00000100:00100000:3.0:1746142917.280234:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867894016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.280234:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009734b480/2, rc 0, transno 21474841277 00000100:00100000:0.0:1746142917.280236:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009734b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867894528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142917.280251:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1180/2, rc 0, transno 17179874018 00000004:00080000:0.0:1746142917.280252:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092d0bb80/2, rc 0, transno 21474841278 00000100:00100000:3.0:1746142917.280254:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867893888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.280254:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867895040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.280258:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867893376:192.168.204.50@tcp:105: 00000004:00080000:3.0:1746142917.280259:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af0000/2, rc 0, transno 17179874025 00000100:00100000:3.0:1746142917.280262:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867894400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142917.280271:0:7232:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00002000:00010000:1.0:1746142917.280328:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00010000:00080000:2.0:1746142917.280329:0:7232:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00002000:00010000:1.0:1746142917.280331:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.280332:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142917.280334:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.280336:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142917.280338:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32687:x1830962867588096:12345-192.168.204.50@tcp:36:mirror_io.0 Request processed in 33079us (34351us total) trans 8589936739 rc 0/0 00000100:00100000:2.0:1746142917.280344:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14548 00000100:00100000:1.0:1746142917.280358:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3763:x1830962867895296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 560us (6467us total) trans 21474841282 rc 0/0 00000100:00100000:1.0:1746142917.280364:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14739 00010000:00010000:2.0:1746142917.280370:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746142917.280382:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.280389:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00000004:00080000:0.0:1746142917.280407:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880088d7d880/2, rc 0, transno 21474841282 00010000:00010000:2.0:1746142917.280410:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.280411:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880088d7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867895296:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746142917.280419:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 7 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.280429:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867895552:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.280462:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.280544:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.280563:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589760 00000100:00100000:2.0:1746142917.280567:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589760 00000100:00100000:2.0:1746142917.280584:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5331 00000100:00100000:2.0:1746142917.280589:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32690:x1830962867589760:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:2.0:1746142917.280632:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32690:x1830962867589760:12345-192.168.204.50@tcp:49:cat.0 Request processed in 44us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.280637:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5331 00000004:00080000:1.0:1746142917.282194:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af3800/2, rc 0, transno 17179874023 00000100:00100000:1.0:1746142917.282202:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867893760:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142917.282210:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af2680/2, rc 0, transno 17179874024 00000100:00100000:1.0:1746142917.282213:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867894272:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142917.282220:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af2a00/2, rc 0, transno 17179874021 00000100:00100000:1.0:1746142917.282222:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867893632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142917.282228:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af3480/2, rc 0, transno 17179874022 00000100:00100000:1.0:1746142917.282230:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867894144:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746142917.282956:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.282964:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.282970:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.282974:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd8f000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.282978:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.282987:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.282999:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.283001:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142917.283004:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.283008:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce464 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00000100:00100000:1.0:1746142917.283067:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867895680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.283098:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.283126:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867895680 00000100:00100000:1.0:1746142917.283130:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867895680 00000100:00100000:1.0:1746142917.283163:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14747 00000100:00100000:1.0:1746142917.283168:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3765:x1830962867895680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.283276:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3765:x1830962867895680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (178us total) trans 17179874026 rc 0/0 00000100:00100000:1.0:1746142917.283282:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14747 00000004:00080000:1.0:1746142917.283303:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092136680/2, rc 0, transno 17179874026 00000100:00100000:1.0:1746142917.283307:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867895680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142917.284235:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.284264:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867589888 00000100:00100000:0.0:1746142917.284268:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867589888 00000100:00100000:0.0:1746142917.284539:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14551 00000100:00100000:0.0:1746142917.284545:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+7:32687:x1830962867589888:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142917.284557:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.284569:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b434 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.284605:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 8 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.284620:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 8 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.284633:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.284635:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142917.284637:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880088f3c400, rc 0) 00000100:00100000:3.0:1746142917.284709:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867895552:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.284724:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142917.284766:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32687:x1830962867589888:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 220us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.284771:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14551 00000100:00100000:2.0:1746142917.284814:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.284871:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590016 00000100:00100000:0.0:1746142917.284874:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590016 00010000:00010000:0.0:1746142917.284887:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.284930:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6712 00000100:00100000:0.0:1746142917.284936:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b7b42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2004:x1830962867590016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.284943:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.284946:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.284959:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.284974:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a2a600/0x2fa243e067cce409 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b3f5 expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.284985:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.284988:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142917.284994:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142917.284999:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142917.285009:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142917.285017:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285023:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142917.285033:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142917.285087:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285093:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285098:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285102:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb24e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.285105:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746142917.285517:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b7b42450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:2004:x1830962867590016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 582us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.285523:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6712 00010000:00010000:3.0:1746142917.285830:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285838:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.285840:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142917.285842:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285847:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce48e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285861:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285866:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285870:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285873:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285876:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.285879:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285882:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285888:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142917.285889:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142917.285892:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285895:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cce479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285930:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285935:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.285939:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.287263:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.287267:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.287272:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.287281:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4b00) 00010000:00010000:3.0:1746142917.287283:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142917.287286:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.287290:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067cce480 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.287329:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067cce472 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b41f expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.287334:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75400/0x2fa243e067cce472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b41f expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.287342:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:3.0:1746142917.288307:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:32694:x1830962867588736:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 23197us (25227us total) trans 8589936740 rc 301/301 00000100:00100000:3.0:1746142917.288315:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14549 00000100:00100000:0.0:1746142917.288616:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.288649:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590144 00000100:00100000:3.0:1746142917.288654:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590144 00000100:00100000:3.0:1746142917.288689:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14552 00000100:00100000:3.0:1746142917.288695:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:32687:x1830962867590144:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142917.288708:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.288720:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3600/0x2fa243e067cce4a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b43b expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.288794:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.288804:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.288811:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142917.288832:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142917.288835:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142917.288845:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.288862:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091fc3600/0x2fa243e067cce4a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.288876:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.288882:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.288884:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142917.288886:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc79c00, rc 0) 00000100:00100000:3.0:1746142917.291350:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+8:32687:x1830962867590144:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 2647us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.291358:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14552 00000100:00100000:0.0:1746142917.292603:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.292705:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590400 00000100:00100000:2.0:1746142917.292711:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590400 00002000:00100000:2.0:1746142917.292744:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880099e89c00 x1830962867590400/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.292752:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89c00 with x1830962867590400 ext(1048576->2097151) 00002000:00010000:2.0:1746142917.292756:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e89c00 00000100:00100000:2.0:1746142917.292771:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4624 00000100:00100000:2.0:1746142917.292776:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867590400:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.304355:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.304387:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.304408:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590656 00000100:00100000:2.0:1746142917.304408:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.304416:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590656 00000100:00100000:2.0:1746142917.304420:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590912 00000100:00100000:2.0:1746142917.304422:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590912 00000100:00100000:3.0:1746142917.304526:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14748 00000100:00100000:3.0:1746142917.304533:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+10:2004:x1830962867590912:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142917.304546:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.304561:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b457 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142917.304580:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x808 00010000:00010000:3.0:1746142917.304595:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.304596:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.304603:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 11 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.304615:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 11 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.304628:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cc79200, rc 0) 00000100:00100000:3.0:1746142917.304663:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+11:2004:x1830962867590912:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 131us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.304669:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14748 00000100:00100000:3.0:1746142917.304683:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14749 00000100:00100000:3.0:1746142917.304688:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867590656:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142917.304693:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.304701:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b449 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.304710:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.304711:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.304715:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.304722:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 14 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.304728:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880c00, rc 0) 00000100:00100000:3.0:1746142917.304741:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867590656:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 53us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.304745:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14749 00000100:00100000:0.0:1746142917.304804:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.304836:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.304864:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.304938:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867591168 00000100:00100000:2.0:1746142917.304942:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867591168 00000100:00100000:2.0:1746142917.304958:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590528 00000100:00100000:2.0:1746142917.304960:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590528 00000100:00100000:2.0:1746142917.304968:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867590784 00000100:00100000:2.0:1746142917.304969:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867590784 00000100:00100000:2.0:1746142917.304976:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867591040 00000100:00100000:2.0:1746142917.304977:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867591040 00000100:00100000:2.0:1746142917.304988:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14750 00000100:00100000:2.0:1746142917.304992:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867591168:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142917.304998:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.305006:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b465 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142917.305018:0:1397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c5, atime: 0x681406c4, ctime: 0x681406c5, blocks: 0x1008 00010000:00010000:2.0:1746142917.305026:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.305027:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.305031:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.305039:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 16 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.305046:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25000, rc 0) 00000100:00100000:1.0:1746142917.305125:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14751 00000100:00100000:1.0:1746142917.305132:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867590528:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142917.305138:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.305144:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b442 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.305153:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.305154:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.305158:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.305167:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.305173:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75e00, rc 0) 00000100:00100000:3.0:1746142917.307723:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14752 00000100:00100000:3.0:1746142917.307735:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867590784:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142917.307749:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.307761:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b450 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142917.307778:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c5, atime: 0x681406c5, ctime: 0x681406c5, blocks: 0x800 00010000:00010000:3.0:1746142917.307790:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.307792:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.307798:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.307809:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 17 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.307817:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881400, rc 0) 00000100:00100000:2.0:1746142917.307909:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867591168:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 2903us (3487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.307915:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14750 00000100:00100000:2.0:1746142917.307932:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14753 00000100:00100000:2.0:1746142917.307939:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867591040:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142917.307946:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142917.307948:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867590528:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 2816us (3142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.307952:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14751 00010000:00010000:2.0:1746142917.307954:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b45e expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142917.307965:0:1397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c5, atime: 0x681406c5, ctime: 0x681406c5, blocks: 0x16b0 00010000:00010000:2.0:1746142917.307972:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.307973:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.307977:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.307991:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.307997:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25e00, rc 0) 00000100:00100000:3.0:1746142917.308005:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867590784:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 274us (3167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.308009:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14752 00000100:00100000:2.0:1746142917.308012:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867591040:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 75us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.308016:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14753 00000100:00100000:2.0:1746142917.308078:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867590400:12345-192.168.204.50@tcp:3:cat.0 Request processed in 15301us (15479us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.308084:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4624 00002000:00100000:2.0:1746142917.308090:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880099e89c00 x1830962867590400/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.308097:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e89c00 with x1830962867590400 ext(1048576->2097151) 00002000:00010000:2.0:1746142917.308100:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e89c00 00000100:00100000:0.0:1746142917.318656:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.318740:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867591424 00000100:00100000:3.0:1746142917.318748:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867591424 00000100:00100000:3.0:1746142917.318782:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14553 00000100:00100000:3.0:1746142917.318788:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32696:x1830962867591424:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142917.318807:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.318821:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880a00/0x2fa243e067cce4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b46c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.318876:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.318890:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.318915:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.318926:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.318931:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.318936:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319007:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319015:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319020:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746142917.319026:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142917.319080:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319085:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319091:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319096:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.319100:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319105:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319113:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.319115:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142917.319118:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319122:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881000/0x2fa243e067cce4f0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319153:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319158:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319161:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319165:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319169:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c880800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.319171:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319176:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319181:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142917.319183:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142917.319186:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319189:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880800/0x2fa243e067cce4e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319196:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319200:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319204:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319208:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142917.319210:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319214:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319219:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009b462b00) 00010000:00010000:3.0:1746142917.319221:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142917.319222:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319226:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce4e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746142917.319262:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880a00/0x2fa243e067cce4db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b46c expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.319267:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880a00/0x2fa243e067cce4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b46c expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.319273:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880a00, rc 0) 00000100:00100000:3.0:1746142917.319309:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32696:x1830962867591424:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 521us (661us total) trans 8589936741 rc 301/301 00000100:00100000:3.0:1746142917.319314:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14553 00000100:00100000:0.0:1746142917.321278:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.321345:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867591552 00000100:00100000:2.0:1746142917.321351:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867591552 00000100:00100000:2.0:1746142917.321391:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14754 00000100:00100000:2.0:1746142917.321397:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+26:32690:x1830962867591552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.321409:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.321420:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b473 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.321439:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.321440:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.321446:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.321457:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 27 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.321466:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb25c00, rc 0) 00000100:00100000:2.0:1746142917.321494:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:32690:x1830962867591552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.321499:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14754 00000100:00100000:0.0:1746142917.327355:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.327404:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.327477:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867591936 00000100:00100000:3.0:1746142917.327484:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867591936 00002000:00100000:3.0:1746142917.327521:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009cfece00 x1830962867591936/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.327529:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfece00 with x1830962867591936 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.327534:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfece00 00000100:00100000:3.0:1746142917.327551:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4625 00000100:00100000:3.0:1746142917.327558:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867591936:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.328161:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867591680 00000100:00100000:2.0:1746142917.328165:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867591680 00000100:00100000:2.0:1746142917.328190:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14554 00000100:00100000:2.0:1746142917.328195:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32696:x1830962867591680:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.328209:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.328222:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24000/0x2fa243e067cce505 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b47a expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.328272:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24000/0x2fa243e067cce505 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b47a expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.328284:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24000/0x2fa243e067cce505 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b47a expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.328296:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.328298:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142917.328301:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb24000, rc 0) 00000100:00100000:2.0:1746142917.328616:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32696:x1830962867591680:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 419us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.328622:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14554 00000100:00100000:3.0:1746142917.335578:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867591936:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8013us (8167us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142917.335588:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4625 00002000:00100000:3.0:1746142917.335598:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88009cfece00 x1830962867591936/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.335606:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfece00 with x1830962867591936 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.335611:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfece00 00000100:00100000:0.0:1746142917.339785:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.339876:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867592192 00000100:00100000:2.0:1746142917.339883:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867592192 00000100:00100000:2.0:1746142917.339960:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14555 00000100:00100000:2.0:1746142917.339968:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32696:x1830962867592192:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.339984:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.339987:0:7232:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142917.340008:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24000/0x2fa243e067cce505 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b47a expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340026:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.340030:0:7232:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142917.340040:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24600/0x2fa243e067cce50c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b481 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340076:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.340086:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340092:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340098:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340103:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.340127:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340136:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.340146:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867895808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.340228:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340265:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 8 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.340277:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867895936:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.340301:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340308:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 7 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.340314:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867896064:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.340328:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.340647:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.340682:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.340728:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867592448 00000100:00100000:2.0:1746142917.340731:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867592448 00000100:00100000:2.0:1746142917.340750:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14556 00000100:00100000:2.0:1746142917.340755:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:32694:x1830962867592448:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.340766:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.340767:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142917.340773:0:13326:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 9 pid: 7230 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.340783:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.340786:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.340791:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.340795:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142917.340800:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130400/0x2fa243e067cce51a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b488 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.340818:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142917.340824:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.340829:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142917.340837:0:13326:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.340845:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142917.340868:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867592576 00000100:00100000:2.0:1746142917.340963:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867592576 00000100:00100000:2.0:1746142917.340984:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14755 00000100:00100000:2.0:1746142917.340988:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+18:32690:x1830962867592576:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.340995:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.341003:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b48f expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.341078:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.341079:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.341085:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 19 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.341096:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 19 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.341109:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130000, rc 0) 00000100:00100000:2.0:1746142917.344035:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+19:32690:x1830962867592576:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3037us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.344045:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14755 00000100:00100000:0.0:1746142917.344695:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.344713:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867592704 00000100:00100000:0.0:1746142917.344719:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867592704 00010000:00010000:0.0:1746142917.344744:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.344838:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867895808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.344848:0:7232:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@ffff8800924a3100 x1830962867895936) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 10 pid: 7230 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.344859:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3d000/0x2fa243e067cce487 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b42d expref: 10 pid: 7230 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.344870:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867895936:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.344878:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867896064:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.344896:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.344915:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.344922:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.344928:0:7232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142917.345567:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6713 00000100:00100000:0.0:1746142917.345574:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+8:2006:x1830962867592704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.345583:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.345588:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.345596:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.345613:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cc79c00/0x2fa243e067cce4aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b43b expref: 8 pid: 7231 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.345628:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.345631:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.345636:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.345640:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.345665:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+7:2006:x1830962867592704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.345670:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6713 00000100:00100000:3.0:1746142917.346308:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.346335:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.346378:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867592960 00000100:00100000:1.0:1746142917.346383:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867592960 00000100:00100000:1.0:1746142917.346406:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14557 00000100:00100000:1.0:1746142917.346411:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32690:x1830962867592960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.346424:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.346434:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b496 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.346470:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.346476:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.346489:0:7230:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.346497:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 11 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.346505:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.346508:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142917.346510:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.346514:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8fe00, rc 0) 00000100:00100000:1.0:1746142917.346534:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32690:x1830962867592960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 123us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.346539:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14557 00000100:00100000:0.0:1746142917.346824:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867592832 00000100:00100000:0.0:1746142917.346827:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867592832 00010000:00010000:0.0:1746142917.346840:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.346867:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6714 00000100:00100000:0.0:1746142917.346872:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:2005:x1830962867592832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.346879:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.346882:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.346890:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.346915:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880088f3c400/0x2fa243e067cce495 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b434 expref: 7 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.346922:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.346925:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.346931:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.346935:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7232 initiator: MDT0 00010000:00010000:0.0:1746142917.346941:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.346945:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.346964:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.346980:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+6:2005:x1830962867592832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.346986:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6714 00010000:00010000:3.0:1746142917.347060:0:7232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142917.347069:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7232 initiator: MDT0 00000040:00080000:3.0:1746142917.347273:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].682, 88 off67736 00000004:00080000:3.0:1746142917.347278:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346378004ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347297:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].760, 88 off74696 00000004:00080000:3.0:1746142917.347300:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346400347ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347311:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].761, 88 off74784 00000004:00080000:3.0:1746142917.347314:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346413939ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347321:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].683, 88 off67824 00000004:00080000:3.0:1746142917.347324:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346423974ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347330:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].684, 88 off67912 00000004:00080000:3.0:1746142917.347342:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346432837ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347351:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].762, 88 off74872 00000004:00080000:3.0:1746142917.347353:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346453559ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347360:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].763, 88 off74960 00000004:00080000:3.0:1746142917.347363:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346462784ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347370:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].685, 88 off68000 00000004:00080000:3.0:1746142917.347372:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346472537ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347379:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].764, 88 off75048 00000004:00080000:3.0:1746142917.347382:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346482047ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347388:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].686, 88 off68088 00000004:00080000:3.0:1746142917.347392:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346492109ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347399:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].765, 88 off75136 00000004:00080000:3.0:1746142917.347401:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346501349ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347408:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].687, 88 off68176 00000004:00080000:3.0:1746142917.347411:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346510942ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347418:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].766, 88 off75224 00000004:00080000:3.0:1746142917.347420:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346520389ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347427:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].688, 88 off68264 00000004:00080000:3.0:1746142917.347430:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346529829ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142917.347436:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].767, 88 off75312 00000004:00080000:3.0:1746142917.347439:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346538929ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347445:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].768, 88 off75400 00000004:00080000:3.0:1746142917.347447:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691346547674ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142917.347455:0:7232:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].689, 88 off68352 00000004:00080000:3.0:1746142917.347457:0:7232:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691346557234ns, next at 629431245375ns, rc = 0 00000001:00080000:3.0:1746142917.349767:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936742 is committed 00000004:00080000:3.0:1746142917.349774:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 677 committed 00000004:00080000:3.0:1746142917.349786:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 756 committed 00000004:00080000:3.0:1746142917.350229:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 755 committed 00000004:00080000:3.0:1746142917.350231:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 676 committed 00000004:00080000:3.0:1746142917.350233:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 754 committed 00000004:00080000:3.0:1746142917.350234:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 675 committed 00000004:00080000:3.0:1746142917.350235:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 753 committed 00000004:00080000:3.0:1746142917.350245:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 674 committed 00000004:00080000:3.0:1746142917.350247:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 752 committed 00000004:00080000:3.0:1746142917.350249:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 673 committed 00000004:00080000:3.0:1746142917.350250:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 751 committed 00000004:00080000:3.0:1746142917.350251:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 750 committed 00000004:00080000:3.0:1746142917.350253:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 672 committed 00000004:00080000:3.0:1746142917.350254:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 671 committed 00000004:00080000:3.0:1746142917.350256:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 749 committed 00000004:00080000:3.0:1746142917.350257:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 748 committed 00000004:00080000:3.0:1746142917.350259:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 670 committed 00000001:00080000:3.0:1746142917.350265:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936740 is committed 00010000:00010000:3.0:1746142917.350313:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.350322:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142917.350324:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746142917.350327:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142917.350334:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.350340:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142917.350359:0:7232:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.350370:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.350381:0:7232:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867896320:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.350566:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867896192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.350600:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.350626:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746142917.350630:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867896448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.350644:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.350664:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867896192 00000100:00100000:1.0:1746142917.350668:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867896192 00000100:00100000:1.0:1746142917.350692:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867896448 00000100:00100000:1.0:1746142917.350694:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867896448 00000100:00100000:1.0:1746142917.350705:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14756 00000100:00100000:1.0:1746142917.350711:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3762:x1830962867896192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142917.350797:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142917.350800:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.350802:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.350804:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.350806:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142917.350828:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3762:x1830962867896192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (227us total) trans 17179874027 rc 0/0 00000100:00100000:1.0:1746142917.350832:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14756 00000100:00100000:1.0:1746142917.350843:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14757 00000100:00100000:1.0:1746142917.350847:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3762:x1830962867896448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142917.350891:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746142917.350894:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142917.350895:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142917.350912:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142917.350914:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:1.0:1746142917.350929:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3762:x1830962867896448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (285us total) trans 21474841283 rc 0/0 00000100:00100000:1.0:1746142917.350934:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14757 00000004:00080000:1.0:1746142917.350963:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938de300/2, rc 0, transno 21474841283 00000100:00100000:1.0:1746142917.350967:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867896448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142917.350974:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1180/2, rc 0, transno 17179874027 00000100:00100000:1.0:1746142917.350976:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867896192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.351031:0:7232:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9900 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.351050:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867896576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.351068:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.351079:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746142917.351082:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867896704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142917.351094:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.351116:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867896576 00000100:00100000:3.0:1746142917.351118:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867896576 00000100:00100000:3.0:1746142917.351134:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867896704 00000100:00100000:3.0:1746142917.351135:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867896704 00000100:00100000:3.0:1746142917.351145:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14758 00000100:00100000:3.0:1746142917.351149:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3764:x1830962867896576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142917.351189:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142917.351192:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:3.0:1746142917.351194:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:3.0:1746142917.351195:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:3.0:1746142917.351197:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746142917.351214:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:3764:x1830962867896576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (146us total) trans 17179874028 rc 0/0 00000100:00100000:3.0:1746142917.351219:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14758 00000100:00100000:3.0:1746142917.351228:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14759 00000100:00100000:3.0:1746142917.351232:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+38:3764:x1830962867896704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142917.351283:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142917.351285:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.351286:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.351288:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.351290:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746142917.351305:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3764:x1830962867896704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (210us total) trans 21474841284 rc 0/0 00000100:00100000:3.0:1746142917.351309:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14759 00000004:00080000:3.0:1746142917.351326:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938dca80/2, rc 0, transno 21474841284 00000100:00100000:3.0:1746142917.351329:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867896704:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142917.351335:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a3100/2, rc 0, transno 17179874028 00000100:00100000:3.0:1746142917.351337:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867896576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.351514:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867896960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.351533:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.351547:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867897472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.351558:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.351568:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1746142917.351571:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867896832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.351582:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.351592:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867897344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.351602:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.351610:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867897856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.351620:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.351637:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867896960 00000100:00100000:0.0:1746142917.351640:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867896960 00000100:00100000:0.0:1746142917.351653:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897472 00000100:00100000:0.0:1746142917.351655:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897472 00000100:00100000:0.0:1746142917.351662:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867896832 00000100:00100000:0.0:1746142917.351664:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867896832 00000100:00100000:0.0:1746142917.351671:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897344 00000100:00100000:0.0:1746142917.351673:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897344 00000100:00100000:0.0:1746142917.351678:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897856 00000100:00100000:0.0:1746142917.351679:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897856 00000100:00100000:0.0:1746142917.351686:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14760 00000100:00100000:0.0:1746142917.351690:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3763:x1830962867896960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142917.351732:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142917.351734:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142917.351737:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142917.351738:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142917.351740:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:0.0:1746142917.351760:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3763:x1830962867896960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (226us total) trans 17179874029 rc 0/0 00000100:00100000:0.0:1746142917.351765:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14760 00000100:00100000:0.0:1746142917.351775:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14761 00000100:00100000:0.0:1746142917.351779:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3763:x1830962867897472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.351827:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3763:x1830962867897472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (267us total) trans 21474841285 rc 0/0 00000100:00100000:0.0:1746142917.351831:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14761 00000100:00100000:0.0:1746142917.351839:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14762 00000100:00100000:0.0:1746142917.351843:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3763:x1830962867896832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142917.351877:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142917.351878:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:0.0:1746142917.351880:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142917.351882:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:0.0:1746142917.351883:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142917.351914:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3763:x1830962867896832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (316us total) trans 17179874030 rc 0/0 00000100:00100000:0.0:1746142917.351919:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14762 00000100:00100000:0.0:1746142917.351928:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14763 00000100:00100000:0.0:1746142917.351931:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3763:x1830962867897344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.351979:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3763:x1830962867897344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (375us total) trans 21474841286 rc 0/0 00000100:00100000:0.0:1746142917.351986:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14763 00000100:00100000:0.0:1746142917.351996:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14764 00000100:00100000:0.0:1746142917.352000:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3763:x1830962867897856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.352043:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3763:x1830962867897856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (422us total) trans 21474841287 rc 0/0 00000100:00100000:0.0:1746142917.352048:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14764 00000004:00080000:0.0:1746142917.352070:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1f80/2, rc 0, transno 17179874030 00000100:00100000:0.0:1746142917.352073:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867896832:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.352078:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938ddf80/2, rc 0, transno 21474841286 00000100:00100000:0.0:1746142917.352081:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867897344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142917.352101:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cdf80/2, rc 0, transno 21474841287 00000100:00100000:0.0:1746142917.352104:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867897856:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142917.352109:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1880/2, rc 0, transno 17179874029 00000100:00100000:0.0:1746142917.352111:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867896960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.352116:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981ce680/2, rc 0, transno 21474841285 00000100:00100000:0.0:1746142917.352118:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867897472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.352361:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.352380:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.352391:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.352404:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.352411:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.352422:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.352431:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746142917.352434:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.352446:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.352454:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.352464:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.352470:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.352480:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.352492:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897216 00000100:00100000:1.0:1746142917.352495:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897216 00000100:00100000:1.0:1746142917.352506:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897728 00000100:00100000:1.0:1746142917.352507:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897728 00000100:00100000:1.0:1746142917.352512:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898240 00000100:00100000:1.0:1746142917.352514:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898240 00000100:00100000:1.0:1746142917.352519:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897088 00000100:00100000:1.0:1746142917.352521:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897088 00000100:00100000:1.0:1746142917.352526:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897600 00000100:00100000:1.0:1746142917.352527:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897600 00000100:00100000:1.0:1746142917.352532:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898112 00000100:00100000:1.0:1746142917.352534:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898112 00000100:00100000:1.0:1746142917.352542:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14765 00000100:00100000:1.0:1746142917.352546:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3765:x1830962867897216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142917.352584:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:1.0:1746142917.352586:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.352588:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.352590:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.352591:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:1.0:1746142917.352609:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3765:x1830962867897216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (229us total) trans 21474841288 rc 0/0 00000100:00100000:1.0:1746142917.352614:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14765 00000100:00100000:1.0:1746142917.352623:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14766 00000100:00100000:1.0:1746142917.352627:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3765:x1830962867897728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142917.352659:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142917.352661:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.352663:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142917.352664:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.352666:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142917.352680:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3765:x1830962867897728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (276us total) trans 21474841289 rc 0/0 00000100:00100000:1.0:1746142917.352685:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14766 00000100:00100000:1.0:1746142917.352693:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14767 00000100:00100000:1.0:1746142917.352697:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3765:x1830962867898240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142917.352729:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:1.0:1746142917.352731:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.352733:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142917.352734:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.352735:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:1.0:1746142917.352750:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3765:x1830962867898240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (327us total) trans 17179874031 rc 0/0 00000100:00100000:1.0:1746142917.352755:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14767 00000100:00100000:1.0:1746142917.352762:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14768 00000100:00100000:1.0:1746142917.352766:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3765:x1830962867897088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142917.352796:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746142917.352798:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.352799:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142917.352800:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.352802:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:1.0:1746142917.352816:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3765:x1830962867897088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (369us total) trans 17179874032 rc 0/0 00000100:00100000:1.0:1746142917.352821:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14768 00000100:00100000:1.0:1746142917.352828:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14769 00000100:00100000:1.0:1746142917.352831:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3765:x1830962867897600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.352870:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3765:x1830962867897600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (405us total) trans 21474841290 rc 0/0 00000100:00100000:1.0:1746142917.352874:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14769 00000100:00100000:1.0:1746142917.352882:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14770 00000100:00100000:1.0:1746142917.352885:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3765:x1830962867898112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142917.352945:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3765:x1830962867898112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (463us total) trans 17179874033 rc 0/0 00000100:00100000:1.0:1746142917.352950:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14770 00000004:00080000:1.0:1746142917.352969:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2300/2, rc 0, transno 17179874032 00000100:00100000:1.0:1746142917.352972:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897088:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142917.352978:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cdc00/2, rc 0, transno 21474841290 00000100:00100000:1.0:1746142917.352980:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142917.352985:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2d80/2, rc 0, transno 17179874033 00000100:00100000:1.0:1746142917.352988:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898112:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142917.352993:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938df100/2, rc 0, transno 21474841288 00000100:00100000:1.0:1746142917.352995:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897216:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142917.352999:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cca80/2, rc 0, transno 21474841289 00000100:00100000:1.0:1746142917.353001:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867897728:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142917.353007:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2a00/2, rc 0, transno 17179874031 00000100:00100000:1.0:1746142917.353009:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.353213:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867898368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.353233:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.353256:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746142917.353261:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867897984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.353275:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.353290:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898368 00000100:00100000:3.0:1746142917.353293:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898368 00000100:00100000:3.0:1746142917.353307:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867897984 00000100:00100000:3.0:1746142917.353309:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867897984 00000100:00100000:3.0:1746142917.353317:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14771 00000100:00100000:3.0:1746142917.353322:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3762:x1830962867898368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.353377:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3762:x1830962867898368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (142us total) trans 17179874034 rc 0/0 00000100:00100000:3.0:1746142917.353381:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14771 00000100:00100000:3.0:1746142917.353390:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14772 00000100:00100000:3.0:1746142917.353394:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3762:x1830962867897984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142917.353428:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:3.0:1746142917.353430:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142917.353432:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142917.353433:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:3.0:1746142917.353435:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:3.0:1746142917.353451:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3762:x1830962867897984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (175us total) trans 17179874035 rc 0/0 00000100:00100000:3.0:1746142917.353455:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14772 00000004:00080000:3.0:1746142917.353472:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a1c00/2, rc 0, transno 17179874035 00000100:00100000:3.0:1746142917.353475:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867897984:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142917.353481:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a3480/2, rc 0, transno 17179874034 00000100:00100000:3.0:1746142917.353483:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867898368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.356457:0:7232:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7232:1830962867896320:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142917.356489:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24600/0x2fa243e067cce50c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746142917.356506:0:7232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 27 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.356519:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 27 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.356542:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb24e00, rc 0) 00000100:00100000:0.0:1746142917.356585:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32696:x1830962867592192:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 16618us (16806us total) trans 8589936742 rc 0/0 00000100:00100000:0.0:1746142917.356592:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14555 00000100:00100000:0.0:1746142917.358944:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.359031:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593088 00000100:00100000:1.0:1746142917.359038:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593088 00000100:00100000:1.0:1746142917.359066:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14558 00000100:00100000:1.0:1746142917.359071:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32696:x1830962867593088:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.359090:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.359105:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b49d expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.359286:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.359295:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 28 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.359303:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.359306:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142917.359308:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.359312:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8ee00, rc 0) 00000100:00100000:1.0:1746142917.359342:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32696:x1830962867593088:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 270us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.359348:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14558 00000100:00100000:0.0:1746142917.359414:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.359499:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593216 00000100:00100000:2.0:1746142917.359503:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593216 00010000:00010000:2.0:1746142917.359518:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.359544:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6715 00000100:00100000:2.0:1746142917.359549:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867593216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142917.359556:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142917.359560:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.359568:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.359581:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb24e00/0x2fa243e067cce513 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b481 expref: 28 pid: 7232 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.359592:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.359594:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142917.359599:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142917.359604:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142917.359610:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.359623:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142917.359634:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.359641:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142917.359652:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867593216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.359660:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6715 00000040:00080000:0.0:1746142917.359823:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].690, 88 off68440 00000004:00080000:0.0:1746142917.359827:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691358927424ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142917.360286:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].769, 88 off75488 00000004:00080000:1.0:1746142917.360328:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359427954ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360364:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].770, 88 off75576 00000004:00080000:1.0:1746142917.360368:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359468137ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360382:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].691, 88 off68528 00000004:00080000:1.0:1746142917.360385:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359485372ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142917.360395:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].692, 88 off68616 00000004:00080000:1.0:1746142917.360398:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359498336ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142917.360407:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].771, 88 off75664 00000004:00080000:1.0:1746142917.360410:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359510062ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360431:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].772, 88 off75752 00000004:00080000:1.0:1746142917.360434:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359533924ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360442:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].693, 88 off68704 00000004:00080000:1.0:1746142917.360444:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359544317ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142917.360453:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].773, 88 off75840 00000004:00080000:1.0:1746142917.360456:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359556597ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360465:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].694, 88 off68792 00000004:00080000:1.0:1746142917.360467:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359567489ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142917.360477:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].774, 88 off75928 00000004:00080000:1.0:1746142917.360479:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359579376ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360488:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].695, 88 off68880 00000004:00080000:1.0:1746142917.360491:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359590819ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142917.360499:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].775, 88 off76016 00000004:00080000:1.0:1746142917.360501:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359600972ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360508:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].696, 88 off68968 00000004:00080000:1.0:1746142917.360511:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359610969ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142917.360519:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].776, 88 off76104 00000004:00080000:1.0:1746142917.360521:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359621336ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360529:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].777, 88 off76192 00000004:00080000:1.0:1746142917.360531:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 691359631089ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142917.360540:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].697, 88 off69056 00000004:00080000:1.0:1746142917.360542:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 691359642644ns, next at 629431245375ns, rc = 0 00000001:00080000:3.0:1746142917.365589:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936743 is committed 00000004:00080000:3.0:1746142917.365599:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 685 committed 00000004:00080000:3.0:1746142917.365612:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 765 committed 00000004:00080000:3.0:1746142917.365616:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 764 committed 00000004:00080000:3.0:1746142917.365617:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 684 committed 00000004:00080000:3.0:1746142917.365619:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 763 committed 00000004:00080000:3.0:1746142917.365620:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 683 committed 00000004:00080000:3.0:1746142917.365622:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 762 committed 00000004:00080000:3.0:1746142917.365623:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 682 committed 00000004:00080000:3.0:1746142917.365624:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 761 committed 00000004:00080000:3.0:1746142917.365625:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 681 committed 00000004:00080000:3.0:1746142917.365628:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 760 committed 00000004:00080000:3.0:1746142917.365629:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 759 committed 00000004:00080000:3.0:1746142917.365630:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 680 committed 00000004:00080000:3.0:1746142917.365631:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 679 committed 00000004:00080000:3.0:1746142917.365632:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 758 committed 00000004:00080000:3.0:1746142917.365634:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 757 committed 00000004:00080000:3.0:1746142917.365635:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 678 committed 00000100:00100000:0.0:1746142917.365780:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867898496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.365830:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.366535:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142917.366542:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867898880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.366564:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.366601:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867899008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.366614:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.366646:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142917.366651:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867899392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.366664:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.366681:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898496 00000100:00100000:0.0:1746142917.366687:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898496 00000100:00100000:0.0:1746142917.366710:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898880 00000100:00100000:0.0:1746142917.366712:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898880 00000100:00100000:0.0:1746142917.366721:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899008 00000100:00100000:0.0:1746142917.366722:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899008 00000100:00100000:0.0:1746142917.366730:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899392 00000100:00100000:0.0:1746142917.366732:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899392 00000100:00100000:0.0:1746142917.366742:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14773 00000100:00100000:0.0:1746142917.366747:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3763:x1830962867898496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.366818:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14774 00000100:00100000:1.0:1746142917.366824:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3763:x1830962867898880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142917.366843:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142917.366846:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142917.366848:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142917.366849:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142917.366850:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142917.366876:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3763:x1830962867898496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (1045us total) trans 21474841291 rc 0/0 00000100:00100000:0.0:1746142917.366881:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14773 00000100:00100000:0.0:1746142917.366894:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14775 00000100:00100000:0.0:1746142917.366914:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3763:x1830962867899008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142917.367006:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.367027:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.367039:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142917.367051:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.367061:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.367074:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.367096:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746142917.367101:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898624:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142917.367174:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142917.367177:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.367178:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.367180:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:1.0:1746142917.367182:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746142917.367203:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867898880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 379us (637us total) trans 17179874036 rc 0/0 00000100:00100000:3.0:1746142917.367206:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867899904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.367211:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14774 00000100:00100000:1.0:1746142917.367220:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898752 00000100:00100000:1.0:1746142917.367222:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898752 00000100:00100000:3.0:1746142917.367223:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.367232:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899264 00000100:00100000:3.0:1746142917.367233:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746142917.367233:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899264 00000100:00100000:3.0:1746142917.367245:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867899520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.367249:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899776 00000100:00100000:1.0:1746142917.367251:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899776 00000100:00100000:1.0:1746142917.367257:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899904 00000100:00100000:1.0:1746142917.367258:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899904 00000100:00100000:3.0:1746142917.367259:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142917.367263:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899520 00000100:00100000:1.0:1746142917.367264:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899520 00000100:00100000:3.0:1746142917.367266:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867900032:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.367271:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14776 00000100:00100000:1.0:1746142917.367275:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3763:x1830962867899392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.367276:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142917.367289:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867900032 00000100:00100000:3.0:1746142917.367292:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867900032 00000100:00100000:3.0:1746142917.367304:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14777 00000100:00100000:3.0:1746142917.367308:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3765:x1830962867898752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142917.367353:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142917.367355:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.367357:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.367359:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:3.0:1746142917.367360:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746142917.367378:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3765:x1830962867898752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (350us total) trans 21474841292 rc 0/0 00000100:00100000:3.0:1746142917.367383:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14777 00000100:00100000:3.0:1746142917.367393:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14778 00000100:00100000:3.0:1746142917.367397:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867899264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142917.369280:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.369303:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142917.369322:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.369332:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.369345:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142917.369352:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867900160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.369364:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746142917.369385:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13ca80/2, rc 0, transno 21474841292 00000100:00100000:2.0:1746142917.369390:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.369411:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867898624 00000100:00100000:2.0:1746142917.369415:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867898624 00000100:00100000:2.0:1746142917.369433:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899136 00000100:00100000:2.0:1746142917.369434:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899136 00000100:00100000:2.0:1746142917.369440:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867899648 00000100:00100000:2.0:1746142917.369441:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867899648 00000100:00100000:2.0:1746142917.369447:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867900160 00000100:00100000:2.0:1746142917.369449:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867900160 00000100:00100000:2.0:1746142917.369459:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14779 00000100:00100000:2.0:1746142917.369464:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3765:x1830962867899776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.369549:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867899776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (2474us total) trans 21474841293 rc 0/0 00000100:00100000:2.0:1746142917.369554:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14779 00000100:00100000:2.0:1746142917.369565:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14780 00000100:00100000:2.0:1746142917.369569:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3762:x1830962867899904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142917.369612:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3762:x1830962867899904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (2387us total) trans 21474841294 rc 0/0 00000100:00100000:2.0:1746142917.369616:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14780 00000100:00100000:2.0:1746142917.369623:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14781 00000100:00100000:2.0:1746142917.369626:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3762:x1830962867899520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142917.369655:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:2.0:1746142917.369658:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:2.0:1746142917.369659:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:2.0:1746142917.369661:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:2.0:1746142917.369663:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:2.0:1746142917.369674:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3762:x1830962867899520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (2415us total) trans 21474841295 rc 0/0 00000100:00100000:2.0:1746142917.369678:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14781 00000100:00100000:2.0:1746142917.369685:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14782 00000100:00100000:2.0:1746142917.369688:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3762:x1830962867900032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746142917.369713:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142917.369715:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142917.369717:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142917.369718:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142917.369720:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142917.369735:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3762:x1830962867900032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (2458us total) trans 21474841296 rc 0/0 00000100:00100000:2.0:1746142917.369739:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14782 00000100:00100000:2.0:1746142917.369749:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14783 00000100:00100000:2.0:1746142917.369753:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3765:x1830962867898624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142917.369949:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:1.0:1746142917.369952:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:1.0:1746142917.369953:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142917.369955:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:1.0:1746142917.369956:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:1.0:1746142917.369980:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3763:x1830962867899392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2704us (3314us total) trans 17179874037 rc 0/0 00000100:00100000:1.0:1746142917.369985:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14776 00000100:00100000:1.0:1746142917.369996:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14784 00000100:00100000:1.0:1746142917.370000:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3765:x1830962867899136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142917.370035:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142917.370037:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.370039:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:1.0:1746142917.370040:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142917.370042:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:1.0:1746142917.370060:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3765:x1830962867899136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (736us total) trans 17179874038 rc 0/0 00000100:00100000:1.0:1746142917.370064:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14784 00000100:00100000:1.0:1746142917.370073:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14785 00000100:00100000:1.0:1746142917.370077:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3765:x1830962867899648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.370123:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867899648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (776us total) trans 21474841297 rc 0/0 00000100:00100000:1.0:1746142917.370127:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14785 00000100:00100000:1.0:1746142917.370135:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14786 00000100:00100000:1.0:1746142917.370139:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3765:x1830962867900160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.370185:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3765:x1830962867900160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (820us total) trans 21474841298 rc 0/0 00000100:00100000:1.0:1746142917.370189:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14786 00010000:00010000:1.0:1746142917.370256:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370266:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.370268:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746142917.370271:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370279:0:13326:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370285:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370295:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370301:0:13326:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370305:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.370327:0:13326:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.370335:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867900288:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.370389:0:13326:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.370396:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867900416:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142917.370411:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00002000:00010000:0.0:1746142917.370686:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142917.370690:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:0.0:1746142917.370692:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142917.370693:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:0.0:1746142917.370695:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142917.370719:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3763:x1830962867899008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3820us (4104us total) trans 17179874039 rc 0/0 00000100:00100000:0.0:1746142917.370725:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14775 00000004:00080000:0.0:1746142917.370758:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809c000/2, rc 0, transno 17179874037 00000100:00100000:0.0:1746142917.370762:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867899392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.370768:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809fb80/2, rc 0, transno 17179874039 00000100:00100000:0.0:1746142917.370770:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867899008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.370776:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809d500/2, rc 0, transno 17179874036 00000100:00100000:0.0:1746142917.370779:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867898880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142917.370786:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924a2680/2, rc 0, transno 21474841291 00000100:00100000:0.0:1746142917.370789:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867898496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142917.370855:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142917.370860:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867900672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.370878:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.370895:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867900672 00000100:00100000:0.0:1746142917.370912:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867900672 00000100:00100000:0.0:1746142917.370928:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14787 00000100:00100000:0.0:1746142917.370932:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+56:3763:x1830962867900672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142917.370975:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:0.0:1746142917.370977:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142917.370978:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142917.370979:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142917.370981:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:0.0:1746142917.371001:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:3763:x1830962867900672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (122us total) trans 17179874040 rc 0/0 00000100:00100000:0.0:1746142917.371008:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14787 00000004:00080000:0.0:1746142917.371026:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809ea00/2, rc 0, transno 17179874040 00000100:00100000:0.0:1746142917.371030:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867900672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.371052:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867900800:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.371067:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142917.371084:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867900800 00000100:00100000:0.0:1746142917.371087:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867900800 00000100:00100000:0.0:1746142917.371100:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14788 00000100:00100000:0.0:1746142917.371103:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3763:x1830962867900800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142917.371156:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3763:x1830962867900800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (88us total) trans 17179874041 rc 0/0 00000100:00100000:0.0:1746142917.371161:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14788 00000004:00080000:0.0:1746142917.371178:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb3480/2, rc 0, transno 17179874041 00000100:00100000:0.0:1746142917.371180:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867900800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.371252:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746142917.371259:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867900544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.371280:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746142917.371304:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13c700/2, rc 0, transno 21474841295 00000100:00100000:3.0:1746142917.371307:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867899520:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142917.371314:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13f480/2, rc 0, transno 21474841296 00000100:00100000:3.0:1746142917.371316:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867900032:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142917.371322:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13f800/2, rc 0, transno 21474841294 00000100:00100000:3.0:1746142917.371324:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867899904:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142917.371348:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746142917.371351:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142917.371352:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142917.371354:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142917.371356:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:3.0:1746142917.371374:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3765:x1830962867899264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3976us (4321us total) trans 17179874042 rc 0/0 00000100:00100000:3.0:1746142917.371379:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14778 00000100:00100000:3.0:1746142917.371389:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867900544 00000100:00100000:3.0:1746142917.371391:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867900544 00000100:00100000:3.0:1746142917.371405:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14789 00000100:00100000:3.0:1746142917.371409:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3764:x1830962867900544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142917.371460:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+59:3764:x1830962867900544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (179us total) trans 17179874043 rc 0/0 00000100:00100000:3.0:1746142917.371464:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14789 00000004:00080000:3.0:1746142917.371480:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809e680/2, rc 0, transno 17179874043 00000100:00100000:3.0:1746142917.371483:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867900544:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142917.372334:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142917.372337:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142917 -> 1746142917 00002000:00010000:2.0:1746142917.372339:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142917 -> 1746142917 00002000:00010000:2.0:1746142917.372341:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142917 -> 1746142917 00002000:00010000:2.0:1746142917.372342:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142917.372366:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3765:x1830962867898624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2612us (3086us total) trans 17179874044 rc 0/0 00000100:00100000:2.0:1746142917.372372:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14783 00000004:00080000:2.0:1746142917.372485:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809c380/2, rc 0, transno 17179874044 00000100:00100000:2.0:1746142917.372488:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867898624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142917.372497:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809d880/2, rc 0, transno 17179874038 00000100:00100000:2.0:1746142917.372499:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142917.372505:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13f100/2, rc 0, transno 21474841297 00000100:00100000:2.0:1746142917.372508:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899648:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142917.372515:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13ce00/2, rc 0, transno 21474841298 00000100:00100000:2.0:1746142917.372517:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867900160:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142917.372524:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809ed80/2, rc 0, transno 17179874042 00000100:00100000:2.0:1746142917.372526:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899264:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142917.372533:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011e13e680/2, rc 0, transno 21474841293 00000100:00100000:2.0:1746142917.372535:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867899776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142917.373502:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867900288:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142917.373512:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867900416:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.373542:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130400/0x2fa243e067cce51a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 10 pid: 13326 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746142917.373560:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.373589:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130200, rc 0) 00000100:00100000:1.0:1746142917.373631:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:32694:x1830962867592448:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 32876us (32984us total) trans 8589936743 rc 0/0 00000100:00100000:1.0:1746142917.373638:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14556 00000100:00100000:0.0:1746142917.374389:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.374446:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.374494:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593344 00000100:00100000:3.0:1746142917.374499:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593344 00000100:00100000:3.0:1746142917.374525:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593472 00000100:00100000:3.0:1746142917.374527:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593472 00000100:00100000:3.0:1746142917.374538:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5332 00000100:00100000:3.0:1746142917.374544:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32696:x1830962867593344:12345-192.168.204.50@tcp:49:multiop.0 00000100:00100000:3.0:1746142917.374620:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32696:x1830962867593344:12345-192.168.204.50@tcp:49:multiop.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.374626:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5332 00000100:00100000:3.0:1746142917.374661:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5333 00000100:00100000:3.0:1746142917.374666:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32690:x1830962867593472:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:3.0:1746142917.374700:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32690:x1830962867593472:12345-192.168.204.50@tcp:49:cat.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.374706:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5333 00000100:00100000:2.0:1746142917.375307:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.375359:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593600 00000100:00100000:0.0:1746142917.375362:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593600 00000100:00100000:0.0:1746142917.375381:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5334 00000100:00100000:0.0:1746142917.375386:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32694:x1830962867593600:12345-192.168.204.50@tcp:49:multiop.0 00000100:00100000:0.0:1746142917.375442:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32694:x1830962867593600:12345-192.168.204.50@tcp:49:multiop.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.375446:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5334 00000100:00100000:1.0:1746142917.389099:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.389118:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.389184:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.390574:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867594112 00000100:00100000:2.0:1746142917.390581:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593728 00000100:00100000:3.0:1746142917.390584:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867594112 00000100:00100000:2.0:1746142917.390584:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593728 00002000:00100000:3.0:1746142917.390623:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093bcd180 x1830962867594112/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746142917.390630:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867593856 00002000:00100000:3.0:1746142917.390632:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd180 with x1830962867594112 ext(1048576->2097151) 00000100:00100000:2.0:1746142917.390632:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867593856 00002000:00010000:3.0:1746142917.390637:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcd180 00000100:00100000:2.0:1746142917.390647:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14790 00000100:00100000:3.0:1746142917.390648:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4626 00000100:00100000:3.0:1746142917.390653:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867594112:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142917.390653:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+27:32694:x1830962867593728:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.390662:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.390675:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4a4 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.390694:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.390701:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 15 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.390706:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.390708:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.390710:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1245184->1691647] (req 1245184->1691647) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.390733:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 15 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.390746:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 15 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.390754:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867900928:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.390827:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.390835:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.390842:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867901056:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.390860:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.391136:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14791 00000100:00100000:1.0:1746142917.391143:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32696:x1830962867593856:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.391150:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.391158:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4ab expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.391171:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.391177:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.391182:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.391184:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.391186:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1929216->2084863] (req 1929216->2084863) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.391199:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 28 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.391206:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.391213:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867901184:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.391256:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.391262:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.391268:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867901312:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.391284:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.393593:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867900928:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.394612:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867901056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142917.394638:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [1245184->1691647] (req 1245184->1691647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.394652:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc06e00, rc 0) 00000100:00100000:3.0:1746142917.394691:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad4f1515-ae46-4d91-8f96-492179af7039+28:32694:x1830962867593728:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4037us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.394699:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14790 00000100:00100000:0.0:1746142917.394990:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.395005:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.395020:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867594496 00000100:00100000:0.0:1746142917.395025:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867594496 00010000:00010000:0.0:1746142917.395047:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.395064:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867594240 00000100:00100000:0.0:1746142917.395067:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867594240 00010000:00010000:0.0:1746142917.395075:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 16 pid: 12211 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.395087:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6716 00000100:00100000:0.0:1746142917.395092:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867594496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.395102:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.395117:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.395126:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.395143:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.395158:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867594496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.395164:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6716 00000100:00100000:0.0:1746142917.395174:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6717 00000100:00100000:0.0:1746142917.395178:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+16:2005:x1830962867594240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.395183:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.395191:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 16 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.395198:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 16 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.395207:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce4b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b449 expref: 16 pid: 12211 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.395219:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.395232:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867594240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.395249:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6717 00000100:00100000:0.0:1746142917.395284:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.395296:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867594368 00000100:00100000:0.0:1746142917.395298:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867594368 00010000:00010000:0.0:1746142917.395308:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:0.0:1746142917.395319:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6718 00000100:00100000:0.0:1746142917.395323:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2005:x1830962867594368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.395328:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.395334:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.395341:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.395355:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091fc2e00/0x2fa243e067cce46b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b426 expref: 28 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.395362:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.395364:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.395369:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.395376:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.395398:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.395408:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092407480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867901440:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.395578:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25c00/0x2fa243e067cce4fe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b473 expref: 27 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.396715:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867901184:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.396730:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867901312:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.396746:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1929216->2084863] (req 1929216->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 38 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.396755:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0800, rc 0) 00000100:00100000:1.0:1746142917.396773:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32696:x1830962867593856:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 5631us (7654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.396783:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14791 00000100:00100000:0.0:1746142917.396973:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.410493:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.410524:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.410543:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867595136 00000100:00100000:1.0:1746142917.410550:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867595136 00000100:00100000:1.0:1746142917.410584:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14559 00000100:00100000:1.0:1746142917.410591:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4009050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32699:x1830962867595136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.410605:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.410622:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067cce54b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4b2 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.410680:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410691:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410699:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410707:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410712:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410716:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410789:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410799:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410803:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142917.410810:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142917.410858:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410863:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410867:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410872:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984b1e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.410875:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410880:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410887:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.410889:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142917.410891:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410895:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1e00/0x2fa243e067cce560 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410923:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410931:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410935:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410938:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984b1c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.410939:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410943:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410947:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142917.410949:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.410951:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410954:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1c00/0x2fa243e067cce552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410958:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410962:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410966:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410969:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800984b1800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.410971:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410977:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410982:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4e00) 00010000:00010000:1.0:1746142917.410983:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.410985:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.410988:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1800/0x2fa243e067cce559 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.411011:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067cce54b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4b2 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.411017:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1600/0x2fa243e067cce54b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4b2 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.411022:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1600, rc 0) 00000100:00100000:1.0:1746142917.411052:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4009050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32699:x1830962867595136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 461us (527us total) trans 8589936744 rc 301/301 00000100:00100000:1.0:1746142917.411057:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14559 00000100:00100000:0.0:1746142917.411611:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867594624 00000100:00100000:0.0:1746142917.411615:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867594624 00010000:00010000:0.0:1746142917.411632:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.413457:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092407480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867901440:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.413471:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142917.413496:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867594368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 18171us (18210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.413503:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6718 00000100:00100000:1.0:1746142917.413522:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6719 00000100:00100000:1.0:1746142917.413529:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b405e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+15:2003:x1830962867594624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142917.413541:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142917.413560:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.413572:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.413591:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881400/0x2fa243e067cce4cd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b450 expref: 15 pid: 9578 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.413602:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.413603:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.413608:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.413615:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.413638:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 37 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.413647:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867901568:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142917.413687:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18900 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.413851:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+19:2003:x1830962867594112:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 23197us (24666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142917.413858:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4626 00002000:00100000:3.0:1746142917.413864:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880093bcd180 x1830962867594112/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.413872:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcd180 with x1830962867594112 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.413876:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcd180 00000100:00100000:0.0:1746142917.415262:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.415301:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867594880 00000100:00100000:3.0:1746142917.415307:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867594880 00002000:00100000:3.0:1746142917.415331:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1245184->1249279) req@ffff880092406680 x1830962867594880/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.415338:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406680 with x1830962867594880 ext(1245184->1249279) 00002000:00010000:3.0:1746142917.415341:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406680 00000100:00100000:3.0:1746142917.415363:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4627 00000100:00100000:3.0:1746142917.415369:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867594880:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.415464:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2006:x1830962867594880:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 94us (204us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.415468:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4627 00002000:00100000:3.0:1746142917.415473:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1245184->1249279) req@ffff880092406680 x1830962867594880/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.415479:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406680 with x1830962867594880 ext(1245184->1249279) 00002000:00010000:3.0:1746142917.415481:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406680 00000100:00100000:1.0:1746142917.422299:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867901568:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.422318:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142917.422479:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.422866:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b405e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c8243383-433c-45fe-9bef-8828afa9ff81+14:2003:x1830962867594624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9335us (12378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.422877:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6719 00000100:00100000:3.0:1746142917.425325:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867595392 00000100:00100000:3.0:1746142917.425336:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867595392 00002000:00100000:3.0:1746142917.425384:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1929216->1933311) req@ffff880092406d80 x1830962867595392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.425393:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406d80 with x1830962867595392 ext(1929216->1933311) 00002000:00010000:3.0:1746142917.425398:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406d80 00000100:00100000:3.0:1746142917.425414:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4628 00000100:00100000:3.0:1746142917.425420:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867595392:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.425592:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867595392:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 171us (3114us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.425597:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4628 00002000:00100000:3.0:1746142917.425602:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1929216->1933311) req@ffff880092406d80 x1830962867595392/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.425609:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406d80 with x1830962867595392 ext(1929216->1933311) 00002000:00010000:3.0:1746142917.425612:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406d80 00000100:00100000:0.0:1746142917.427170:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.427200:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.427228:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.427253:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867595520 00000100:00100000:0.0:1746142917.427257:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867595520 00000100:00100000:0.0:1746142917.427279:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867595648 00000100:00100000:0.0:1746142917.427281:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867595648 00000100:00100000:0.0:1746142917.427303:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867595776 00000100:00100000:0.0:1746142917.427305:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867595776 00000100:00100000:0.0:1746142917.427318:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14792 00000100:00100000:0.0:1746142917.427323:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867595520:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.427334:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.427348:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3a800/0x2fa243e067cce56e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4b9 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.427386:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092405500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867901696:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142917.427438:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14793 00000100:00100000:0.0:1746142917.427442:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.427446:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+19:2004:x1830962867595648:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.427454:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142917.427460:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14794 00000100:00100000:0.0:1746142917.427465:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+28:2004:x1830962867595776:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.427472:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.427473:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4c0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.427477:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4c7 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.427485:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.427486:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.427487:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.427488:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.427494:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.427494:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.427506:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 29 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.427508:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 20 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.427516:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9a1a00, rc 0) 00010000:00010000:0.0:1746142917.427517:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3b600, rc 0) 00000100:00100000:0.0:1746142917.427532:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867595776:12345-192.168.204.50@tcp:101:cat.0 Request processed in 66us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.427537:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867595648:12345-192.168.204.50@tcp:101:cat.0 Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.427537:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14794 00000100:00100000:2.0:1746142917.427542:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14793 00000100:00100000:0.0:1746142917.440643:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.442042:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867596032 00000100:00100000:3.0:1746142917.442051:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867596032 00002000:00100000:3.0:1746142917.442090:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1687552->1691647) req@ffff880092404380 x1830962867596032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.442100:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404380 with x1830962867596032 ext(1687552->1691647) 00002000:00010000:3.0:1746142917.442105:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092404380 00000100:00100000:3.0:1746142917.442138:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4629 00000100:00100000:3.0:1746142917.442145:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867596032:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.442845:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092404380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867596032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 698us (2206us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.442852:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4629 00002000:00100000:3.0:1746142917.442859:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1687552->1691647) req@ffff880092404380 x1830962867596032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.442867:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092404380 with x1830962867596032 ext(1687552->1691647) 00002000:00010000:3.0:1746142917.442871:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092404380 00000100:00100000:0.0:1746142917.443016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.444006:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867596288 00000100:00100000:3.0:1746142917.444014:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867596288 00002000:00100000:3.0:1746142917.444042:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (2080768->2084863) req@ffff880092406300 x1830962867596288/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.444049:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406300 with x1830962867596288 ext(2080768->2084863) 00002000:00010000:3.0:1746142917.444052:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406300 00000100:00100000:3.0:1746142917.444067:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4630 00000100:00100000:3.0:1746142917.444073:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867596288:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.444178:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:2005:x1830962867596288:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 105us (1162us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.444184:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4630 00002000:00100000:3.0:1746142917.444189:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (2080768->2084863) req@ffff880092406300 x1830962867596288/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.444195:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092406300 with x1830962867596288 ext(2080768->2084863) 00002000:00010000:3.0:1746142917.444197:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092406300 00002000:00010000:1.0:1746142917.447113:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142917 -> 1746142918 00002000:00010000:1.0:1746142917.447120:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142917 -> 1746142918 00000100:00100000:1.0:1746142917.447143:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092405500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867901696:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.447173:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3a800/0x2fa243e067cce56e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4b9 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.447186:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a800/0x2fa243e067cce56e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4b9 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.447211:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a800, rc 0) 00000100:00100000:1.0:1746142917.447276:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+27:2004:x1830962867595520:12345-192.168.204.50@tcp:101:cat.0 Request processed in 19951us (20107us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.447284:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14792 00000100:00100000:0.0:1746142917.453142:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.453178:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.453210:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.453231:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867596544 00000100:00100000:0.0:1746142917.453247:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867596544 00000100:00100000:0.0:1746142917.453289:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867596928 00000100:00100000:0.0:1746142917.453292:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867596928 00000100:00100000:0.0:1746142917.453304:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5335 00000100:00100000:0.0:1746142917.453310:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32696:x1830962867596544:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142917.453321:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5336 00000100:00100000:3.0:1746142917.453327:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32694:x1830962867596928:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142917.453477:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32694:x1830962867596928:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 149us (265us total) trans 8589936746 rc 0/0 00000100:00100000:3.0:1746142917.453482:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5336 00000100:00100000:1.0:1746142917.453648:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867596672 00000100:00100000:1.0:1746142917.453652:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867596672 00000100:00100000:1.0:1746142917.453674:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14560 00000100:00100000:1.0:1746142917.453678:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32699:x1830962867596672:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.453687:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.453701:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1400/0x2fa243e067cce583 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4ce expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.453744:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.453754:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.453763:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:1.0:1746142917.453778:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:1.0:1746142917.453780:0:7232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142917.453789:0:7232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.453803:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b1400/0x2fa243e067cce583 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 32 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.453958:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32696:x1830962867596544:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 648us (822us total) trans 8589936745 rc 0/0 00000100:00100000:0.0:1746142917.453964:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5335 00010000:00010000:1.0:1746142917.456024:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 30 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.456036:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.456038:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142917.456041:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b0000, rc 0) 00000100:00100000:1.0:1746142917.456098:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32699:x1830962867596672:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2416us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.456105:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14560 00000100:00100000:0.0:1746142917.465980:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.466019:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.466046:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.466059:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.466099:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.466121:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867597056 00000100:00100000:0.0:1746142917.466130:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867597056 00000100:00100000:0.0:1746142917.466162:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867597312 00000100:00100000:0.0:1746142917.466164:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867597312 00000100:00100000:0.0:1746142917.466172:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867597568 00000100:00100000:0.0:1746142917.466173:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867597568 00000100:00100000:3.0:1746142917.466177:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867597184 00000100:00100000:3.0:1746142917.466181:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867597184 00000100:00100000:0.0:1746142917.466182:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867597440 00000100:00100000:0.0:1746142917.466183:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867597440 00000100:00100000:0.0:1746142917.466193:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14795 00000100:00100000:0.0:1746142917.466205:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867597056:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.466222:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.466249:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4d5 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.466269:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.466270:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.466278:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 45 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.466291:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 45 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.466300:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3be00, rc 0) 00000100:00100000:0.0:1746142917.466337:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867597056:12345-192.168.204.50@tcp:101:cat.0 Request processed in 137us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.466770:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14795 00000100:00100000:3.0:1746142917.466776:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14796 00000100:00100000:3.0:1746142917.466782:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867597312:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142917.466785:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14797 00010000:00010000:3.0:1746142917.466790:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142917.466791:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867597568:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142917.466797:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4e3 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.466798:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.466806:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4f1 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.466808:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.466809:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.466814:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 45 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.466817:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.466818:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142917.466822:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 40 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.466823:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 45 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.466830:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3600, rc 0) 00010000:00010000:0.0:1746142917.466832:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 40 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142917.466838:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3ae00, rc 0) 00000100:00100000:3.0:1746142917.466848:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867597312:12345-192.168.204.50@tcp:101:cat.0 Request processed in 67us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.466853:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14796 00000100:00100000:0.0:1746142917.466855:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867597568:12345-192.168.204.50@tcp:101:cat.0 Request processed in 64us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.466860:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14797 00000100:00100000:3.0:1746142917.466866:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14798 00000100:00100000:0.0:1746142917.466869:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14799 00000100:00100000:3.0:1746142917.466871:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867597440:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1746142917.466874:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867597184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142917.466876:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.466879:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.466882:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4ea expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.466884:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cce5ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4dc expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.466891:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.466892:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.466896:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 45 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.466928:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 45 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.466939:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091fc3e00, rc 0) 00000100:00100000:0.0:1746142917.466941:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013644df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867901824:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142917.466952:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867597440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 82us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.466957:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14798 00000100:00100000:0.0:1746142917.466990:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.469581:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.469811:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867597824 00000100:00100000:0.0:1746142917.469815:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.469819:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867597824 00002000:00100000:2.0:1746142917.469853:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88013644d500 x1830962867597824/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.469862:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d500 with x1830962867597824 ext(2097152->4194303) 00002000:00010000:2.0:1746142917.469867:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644d500 00000100:00100000:2.0:1746142917.469880:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867598080 00000100:00100000:2.0:1746142917.469882:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867598080 00002000:00100000:2.0:1746142917.469893:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88013644fb80 x1830962867598080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746142917.469949:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4631 00000100:00100000:0.0:1746142917.469957:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867597824:12345-192.168.204.50@tcp:3:cat.0 00002000:00010000:1.0:1746142917.469963:0:9578:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142917 -> 1746142918 00002000:00010000:1.0:1746142917.469965:0:9578:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142917 -> 1746142918 00002000:00010000:1.0:1746142917.469966:0:9578:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142917 -> 1746142918 00000100:00100000:1.0:1746142917.469980:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013644df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867901824:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.470003:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cce5ad lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4dc expref: 40 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.470014:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3a600/0x2fa243e067cce5ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4dc expref: 40 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.470027:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a600, rc 0) 00000100:00100000:1.0:1746142917.470057:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2005:x1830962867597184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3183us (3997us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.470063:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14799 00002000:00100000:2.0:1746142917.470112:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644fb80 with x1830962867598080 ext(2097152->4194303) 00002000:00010000:2.0:1746142917.470114:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644fb80 00000100:00100000:2.0:1746142917.470131:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4632 00000100:00100000:2.0:1746142917.470136:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867598080:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.495323:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867597824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 25359us (25741us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142917.495334:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4631 00002000:00100000:2.0:1746142917.495346:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88013644d500 x1830962867597824/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.495354:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d500 with x1830962867597824 ext(2097152->4194303) 00002000:00010000:2.0:1746142917.495359:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644d500 00000100:00100000:0.0:1746142917.499184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.501494:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867598336 00000100:00100000:2.0:1746142917.501504:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867598336 00002000:00100000:2.0:1746142917.501561:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88013644df80 x1830962867598336/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.501569:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644df80 with x1830962867598336 ext(0->1048575) 00002000:00010000:2.0:1746142917.501574:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644df80 00000100:00100000:2.0:1746142917.501602:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4633 00000100:00100000:2.0:1746142917.501608:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867598336:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.505745:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2006:x1830962867598080:12345-192.168.204.50@tcp:3:cat.0 Request processed in 35599us (35920us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142917.505756:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4632 00002000:00100000:2.0:1746142917.505767:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88013644fb80 x1830962867598080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.505775:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644fb80 with x1830962867598080 ext(2097152->4194303) 00002000:00010000:2.0:1746142917.505781:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644fb80 00000100:00100000:2.0:1746142917.509650:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867598336:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8034us (10466us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.509660:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4633 00002000:00100000:2.0:1746142917.509668:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88013644df80 x1830962867598336/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.509682:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644df80 with x1830962867598336 ext(0->1048575) 00002000:00010000:2.0:1746142917.509687:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644df80 00000100:00100000:0.0:1746142917.515851:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.515895:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.515931:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867598464 00000100:00100000:1.0:1746142917.515942:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867598464 00000100:00100000:1.0:1746142917.516109:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867598592 00000100:00100000:1.0:1746142917.516113:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867598592 00000100:00100000:3.0:1746142917.516121:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14800 00000100:00100000:3.0:1746142917.516129:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867598464:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1746142917.516139:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14801 00000100:00100000:1.0:1746142917.516143:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32699:x1830962867598592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142917.516145:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.516148:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.516158:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4f8 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.516158:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b4ff expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.516177:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.516184:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.516185:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.516187:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 40 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.516196:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867901952:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.516202:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.516210:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 28 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.516217:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902080:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.516266:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.516370:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.517519:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902080:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.517537:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 40 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.517547:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1200, rc 0) 00000100:00100000:1.0:1746142917.517582:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32699:x1830962867598592:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1438us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.517589:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14801 00002000:00010000:3.0:1746142917.517650:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142917 -> 1746142918 00000100:00100000:3.0:1746142917.517664:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867901952:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142917.517679:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f8 expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.517686:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f8 expref: 28 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.517707:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe5e00, rc 0) 00000100:00100000:3.0:1746142917.517723:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867598464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1596us (1880us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142917.517728:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14800 00000100:00100000:0.0:1746142917.519094:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.519144:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867598720 00000100:00100000:2.0:1746142917.519150:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867598720 00002000:00100000:2.0:1746142917.519181:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1245184->1691647) req@ffff880130375c00 x1830962867598720/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.519189:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375c00 with x1830962867598720 ext(1245184->1691647) 00010000:00010000:2.0:1746142917.519196:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 27 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.519206:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 27 pid: 9580 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746142917.519212:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130375c00 00000100:00100000:2.0:1746142917.519243:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1438 00000100:00100000:2.0:1746142917.519250:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+27:2005:x1830962867598720:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142917.522445:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.522682:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867598976 00000100:00100000:1.0:1746142917.522693:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867598976 00002000:00100000:1.0:1746142917.522735:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880096140700 x1830962867598976/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142917.522745:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140700 with x1830962867598976 ext(4194304->5066751) 00002000:00010000:1.0:1746142917.522754:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096140700 00000100:00100000:1.0:1746142917.522803:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4634 00000100:00100000:1.0:1746142917.522810:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867598976:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.523865:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867598720:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4613us (4772us total) trans 17179874045 rc 0/0 00000100:00100000:3.0:1746142917.523875:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1438 00002000:00100000:3.0:1746142917.523881:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1245184->1691647) req@ffff880130375c00 x1830962867598720/t17179874045(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.523889:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130375c00 with x1830962867598720 ext(1245184->1691647) 00010000:00010000:3.0:1746142917.523896:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 29 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.523939:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 29 pid: 9580 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.523946:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130375c00 00000100:00100000:0.0:1746142917.528109:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.528222:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867599104 00000100:00100000:1.0:1746142917.528229:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867599104 00010000:00010000:1.0:1746142917.528270:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 29 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.528292:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6720 00000100:00100000:1.0:1746142917.528299:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867599104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142917.528310:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142917.528324:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 29 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.528334:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 29 pid: 9580 timeout: 791 lvb_type: 0 00010000:00010000:1.0:1746142917.528351:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc06e00/0x2fa243e067cce53d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1245184->1691647) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4a4 expref: 29 pid: 9580 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.528354:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+20:2004:x1830962867598976:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5542us (5913us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142917.528362:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4634 00002000:00100000:2.0:1746142917.528370:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880096140700 x1830962867598976/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.528379:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096140700 with x1830962867598976 ext(4194304->5066751) 00002000:00010000:2.0:1746142917.528383:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096140700 00010000:00010000:1.0:1746142917.528488:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.528490:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.528497:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 39 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.528504:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 39 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.528530:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 39 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.528539:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867902208:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142917.528939:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.531415:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867902208:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.531430:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142917.531468:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+28:2006:x1830962867599104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3168us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.531477:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6720 00000100:00100000:0.0:1746142917.534084:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.534126:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.534495:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867599232 00000100:00100000:3.0:1746142917.534502:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867599232 00000100:00100000:1.0:1746142917.534774:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867599360 00000100:00100000:1.0:1746142917.534778:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867599360 00000100:00100000:3.0:1746142917.535375:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14802 00000100:00100000:3.0:1746142917.535383:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867599232:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142917.535397:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142917.535411:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b506 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.535429:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.535431:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.535438:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 30 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.535451:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 30 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142917.535460:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe5e00, rc 0) 00000100:00100000:3.0:1746142917.535502:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+30:2004:x1830962867599232:12345-192.168.204.50@tcp:101:cat.0 Request processed in 120us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.535507:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14802 00000100:00100000:1.0:1746142917.536108:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14803 00000100:00100000:1.0:1746142917.536113:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867599360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.536120:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.536126:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b1600/0x2fa243e067cce5c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b50d expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.536524:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902336:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142917.537066:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.537097:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.537125:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.537141:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867599616 00000100:00100000:0.0:1746142917.537145:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867599616 00002000:00100000:0.0:1746142917.537170:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130376a00 x1830962867599616/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142917.537179:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376a00 with x1830962867599616 ext(1048576->2097151) 00002000:00010000:0.0:1746142917.537183:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130376a00 00000100:00100000:0.0:1746142917.537194:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867599872 00000100:00100000:0.0:1746142917.537196:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867599872 00002000:00100000:0.0:1746142917.537206:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130377800 x1830962867599872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 504/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142917.537212:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377800 with x1830962867599872 ext(1048576->2097151) 00002000:00010000:0.0:1746142917.537215:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130377800 00000100:00100000:0.0:1746142917.537221:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867600128 00000100:00100000:0.0:1746142917.537223:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867600128 00002000:00100000:0.0:1746142917.537233:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880130374a80 x1830962867600128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142917.537255:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374a80 with x1830962867600128 ext(1048576->2097151) 00002000:00010000:0.0:1746142917.537258:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130374a80 00000100:00100000:0.0:1746142917.537273:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4635 00000100:00100000:0.0:1746142917.537278:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867599616:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.537337:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4636 00000100:00100000:2.0:1746142917.537345:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867599872:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142917.537627:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.537740:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4637 00000100:00100000:3.0:1746142917.537747:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867600128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142917.543422:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902336:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.543455:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1600/0x2fa243e067cce5c9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b50d expref: 30 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.543468:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1600/0x2fa243e067cce5c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b50d expref: 30 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.543496:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1600, rc 0) 00000100:00100000:1.0:1746142917.543545:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2004:x1830962867599360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7430us (9416us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.543552:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14803 00000100:00100000:2.0:1746142917.544103:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867599872:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6758us (7003us total) trans 0 rc 892928/892928 00000100:00100000:2.0:1746142917.544111:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4636 00002000:00100000:2.0:1746142917.544127:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130377800 x1830962867599872/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 504/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.544135:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130377800 with x1830962867599872 ext(1048576->2097151) 00002000:00010000:2.0:1746142917.544139:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130377800 00000100:00100000:2.0:1746142917.547415:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867599616:12345-192.168.204.50@tcp:3:cat.0 Request processed in 10128us (10341us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.547424:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4635 00002000:00100000:2.0:1746142917.547432:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880130376a00 x1830962867599616/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.547441:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130376a00 with x1830962867599616 ext(1048576->2097151) 00002000:00010000:2.0:1746142917.547446:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130376a00 00000100:00100000:3.0:1746142917.549221:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867600128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11469us (12088us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142917.549228:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4637 00002000:00100000:3.0:1746142917.549244:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff880130374a80 x1830962867600128/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.549253:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130374a80 with x1830962867600128 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.549257:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130374a80 00000100:00100000:0.0:1746142917.549997:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.550402:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867600256 00000100:00100000:1.0:1746142917.550409:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867600256 00000100:00100000:1.0:1746142917.550449:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14804 00000100:00100000:1.0:1746142917.550455:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867600256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.550469:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.550503:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800984b1800/0x2fa243e067cce5d0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b514 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.550542:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902464:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142917.550682:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.553113:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902464:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.553139:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1800/0x2fa243e067cce5d0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b514 expref: 30 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.553151:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1800/0x2fa243e067cce5d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b514 expref: 30 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.553810:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800984b1800, rc 0) 00000100:00100000:1.0:1746142917.553856:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867600256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3400us (3859us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.553863:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14804 00000100:00100000:0.0:1746142917.557377:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.557436:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867600512 00000100:00100000:2.0:1746142917.557444:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867600512 00000100:00100000:2.0:1746142917.557528:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5337 00000100:00100000:2.0:1746142917.557535:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:32690:x1830962867600512:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142917.558302:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f39850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:32690:x1830962867600512:12345-192.168.204.50@tcp:35:cat.0 Request processed in 767us (931us total) trans 8589936747 rc 0/0 00000100:00100000:2.0:1746142917.558309:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5337 00000100:00100000:0.0:1746142917.563098:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.563263:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.563333:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867600768 00000100:00100000:3.0:1746142917.563342:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867600768 00002000:00100000:3.0:1746142917.563377:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880088fdb480 x1830962867600768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.563386:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb480 with x1830962867600768 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.563390:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdb480 00000100:00100000:3.0:1746142917.563405:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867601024 00000100:00100000:3.0:1746142917.563407:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867601024 00002000:00100000:3.0:1746142917.563416:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088fdb100 x1830962867601024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.563428:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb100 with x1830962867601024 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.563431:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fdb100 00000100:00100000:3.0:1746142917.563442:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4638 00000100:00100000:3.0:1746142917.563448:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867600768:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.564433:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4639 00000100:00100000:3.0:1746142917.564441:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867601024:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.582091:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867600768:12345-192.168.204.50@tcp:3:cat.0 Request processed in 18634us (18993us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142917.582102:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4638 00002000:00100000:3.0:1746142917.582112:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880088fdb480 x1830962867600768/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.582121:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb480 with x1830962867600768 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.582125:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fdb480 00000100:00100000:0.0:1746142917.586063:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.586293:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867601280 00000100:00100000:1.0:1746142917.586301:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867601280 00000100:00100000:1.0:1746142917.586350:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14561 00000100:00100000:1.0:1746142917.586357:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:32704:x1830962867601280:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.586376:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.586392:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce5d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b51b expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.586452:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586462:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586471:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586483:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586488:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586493:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586567:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586574:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586579:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:1.0:1746142917.586587:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142917.586637:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586643:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586652:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586656:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094715a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.586659:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586665:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586673:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.586675:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142917.586678:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586682:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094715a00/0x2fa243e067cce5ec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586711:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586716:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586720:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586724:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586728:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800971d1c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.586730:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586737:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586743:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142917.586744:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.586747:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586750:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce5de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586757:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586761:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586766:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586770:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800971d0400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.586771:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586776:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586781:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4400) 00010000:00010000:1.0:1746142917.586783:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.586785:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586788:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0400/0x2fa243e067cce5e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:1.0:1746142917.586816:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce5d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b51b expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.586823:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce5d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b51b expref: 13 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.586829:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1600, rc 0) 00000100:00100000:1.0:1746142917.586864:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+12:32704:x1830962867601280:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 508us (810us total) trans 8589936748 rc 301/301 00000100:00100000:1.0:1746142917.586870:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14561 00000100:00100000:3.0:1746142917.591572:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867601024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27124us (28301us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142917.591581:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4639 00002000:00100000:3.0:1746142917.591591:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880088fdb100 x1830962867601024/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.591598:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fdb100 with x1830962867601024 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.591604:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fdb100 00000100:00100000:0.0:1746142917.605261:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.605329:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.605361:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867601792 00000100:00100000:0.0:1746142917.605370:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867601792 00000100:00100000:3.0:1746142917.605459:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867601536 00000100:00100000:3.0:1746142917.605464:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867601536 00002000:00100000:3.0:1746142917.605502:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880088fd8e00 x1830962867601536/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.605511:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8e00 with x1830962867601536 ext(4194304->5066751) 00002000:00010000:3.0:1746142917.605516:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd8e00 00000100:00100000:3.0:1746142917.605747:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4640 00000100:00100000:3.0:1746142917.605757:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867601536:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142917.608084:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14562 00000100:00100000:0.0:1746142917.608098:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32706:x1830962867601792:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142917.608117:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.608137:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cce5fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b522 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.608209:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608223:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608243:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608264:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608270:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608276:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608379:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608390:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608395:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142917.608405:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142917.608474:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608481:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608486:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608491:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097794e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.608495:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608500:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608511:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142917.608514:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142917.608518:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.608522:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097794e00/0x2fa243e067cce60f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611766:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611777:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611782:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611785:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097795400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.611788:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611793:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611804:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:0.0:1746142917.611806:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142917.611809:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611812:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097795400/0x2fa243e067cce601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611822:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611827:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611830:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611833:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097794200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142917.611835:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611839:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611843:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800927b3200) 00010000:00010000:0.0:1746142917.611845:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746142917.611846:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142917.611850:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097794200/0x2fa243e067cce608 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.611950:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cce5fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b522 expref: 32 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.611957:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097794000/0x2fa243e067cce5fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b522 expref: 32 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.611978:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097794000, rc 0) 00000100:00100000:1.0:1746142917.612024:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32706:x1830962867601792:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3931us (6696us total) trans 8589936749 rc 301/301 00000100:00100000:1.0:1746142917.612031:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14562 00000100:00100000:3.0:1746142917.614814:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2003:x1830962867601536:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9052us (9555us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142917.614824:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4640 00002000:00100000:3.0:1746142917.614833:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880088fd8e00 x1830962867601536/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.614841:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd8e00 with x1830962867601536 ext(4194304->5066751) 00002000:00010000:3.0:1746142917.614846:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd8e00 00000100:00100000:0.0:1746142917.630360:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.630446:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602048 00000100:00100000:2.0:1746142917.630453:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602048 00000100:00100000:2.0:1746142917.630487:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5338 00000100:00100000:2.0:1746142917.630493:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32699:x1830962867602048:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142917.630649:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32699:x1830962867602048:12345-192.168.204.50@tcp:35:cat.0 Request processed in 155us (294us total) trans 8589936750 rc 0/0 00000100:00100000:2.0:1746142917.630655:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5338 00000100:00100000:0.0:1746142917.651458:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.651590:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602176 00000100:00100000:1.0:1746142917.651599:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602176 00000100:00100000:1.0:1746142917.651662:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14805 00000100:00100000:1.0:1746142917.651672:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:32704:x1830962867602176:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.651691:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.651707:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b529 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.651737:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.651745:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 39 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.651751:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.651757:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.651758:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.651762:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 30 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.651793:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 30 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.651805:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 30 pid: 1854 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.651817:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902592:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.653277:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 39 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.653290:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 39 pid: 9578 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.653300:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902720:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.654288:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 13 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.654296:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 13 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.654303:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902848:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.656170:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.657996:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902592:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.658972:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.659257:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602304 00000100:00100000:1.0:1746142917.659263:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602304 00010000:00010000:1.0:1746142917.659291:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 31 pid: 1854 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.659313:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6721 00000100:00100000:1.0:1746142917.659319:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+31:2003:x1830962867602304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142917.659329:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142917.659345:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 31 pid: 1854 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.659354:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 31 pid: 1854 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.659377:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3b600/0x2fa243e067cce57c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c7 expref: 31 pid: 1854 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.659406:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142917.659437:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:2003:x1830962867602304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 117us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.659442:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6721 00000100:00100000:2.0:1746142917.660547:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902720:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.660554:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867902848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.660574:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 29 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.660583:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1800, rc 0) 00000100:00100000:2.0:1746142917.660602:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:32704:x1830962867602176:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8934us (9156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.660608:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14805 00000100:00100000:0.0:1746142917.662062:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.662174:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602432 00000100:00100000:2.0:1746142917.662182:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602432 00010000:00010000:2.0:1746142917.662209:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.662710:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6722 00000100:00100000:2.0:1746142917.662719:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867602432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142917.662730:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142917.662749:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.662764:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.662784:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb25000/0x2fa243e067cce4bf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b465 expref: 14 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.662826:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.662869:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867602432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.662875:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6722 00000100:00100000:0.0:1746142917.666283:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.666387:0:13297:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602560 00000100:00100000:1.0:1746142917.666396:0:13297:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602560 00010000:00010000:1.0:1746142917.666429:0:13297:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 40 pid: 9578 timeout: 791 lvb_type: 1 00000100:00100000:1.0:1746142917.669997:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6723 00000100:00100000:1.0:1746142917.670011:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2004:x1830962867602560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142917.670027:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142917.670048:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 40 pid: 9578 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.670061:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 40 pid: 9578 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.670079:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c3ae00/0x2fa243e067cce59f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4f1 expref: 40 pid: 9578 timeout: 791 lvb_type: 1 00010000:00010000:1.0:1746142917.670094:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.670096:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.670102:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.670109:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.670136:0:13297:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 28 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.670146:0:13297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867902976:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142917.670895:0:13297:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.672336:0:13297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:13297:1830962867902976:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142917.672351:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142917.672391:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:2004:x1830962867602560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2384us (6499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.672399:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6723 00000100:00100000:0.0:1746142917.674009:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.674347:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602816 00000100:00100000:3.0:1746142917.674353:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602816 00002000:00100000:3.0:1746142917.674385:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2912256->2916351) req@ffff880088fd9500 x1830962867602816/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.674393:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9500 with x1830962867602816 ext(2912256->2916351) 00002000:00010000:3.0:1746142917.674398:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fd9500 00000100:00100000:3.0:1746142917.675136:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4641 00000100:00100000:3.0:1746142917.675143:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867602816:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.675247:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2005:x1830962867602816:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 104us (1243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.675252:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4641 00002000:00100000:3.0:1746142917.675257:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2912256->2916351) req@ffff880088fd9500 x1830962867602816/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.675263:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9500 with x1830962867602816 ext(2912256->2916351) 00002000:00010000:3.0:1746142917.675265:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880088fd9500 00000100:00100000:0.0:1746142917.681364:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.681785:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867602944 00000100:00100000:2.0:1746142917.681795:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867602944 00000100:00100000:2.0:1746142917.682083:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14806 00000100:00100000:2.0:1746142917.682092:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:32704:x1830962867602944:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.682108:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.682125:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b530 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.682153:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.682161:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 44 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.682168:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.682175:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.682176:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.682180:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 21 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.682208:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.682221:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.682244:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867903104:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.682360:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 44 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.682371:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 44 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.682379:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867903232:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.682415:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.682425:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 12 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:2.0:1746142917.682438:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867903360:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.682464:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.686123:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867903104:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.686134:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867903232:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.686141:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9578:1830962867903360:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.686164:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->3477503] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 21 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.686178:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3400, rc 0) 00000100:00100000:2.0:1746142917.686224:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:32704:x1830962867602944:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4133us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.686238:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14806 00000100:00100000:0.0:1746142917.687800:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.689336:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.689449:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867603072 00000100:00100000:3.0:1746142917.689456:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867603072 00010000:00010000:3.0:1746142917.689486:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.689522:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867603200 00000100:00100000:3.0:1746142917.689525:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867603200 00010000:00010000:3.0:1746142917.689535:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 13 pid: 1397 timeout: 791 lvb_type: 1 00000100:00100000:3.0:1746142917.689556:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6724 00000100:00100000:3.0:1746142917.689563:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867603072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.689573:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142917.689576:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1746142917.689589:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.689599:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 791 lvb_type: 1 00010000:00010000:3.0:1746142917.689617:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a9a1a00/0x2fa243e067cce575 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4c0 expref: 21 pid: 1852 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.689617:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867603328 00000100:00100000:0.0:1746142917.689620:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867603328 00010000:00010000:0.0:1746142917.689649:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 45 pid: 9579 timeout: 791 lvb_type: 1 00000100:00100000:0.0:1746142917.689665:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6725 00000100:00100000:0.0:1746142917.689691:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867603200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142917.689719:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142917.689727:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 13 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.689749:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 13 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.689761:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25e00/0x2fa243e067cce4d4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b45e expref: 13 pid: 1397 timeout: 791 lvb_type: 1 00010000:00010000:0.0:1746142917.689790:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.689819:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6726 00000100:00100000:2.0:1746142917.689826:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867603328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142917.689830:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867603200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (518us total) trans 0 rc 0/0 00010000:00010000:2.0:1746142917.689832:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746142917.689835:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6725 00010000:00010000:2.0:1746142917.689839:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 45 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.689847:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 45 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.689859:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3e00/0x2fa243e067cce5a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ea expref: 45 pid: 9579 timeout: 791 lvb_type: 1 00010000:00010000:2.0:1746142917.689876:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.689879:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.689885:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 20 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.689892:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 20 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.689933:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 20 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.689943:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096141500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867903488:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142917.689982:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b99c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746142917.690055:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.690072:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867603072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 510us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.690077:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6724 00000100:00100000:2.0:1746142917.695332:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096141500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867903488:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142917.695350:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142917.695402:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2005:x1830962867603328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5576us (5824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.695411:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6726 00000100:00100000:0.0:1746142917.695976:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.696036:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867603584 00000100:00100000:3.0:1746142917.696042:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867603584 00002000:00100000:3.0:1746142917.696074:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3473408->3477503) req@ffff880088fd9880 x1830962867603584/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.696082:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9880 with x1830962867603584 ext(3473408->3477503) 00002000:00010000:3.0:1746142917.696086:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd9880 00000100:00100000:3.0:1746142917.696109:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4642 00000100:00100000:3.0:1746142917.696115:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867603584:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142917.697790:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2003:x1830962867603584:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 1667us (1810us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.697800:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4642 00002000:00100000:3.0:1746142917.697809:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3473408->3477503) req@ffff880088fd9880 x1830962867603584/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.697817:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088fd9880 with x1830962867603584 ext(3473408->3477503) 00002000:00010000:3.0:1746142917.697822:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088fd9880 00000100:00100000:0.0:1746142917.707531:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.707599:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867603840 00000100:00100000:1.0:1746142917.707607:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867603840 00000100:00100000:1.0:1746142917.707651:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5339 00000100:00100000:1.0:1746142917.707660:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:32704:x1830962867603840:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142917.707868:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+13:32704:x1830962867603840:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 208us (344us total) trans 8589936751 rc 0/0 00000100:00100000:1.0:1746142917.707875:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5339 00000100:00100000:2.0:1746142917.713677:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.715524:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867604096 00000100:00100000:1.0:1746142917.715534:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867604096 00000100:00100000:1.0:1746142917.716252:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14563 00000100:00100000:1.0:1746142917.716260:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:32710:x1830962867604096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.716275:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.716289:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce62b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b537 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.716345:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716355:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716364:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716373:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716379:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716384:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716450:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716457:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716461:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142917.716468:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142917.716514:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716519:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716524:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716529:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800971d0600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.716532:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716548:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716557:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.716559:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142917.716563:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716568:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0600/0x2fa243e067cce640 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716582:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716587:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716591:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716595:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800971d0200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.716597:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716605:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716610:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142917.716612:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.716614:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716618:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d0200/0x2fa243e067cce632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716623:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716627:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716631:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716635:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800971d1c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.716636:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716640:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716645:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4800) 00010000:00010000:1.0:1746142917.716647:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.716649:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716653:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce639 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.716680:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce62b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b537 expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.716687:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce62b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b537 expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.716693:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1600, rc 0) 00000100:00100000:1.0:1746142917.716731:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:32710:x1830962867604096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 472us (3061us total) trans 8589936752 rc 301/301 00000100:00100000:1.0:1746142917.716737:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14563 00000100:00100000:0.0:1746142917.729038:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.729154:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867604224 00000100:00100000:1.0:1746142917.729161:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867604224 00000100:00100000:1.0:1746142917.729212:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14564 00000100:00100000:1.0:1746142917.729220:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:32710:x1830962867604224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.729252:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.729276:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce64e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b53e expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.729380:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.729392:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.729400:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142917.729424:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:1.0:1746142917.729428:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142917.729441:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.729462:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1600/0x2fa243e067cce64e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 16 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.730291:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 15 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.730299:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.730301:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142917.730304:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1c00, rc 0) 00000100:00100000:1.0:1746142917.730768:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:32710:x1830962867604224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1548us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.730775:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14564 00000100:00100000:0.0:1746142917.733524:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.733738:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.733812:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867604352 00000100:00100000:2.0:1746142917.733819:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867604352 00000100:00100000:2.0:1746142917.733852:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867604480 00000100:00100000:2.0:1746142917.733854:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867604480 00000100:00100000:0.0:1746142917.734076:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14807 00000100:00100000:0.0:1746142917.734084:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867604352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.734097:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.734110:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067cce65c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b545 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.734125:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14808 00000100:00100000:1.0:1746142917.734130:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32706:x1830962867604480:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.734136:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.734142:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b54c expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.734151:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800949d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867903616:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.734154:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 30 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.734160:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.734161:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.734164:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.734182:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 30 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.734191:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 30 pid: 9578 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.734198:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867903744:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142917.734207:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.734213:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.735470:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867903744:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.735488:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.735498:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d0800, rc 0) 00000100:00100000:1.0:1746142917.735528:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32706:x1830962867604480:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1398us (1790us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.735535:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14808 00000100:00100000:2.0:1746142917.735654:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800949d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12211:1830962867903616:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142917.735669:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067cce65c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b545 expref: 30 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.735679:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067cce65c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b545 expref: 30 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.735702:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795e00, rc 0) 00000100:00100000:2.0:1746142917.735766:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088fd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:ad4f1515-ae46-4d91-8f96-492179af7039+29:2003:x1830962867604352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1672us (2243us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142917.735771:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14807 00000100:00100000:0.0:1746142917.736778:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.736854:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867604608 00000100:00100000:3.0:1746142917.736859:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867604608 00002000:00100000:3.0:1746142917.736886:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2912256->3145727) req@ffff8800949d0380 x1830962867604608/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.736895:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0380 with x1830962867604608 ext(2912256->3145727) 00010000:00010000:3.0:1746142917.736926:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 29 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.736941:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 29 pid: 9578 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.736947:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d0380 00000100:00100000:3.0:1746142917.736964:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1439 00000100:00100000:3.0:1746142917.736970:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+29:2006:x1830962867604608:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142917.740555:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867604608:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 3577us (3770us total) trans 17179874046 rc 0/0 00000100:00100000:0.0:1746142917.740565:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1439 00002000:00100000:0.0:1746142917.740574:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x7b:0x0] (2912256->3145727) req@ffff8800949d0380 x1830962867604608/t17179874046(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142917.740583:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0380 with x1830962867604608 ext(2912256->3145727) 00010000:00010000:0.0:1746142917.740592:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 31 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.740605:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 31 pid: 9578 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746142917.740612:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800949d0380 00000100:00100000:0.0:1746142917.744966:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.744996:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.745312:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605120 00000100:00100000:2.0:1746142917.745320:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605120 00002000:00100000:2.0:1746142917.745358:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800949d1880 x1830962867605120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.745367:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1880 with x1830962867605120 ext(1048576->2097151) 00002000:00010000:2.0:1746142917.745372:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d1880 00000100:00100000:0.0:1746142917.745372:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.745401:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605248 00000100:00100000:2.0:1746142917.745403:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605248 00010000:00010000:2.0:1746142917.745418:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 32 pid: 9578 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.745437:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6727 00000100:00100000:2.0:1746142917.745444:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:2004:x1830962867605248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142917.745455:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746142917.745468:0:8381:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142917 -> 1746142918 00002000:00010000:2.0:1746142917.745470:0:8381:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142917 -> 1746142918 00010000:00010000:2.0:1746142917.745475:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 32 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.745486:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 32 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.745518:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce61d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b529 expref: 32 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.745550:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.745552:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142917.745558:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 39 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.745564:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 39 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.745582:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867604992 00000100:00100000:3.0:1746142917.745604:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867604992 00010000:00010000:2.0:1746142917.745606:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 39 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142917.745632:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867903872:192.168.204.50@tcp:105: 00002000:00100000:3.0:1746142917.745638:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800949d0700 x1830962867604992/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.745664:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0700 with x1830962867604992 ext(0->1048575) 00002000:00010000:3.0:1746142917.745667:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0700 00000100:00100000:3.0:1746142917.745697:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4643 00000100:00100000:3.0:1746142917.745719:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867605120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.745741:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9480 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.745767:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4644 00000100:00100000:2.0:1746142917.745784:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867604992:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.750865:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867903872:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142917.750884:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.750987:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+32:2004:x1830962867605248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5533us (5603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.750996:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6727 00000100:00100000:0.0:1746142917.751355:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.752529:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605504 00000100:00100000:2.0:1746142917.752548:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605504 00002000:00100000:2.0:1746142917.752605:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2580480->2584575) req@ffff8800949d3100 x1830962867605504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.752640:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3100 with x1830962867605504 ext(2580480->2584575) 00002000:00010000:2.0:1746142917.752645:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d3100 00000100:00100000:2.0:1746142917.752666:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4645 00000100:00100000:2.0:1746142917.752674:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867605504:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142917.752802:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867605504:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 129us (1464us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142917.752807:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4645 00002000:00100000:2.0:1746142917.752811:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2580480->2584575) req@ffff8800949d3100 x1830962867605504/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.752818:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d3100 with x1830962867605504 ext(2580480->2584575) 00002000:00010000:2.0:1746142917.752821:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d3100 00000100:00100000:2.0:1746142917.762178:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ad4f1515-ae46-4d91-8f96-492179af7039+20:2005:x1830962867604992:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16374us (17151us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.762188:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4644 00002000:00100000:2.0:1746142917.762196:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff8800949d0700 x1830962867604992/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.762244:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d0700 with x1830962867604992 ext(0->1048575) 00002000:00010000:2.0:1746142917.762257:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800949d0700 00000100:00100000:3.0:1746142917.765845:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+30:2006:x1830962867605120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20098us (20859us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142917.765871:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4643 00002000:00100000:3.0:1746142917.765881:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800949d1880 x1830962867605120/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.765890:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800949d1880 with x1830962867605120 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.765895:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800949d1880 00000100:00100000:0.0:1746142917.780523:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.781056:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605632 00000100:00100000:2.0:1746142917.781065:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605632 00000100:00100000:2.0:1746142917.781118:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14809 00000100:00100000:2.0:1746142917.781126:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32706:x1830962867605632:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.781143:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.781157:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b553 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.781182:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.781189:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142917.781191:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142917.781194:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->3284991] (req 3145728->3284991) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 45 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.781218:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 19 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.781229:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 19 pid: 9578 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.781253:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867904000:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.781324:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.790019:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.790227:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.790290:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605888 00000100:00100000:3.0:1746142917.790297:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605888 00002000:00100000:3.0:1746142917.790334:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3477503) req@ffff880130120000 x1830962867605888/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.790349:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120000 with x1830962867605888 ext(3145728->3477503) 00010000:00010000:3.0:1746142917.790357:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 20 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.790369:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 20 pid: 9578 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.790375:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130120000 00000100:00100000:3.0:1746142917.790393:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1440 00000100:00100000:3.0:1746142917.790399:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+20:2006:x1830962867605888:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142917.790468:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867605760 00000100:00100000:1.0:1746142917.790472:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867605760 00000100:00100000:1.0:1746142917.790497:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14810 00000100:00100000:1.0:1746142917.790502:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+30:32710:x1830962867605760:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.790511:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.790522:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b55a expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.790553:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.790560:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.790562:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.790565:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 31 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.790588:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 39 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.790596:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 39 pid: 1853 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.790606:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867904128:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.790652:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc189c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.790724:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867904000:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142917.790741:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->3284991] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 45 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.790750:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2400, rc 0) 00000100:00100000:2.0:1746142917.790770:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:32706:x1830962867605632:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 9645us (10254us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.790776:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14809 00000100:00100000:1.0:1746142917.796071:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867904128:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142917.796091:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867605888:12345-192.168.204.50@tcp:4:cat.0 Request processed in 5690us (5862us total) trans 21474841299 rc 0/0 00010000:00010000:1.0:1746142917.796097:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 31 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.796100:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1440 00002000:00100000:3.0:1746142917.796109:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3477503) req@ffff880130120000 x1830962867605888/t21474841299(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746142917.796112:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0000, rc 0) 00002000:00100000:3.0:1746142917.796117:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120000 with x1830962867605888 ext(3145728->3477503) 00010000:00010000:3.0:1746142917.796125:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 22 pid: 9578 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.796131:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+31:32710:x1830962867605760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5629us (6120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.796137:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14810 00010000:00010000:3.0:1746142917.796139:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 22 pid: 9578 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.796144:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130120000 00000100:00100000:0.0:1746142917.797105:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.797197:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606016 00000100:00100000:3.0:1746142917.797206:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606016 00002000:00100000:3.0:1746142917.797240:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1929216->2084863) req@ffff880130123480 x1830962867606016/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.797248:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123480 with x1830962867606016 ext(1929216->2084863) 00010000:00010000:3.0:1746142917.797253:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 40 pid: 1853 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.797261:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 40 pid: 1853 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.797265:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130123480 00000100:00100000:3.0:1746142917.797280:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1441 00000100:00100000:3.0:1746142917.797286:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2005:x1830962867606016:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142917.798671:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.798976:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606144 00000100:00100000:3.0:1746142917.798982:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606144 00010000:00010000:3.0:1746142917.799005:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 22 pid: 9578 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.799025:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6728 00000100:00100000:3.0:1746142917.799031:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867606144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.799041:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142917.799054:0:8381:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142917 -> 1746142918 00002000:00010000:3.0:1746142917.799057:0:8381:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142917 -> 1746142918 00010000:00010000:3.0:1746142917.799062:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 22 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.799071:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 22 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.799089:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce624 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3477503) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b530 expref: 22 pid: 9578 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.799117:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.799119:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.799125:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.799132:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.799158:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.799168:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867904256:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142917.799239:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9900 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.809511:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867606016:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 12215us (12399us total) trans 17179874047 rc 0/0 00000100:00100000:3.0:1746142917.809525:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1441 00002000:00100000:3.0:1746142917.809535:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1929216->2084863) req@ffff880130123480 x1830962867606016/t17179874047(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.809543:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130123480 with x1830962867606016 ext(1929216->2084863) 00010000:00010000:3.0:1746142917.809552:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 42 pid: 1853 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.809565:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 42 pid: 1853 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.809571:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880130123480 00000100:00100000:0.0:1746142917.809817:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.809895:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606400 00000100:00100000:3.0:1746142917.809922:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606400 00002000:00100000:3.0:1746142917.809950:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3280896->3284991) req@ffff880130120700 x1830962867606400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.809959:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120700 with x1830962867606400 ext(3280896->3284991) 00002000:00010000:3.0:1746142917.809962:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120700 00000100:00100000:3.0:1746142917.809974:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4646 00000100:00100000:3.0:1746142917.809980:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867606400:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142917.810350:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867904256:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142917.810365:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.810834:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2005:x1830962867606400:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 852us (1017us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.810841:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4646 00002000:00100000:3.0:1746142917.810847:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x9b:0x0] (3280896->3284991) req@ffff880130120700 x1830962867606400/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.810859:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120700 with x1830962867606400 ext(3280896->3284991) 00002000:00010000:3.0:1746142917.810861:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130120700 00000100:00100000:2.0:1746142917.811409:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867606144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12377us (12741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142917.811417:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6728 00000100:00100000:0.0:1746142917.815381:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.815465:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606656 00000100:00100000:3.0:1746142917.815472:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606656 00000100:00100000:3.0:1746142917.815521:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5340 00000100:00100000:3.0:1746142917.815529:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:32706:x1830962867606656:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142917.815701:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32706:x1830962867606656:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 172us (326us total) trans 8589936753 rc 0/0 00000100:00100000:3.0:1746142917.815707:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5340 00000100:00100000:2.0:1746142917.825964:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.826055:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867606784 00000100:00100000:3.0:1746142917.826063:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867606784 00010000:00010000:3.0:1746142917.826092:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 42 pid: 1853 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.826130:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6729 00000100:00100000:3.0:1746142917.826137:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867606784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.826150:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.826168:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 42 pid: 1853 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.826178:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 42 pid: 1853 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.826197:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b0800/0x2fa243e067cce544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1929216->2084863) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ab expref: 42 pid: 1853 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.826226:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.826238:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.826244:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 30 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.826253:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 30 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.826281:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 30 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.826291:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867904384:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142917.826358:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.835670:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867904384:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142917.835690:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.836456:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867606784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10315us (10494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.836465:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6729 00000100:00100000:0.0:1746142917.838679:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.839133:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607040 00000100:00100000:3.0:1746142917.839140:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607040 00002000:00100000:3.0:1746142917.839172:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130120380 x1830962867607040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.839181:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120380 with x1830962867607040 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.839186:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130120380 00000100:00100000:3.0:1746142917.839208:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4647 00000100:00100000:3.0:1746142917.839214:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867607040:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.848720:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+31:2005:x1830962867607040:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9499us (10041us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142917.848729:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4647 00002000:00100000:3.0:1746142917.848738:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880130120380 x1830962867607040/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.848746:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130120380 with x1830962867607040 ext(1048576->2097151) 00002000:00010000:3.0:1746142917.848751:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130120380 00000100:00100000:0.0:1746142917.851177:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.855221:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607296 00000100:00100000:1.0:1746142917.855244:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607296 00000100:00100000:1.0:1746142917.855312:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14565 00000100:00100000:1.0:1746142917.855319:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+15:32715:x1830962867607296:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142917.855335:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.855350:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0400/0x2fa243e067cce678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b561 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.855412:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855420:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855428:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855437:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855442:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855447:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855517:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855525:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855530:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142917.855540:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142917.855592:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855597:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855602:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855607:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.855610:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855615:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855624:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142917.855626:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746142917.855629:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855634:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1a00/0x2fa243e067cce68d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855664:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855668:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855672:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855678:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f1400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.855680:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855684:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855690:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142917.855691:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.855693:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855697:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f1400/0x2fa243e067cce67f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855704:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855708:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855712:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855715:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968f0e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142917.855717:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855721:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855726:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4300) 00010000:00010000:1.0:1746142917.855727:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142917.855729:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855733:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0e00/0x2fa243e067cce686 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142917.855759:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0400/0x2fa243e067cce678 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b561 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.855766:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968f0400/0x2fa243e067cce678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b561 expref: 17 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.855772:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0400, rc 0) 00000100:00100000:1.0:1746142917.855816:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+16:32715:x1830962867607296:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 497us (4646us total) trans 8589936754 rc 301/301 00000100:00100000:1.0:1746142917.855821:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14565 00000100:00100000:0.0:1746142917.856715:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.856753:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.856839:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607424 00000100:00100000:1.0:1746142917.856843:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607424 00000100:00100000:1.0:1746142917.856864:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607552 00000100:00100000:1.0:1746142917.856865:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607552 00000100:00100000:1.0:1746142917.856878:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14811 00000100:00100000:1.0:1746142917.856883:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867607424:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.856892:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142917.856953:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14812 00000100:00100000:0.0:1746142917.856959:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867607552:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142917.856966:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142917.856976:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067cce69b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b56f expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142917.857012:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dbf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867904512:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142917.857109:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801324333c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746142917.857197:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6a2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b568 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.857222:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867904640:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142917.857255:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00002000:00010000:2.0:1746142917.859644:0:1852:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142916 -> 1746142918 00000100:00100000:2.0:1746142917.859662:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dbf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867904512:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142917.859683:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067cce69b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b56f expref: 32 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.859693:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3921200/0x2fa243e067cce69b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b56f expref: 32 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142917.859704:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3921200, rc 0) 00000100:00100000:2.0:1746142917.859731:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+31:2006:x1830962867607552:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2773us (2978us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142917.859738:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14812 00002000:00010000:1.0:1746142917.860163:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142917 -> 1746142918 00000100:00100000:1.0:1746142917.860175:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867904640:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.860189:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6a2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b568 expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.860198:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6a2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b568 expref: 22 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.862570:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d0200, rc 0) 00000100:00100000:1.0:1746142917.862631:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+21:2006:x1830962867607424:12345-192.168.204.50@tcp:101:cat.0 Request processed in 5744us (5914us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.862638:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14811 00000100:00100000:0.0:1746142917.864562:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.865950:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607680 00000100:00100000:1.0:1746142917.865958:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607680 00000100:00100000:2.0:1746142917.867382:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14813 00000100:00100000:2.0:1746142917.867393:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+31:32715:x1830962867607680:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142917.867408:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.867422:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b576 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.867451:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.867457:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142917.867459:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142917.867462:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3600384->3743743] (req 3600384->3743743) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 32 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.867488:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 40 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.867498:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 40 pid: 1397 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142917.867508:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867904768:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142917.867581:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.869946:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:1852:1830962867904768:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142917.869969:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3600384->3743743] (req 3600384->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 32 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142917.869982:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c2c00, rc 0) 00000100:00100000:0.0:1746142917.870607:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:32715:x1830962867607680:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3214us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142917.870617:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14813 00000100:00100000:0.0:1746142917.871782:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.871871:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607936 00000100:00100000:1.0:1746142917.871877:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607936 00000100:00100000:1.0:1746142917.871922:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14814 00000100:00100000:1.0:1746142917.871928:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+21:32710:x1830962867607936:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.871941:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.871953:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b57d expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.871973:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.871979:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.871982:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.871985:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.872008:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 44 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.872017:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 44 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.872094:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867904896:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.872298:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.874944:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.875011:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867607808 00000100:00100000:3.0:1746142917.875018:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867607808 00002000:00100000:3.0:1746142917.875054:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2580480->3145727) req@ffff88012dbf5500 x1830962867607808/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.875064:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5500 with x1830962867607808 ext(2580480->3145727) 00010000:00010000:3.0:1746142917.875071:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 41 pid: 1397 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.875091:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 41 pid: 1397 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.875097:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbf5500 00000100:00100000:3.0:1746142917.875115:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1442 00000100:00100000:3.0:1746142917.875121:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2003:x1830962867607808:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142917.876161:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867904896:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.876181:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 22 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.876193:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d0600, rc 0) 00000100:00100000:1.0:1746142917.876432:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:32710:x1830962867607936:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4502us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.876439:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14814 00000100:00100000:0.0:1746142917.876826:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.876925:0:9583:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608064 00000100:00100000:2.0:1746142917.876931:0:9583:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608064 00002000:00100000:2.0:1746142917.876957:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3284991) req@ffff88012dbf4700 x1830962867608064/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.876966:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4700 with x1830962867608064 ext(3145728->3284991) 00010000:00010000:2.0:1746142917.876972:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 45 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.876982:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 45 pid: 12211 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746142917.876988:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf4700 00000100:00100000:2.0:1746142917.877001:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1443 00000100:00100000:2.0:1746142917.877007:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+45:2006:x1830962867608064:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142917.886890:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867608064:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 9874us (10055us total) trans 21474841300 rc 0/0 00000100:00100000:0.0:1746142917.886922:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1443 00002000:00100000:0.0:1746142917.886932:0:9583:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3284991) req@ffff88012dbf4700 x1830962867608064/t21474841300(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142917.886940:0:9583:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf4700 with x1830962867608064 ext(3145728->3284991) 00010000:00010000:0.0:1746142917.886949:0:9583:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 47 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:0.0:1746142917.886960:0:9583:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 47 pid: 12211 timeout: 791 lvb_type: 0 00002000:00010000:0.0:1746142917.886966:0:9583:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dbf4700 00000100:00100000:3.0:1746142917.887238:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867607808:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 12108us (12292us total) trans 17179874048 rc 0/0 00000100:00100000:3.0:1746142917.887248:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1442 00002000:00100000:3.0:1746142917.887253:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2580480->3145727) req@ffff88012dbf5500 x1830962867607808/t17179874048(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.887260:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf5500 with x1830962867607808 ext(2580480->3145727) 00010000:00010000:3.0:1746142917.887265:0:13318:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 43 pid: 1397 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.887273:0:13318:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 43 pid: 1397 timeout: 791 lvb_type: 0 00002000:00010000:3.0:1746142917.887277:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dbf5500 00000100:00100000:0.0:1746142917.888467:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.889116:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608320 00000100:00100000:2.0:1746142917.889124:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608320 00000100:00100000:0.0:1746142917.889393:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.889450:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14566 00000100:00100000:2.0:1746142917.889459:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:32718:x1830962867608320:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142917.889476:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142917.889490:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce6b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b584 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.889549:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.889560:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.889568:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000100:00100000:0.0:1746142917.889857:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142917.890071:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890078:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890083:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890172:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890179:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890185:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:2.0:1746142917.890192:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142917.890257:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890262:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890267:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890271:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3000 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142917.890273:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890279:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890287:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142917.890290:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142917.890292:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890296:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3000/0x2fa243e067cce6cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890314:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890318:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890322:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890326:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890330:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c3800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142917.890332:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890336:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890342:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142917.890343:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142917.890345:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890349:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3800/0x2fa243e067cce6be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890354:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890358:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890362:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890366:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0c2a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142917.890368:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890372:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890377:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff8800b404b500) 00010000:00010000:2.0:1746142917.890379:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142917.890381:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890385:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c2a00/0x2fa243e067cce6c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:2.0:1746142917.890412:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce6b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b584 expref: 35 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.890418:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0c3400/0x2fa243e067cce6b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b584 expref: 35 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142917.890424:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0c3400, rc 0) 00000100:00100000:2.0:1746142917.890462:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32718:x1830962867608320:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1005us (1998us total) trans 8589936755 rc 301/301 00000100:00100000:2.0:1746142917.890468:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14566 00000100:00100000:3.0:1746142917.890676:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608448 00000100:00100000:3.0:1746142917.890682:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608448 00010000:00010000:3.0:1746142917.890699:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 47 pid: 12211 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.890714:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608576 00000100:00100000:3.0:1746142917.890716:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608576 00010000:00010000:3.0:1746142917.890724:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 43 pid: 1397 timeout: 791 lvb_type: 0 00000100:00100000:3.0:1746142917.890735:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6730 00000100:00100000:3.0:1746142917.890740:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867608448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.890747:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.890761:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 47 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.890769:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 47 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.890781:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0c2400/0x2fa243e067cce66a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b553 expref: 47 pid: 12211 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.890794:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.890796:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.890801:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.890807:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.890829:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.890838:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867905024:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142917.890876:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142917.890922:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6731 00000100:00100000:3.0:1746142917.890927:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867608576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142917.890933:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142917.890942:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 43 pid: 1397 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.890952:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 43 pid: 1397 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.890962:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d0800/0x2fa243e067cce663 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b54c expref: 43 pid: 1397 timeout: 791 lvb_type: 0 00010000:00010000:3.0:1746142917.890969:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.890970:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142917.890974:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.890979:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142917.890993:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142917.890999:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867905152:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142917.891015:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142917.893337:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.893431:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867905152:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142917.893443:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.893471:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2004:x1830962867608576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2543us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.893479:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6731 00000100:00100000:3.0:1746142917.893508:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867905024:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142917.893515:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142917.893526:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2005:x1830962867608448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2786us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142917.893530:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6730 00000100:00100000:0.0:1746142917.894048:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.894722:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.895437:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608832 00000100:00100000:1.0:1746142917.895444:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608832 00000100:00100000:1.0:1746142917.895473:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608704 00000100:00100000:1.0:1746142917.895475:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608704 00000100:00100000:1.0:1746142917.895484:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867608960 00000100:00100000:1.0:1746142917.895486:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867608960 00000100:00100000:1.0:1746142917.895502:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14815 00000100:00100000:1.0:1746142917.895508:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2006:x1830962867608832:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.895522:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.895535:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b592 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.895554:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.895555:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.895562:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 47 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.895574:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 47 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.895582:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d0200, rc 0) 00000100:00100000:1.0:1746142917.895612:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867608832:12345-192.168.204.50@tcp:101:cat.0 Request processed in 105us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.895618:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14815 00000100:00100000:1.0:1746142917.895630:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14816 00000100:00100000:1.0:1746142917.895635:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867608704:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.895641:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.895649:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b58b expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.895659:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.895660:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142917.895664:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.895673:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.895683:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1600, rc 0) 00000100:00100000:1.0:1746142917.895697:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867608704:12345-192.168.204.50@tcp:101:cat.0 Request processed in 62us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.895702:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14816 00000100:00100000:1.0:1746142917.895711:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14817 00000100:00100000:1.0:1746142917.895715:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867608960:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.895720:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.895726:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce6e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b599 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.895757:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867905280:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142917.895799:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142917.898483:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867905280:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142917.898508:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce6e8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b599 expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.898519:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1800/0x2fa243e067cce6e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b599 expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142917.898567:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d1800, rc 0) 00000100:00100000:1.0:1746142917.898608:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867608960:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2892us (3886us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142917.898615:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14817 00000100:00100000:0.0:1746142917.903956:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.905426:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867609216 00000100:00100000:3.0:1746142917.905434:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867609216 00002000:00100000:3.0:1746142917.905472:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (3600384->3604479) req@ffff8800968e8380 x1830962867609216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.905481:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8380 with x1830962867609216 ext(3600384->3604479) 00002000:00010000:3.0:1746142917.905485:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8380 00000100:00100000:3.0:1746142917.905514:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4648 00000100:00100000:3.0:1746142917.905521:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867609216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.905639:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867609216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 118us (1690us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142917.905644:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4648 00002000:00100000:3.0:1746142917.905650:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (3600384->3604479) req@ffff8800968e8380 x1830962867609216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/4536 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.905656:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8380 with x1830962867609216 ext(3600384->3604479) 00002000:00010000:3.0:1746142917.905658:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8380 00000100:00100000:0.0:1746142917.911100:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.911136:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.911174:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142917.911175:0:13318:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867609728 00000100:00100000:3.0:1746142917.911182:0:13318:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867609728 00000100:00100000:0.0:1746142917.911190:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867609856 00000100:00100000:0.0:1746142917.911192:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867609856 00002000:00100000:3.0:1746142917.911215:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800968ead80 x1830962867609728/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 504/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142917.911215:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800968ebb80 x1830962867609856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.911224:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ead80 with x1830962867609728 ext(2097152->4194303) 00002000:00100000:0.0:1746142917.911224:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ebb80 with x1830962867609856 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.911238:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968ead80 00002000:00010000:0.0:1746142917.911238:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ebb80 00000100:00100000:0.0:1746142917.911264:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867609984 00000100:00100000:0.0:1746142917.911266:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867609984 00000100:00100000:3.0:1746142917.911274:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4649 00002000:00100000:0.0:1746142917.911276:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800968e8a80 x1830962867609984/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142917.911280:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867609856:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:0.0:1746142917.911283:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8a80 with x1830962867609984 ext(1048576->2097151) 00002000:00010000:0.0:1746142917.911285:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8a80 00000100:00100000:0.0:1746142917.911295:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4650 00000100:00100000:0.0:1746142917.911298:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867609728:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142917.911840:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4651 00000100:00100000:2.0:1746142917.911846:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867609984:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142917.932302:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867609856:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21012us (21155us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142917.932314:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4649 00002000:00100000:3.0:1746142917.932325:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff8800968ebb80 x1830962867609856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142917.932333:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ebb80 with x1830962867609856 ext(2097152->4194303) 00002000:00010000:3.0:1746142917.932338:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968ebb80 00000100:00100000:2.0:1746142917.935799:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2003:x1830962867609984:12345-192.168.204.50@tcp:3:cat.0 Request processed in 23919us (24589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.935811:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4651 00002000:00100000:2.0:1746142917.935842:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800968e8a80 x1830962867609984/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.935851:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e8a80 with x1830962867609984 ext(1048576->2097151) 00002000:00010000:2.0:1746142917.935856:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968e8a80 00000100:00100000:2.0:1746142917.949507:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+32:2005:x1830962867609728:12345-192.168.204.50@tcp:3:cat.0 Request processed in 38199us (38407us total) trans 0 rc 2093056/2093056 00000100:00100000:2.0:1746142917.949517:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4650 00002000:00100000:2.0:1746142917.949526:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800968ead80 x1830962867609728/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 504/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.949535:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968ead80 with x1830962867609728 ext(2097152->4194303) 00002000:00010000:2.0:1746142917.949539:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968ead80 00000100:00100000:0.0:1746142917.954348:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142917.954428:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867610240 00000100:00100000:2.0:1746142917.954436:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867610240 00002000:00100000:2.0:1746142917.954474:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800968eb800 x1830962867610240/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.954482:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb800 with x1830962867610240 ext(2097152->3145727) 00002000:00010000:2.0:1746142917.954487:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968eb800 00000100:00100000:2.0:1746142917.954502:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4652 00000100:00100000:2.0:1746142917.954508:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2003:x1830962867610240:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142917.967787:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.967896:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867610496 00000100:00100000:1.0:1746142917.967919:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867610496 00000100:00100000:1.0:1746142917.967968:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5341 00000100:00100000:1.0:1746142917.967976:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+16:32715:x1830962867610496:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142917.968269:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2003:x1830962867610240:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13759us (13927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142917.968276:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4652 00002000:00100000:2.0:1746142917.968285:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff8800968eb800 x1830962867610240/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.968293:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb800 with x1830962867610240 ext(2097152->3145727) 00002000:00010000:2.0:1746142917.968297:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968eb800 00000100:00100000:1.0:1746142917.968474:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+17:32715:x1830962867610496:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 499us (695us total) trans 8589936756 rc 0/0 00000100:00100000:1.0:1746142917.968480:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5341 00000100:00100000:0.0:1746142917.975535:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142917.975766:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.975861:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867610624 00000100:00100000:1.0:1746142917.975869:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867610624 00000100:00100000:1.0:1746142917.975927:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14818 00000100:00100000:1.0:1746142917.975934:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:32718:x1830962867610624:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.975948:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.975962:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5a0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.975983:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.975989:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.975991:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142917.975993:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.976015:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 31 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.976025:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 31 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:1.0:1746142917.976035:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867905408:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142917.976102:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142917.977678:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867610880 00000100:00100000:2.0:1746142917.977683:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867610880 00002000:00100000:2.0:1746142917.977714:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800968e9880 x1830962867610880/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.977721:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9880 with x1830962867610880 ext(4194304->5066751) 00002000:00010000:2.0:1746142917.977726:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968e9880 00000100:00100000:2.0:1746142917.977748:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4653 00000100:00100000:2.0:1746142917.977753:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867610880:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142917.986798:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.987180:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867905408:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142917.987204:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 44 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142917.987219:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d9800, rc 0) 00000100:00100000:1.0:1746142917.987275:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:32718:x1830962867610624:12345-192.168.204.50@tcp:101:cat.0 Request processed in 11341us (11746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142917.987282:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14818 00000100:00100000:2.0:1746142917.987467:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867611008 00000100:00100000:2.0:1746142917.987473:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867611008 00002000:00100000:2.0:1746142917.987501:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3600384->3743743) req@ffff8800968eaa00 x1830962867611008/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/0 e 0 to 0 dl 1746142928 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.987509:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eaa00 with x1830962867611008 ext(3600384->3743743) 00010000:00010000:2.0:1746142917.987516:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 32 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.987527:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 32 pid: 1852 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746142917.987532:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968eaa00 00000100:00100000:2.0:1746142917.987556:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1444 00000100:00100000:2.0:1746142917.987563:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+32:2006:x1830962867611008:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1746142917.989717:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867610880:12345-192.168.204.50@tcp:3:cat.0 Request processed in 11958us (13945us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142917.989726:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4653 00002000:00100000:2.0:1746142917.989733:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff8800968e9880 x1830962867610880/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/440 e 0 to 0 dl 1746142928 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.989741:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968e9880 with x1830962867610880 ext(4194304->5066751) 00002000:00010000:2.0:1746142917.989745:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800968e9880 00000100:00100000:2.0:1746142917.994827:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+34:2006:x1830962867611008:12345-192.168.204.50@tcp:4:cat.0 Request processed in 7257us (8033us total) trans 17179874049 rc 0/0 00000100:00100000:2.0:1746142917.994837:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1444 00002000:00100000:2.0:1746142917.994847:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3600384->3743743) req@ffff8800968eaa00 x1830962867611008/t17179874049(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:68/0 lens 488/448 e 0 to 0 dl 1746142928 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142917.994856:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eaa00 with x1830962867611008 ext(3600384->3743743) 00010000:00010000:2.0:1746142917.994864:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 34 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142917.994876:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 34 pid: 1852 timeout: 791 lvb_type: 0 00002000:00010000:2.0:1746142917.994883:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800968eaa00 00000100:00100000:3.0:1746142917.997879:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142917.998163:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867611136 00000100:00100000:1.0:1746142917.998171:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867611136 00000100:00100000:1.0:1746142917.998217:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14819 00000100:00100000:1.0:1746142917.998224:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867611136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142917.998249:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142917.998263:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8e00/0x2fa243e067cce6f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5a7 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142917.998303:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867905536:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142917.998372:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.002284:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867905536:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142918.002312:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8e00/0x2fa243e067cce6f6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a7 expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.002328:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8e00/0x2fa243e067cce6f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a7 expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.002506:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8e00, rc 0) 00000100:00100000:1.0:1746142918.002561:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867611136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4336us (4687us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142918.002568:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14819 00000100:00100000:0.0:1746142918.002950:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.003062:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867611264 00000100:00100000:2.0:1746142918.003068:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867611264 00010000:00010000:2.0:1746142918.003090:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 34 pid: 1852 timeout: 791 lvb_type: 0 00000100:00100000:2.0:1746142918.003131:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6732 00000100:00100000:2.0:1746142918.003137:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867611264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142918.003148:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142918.003185:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 34 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142918.003194:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 34 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142918.003210:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0c2c00/0x2fa243e067cce6a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->3743743) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b576 expref: 34 pid: 1852 timeout: 791 lvb_type: 0 00010000:00010000:2.0:1746142918.003239:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142918.003241:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142918.003247:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.003254:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.003286:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142918.003296:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867905664:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142918.003366:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746142918.005550:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867905664:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142918.005565:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142918.005590:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+33:2005:x1830962867611264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2453us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.005597:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6732 00000100:00100000:0.0:1746142918.007302:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.007632:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867611392 00000100:00100000:1.0:1746142918.007639:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867611392 00000100:00100000:1.0:1746142918.007680:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14820 00000100:00100000:1.0:1746142918.007687:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+33:2004:x1830962867611392:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.007702:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.007716:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5ae expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.007736:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.007738:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.007745:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 34 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.007759:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 34 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.007768:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c4d8800, rc 0) 00000100:00100000:1.0:1746142918.007797:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867611392:12345-192.168.204.50@tcp:101:cat.0 Request processed in 111us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.007806:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14820 00000100:00100000:0.0:1746142918.016360:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.016448:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867611648 00000100:00100000:3.0:1746142918.016455:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867611648 00000100:00100000:3.0:1746142918.016502:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5342 00000100:00100000:3.0:1746142918.016510:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+17:32710:x1830962867611648:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142918.016663:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32710:x1830962867611648:12345-192.168.204.50@tcp:35:cat.0 Request processed in 154us (310us total) trans 8589936757 rc 0/0 00000100:00100000:3.0:1746142918.016669:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5342 00000100:00100000:0.0:1746142918.017823:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.017858:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.017922:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867612032 00000100:00100000:3.0:1746142918.017927:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867612032 00002000:00100000:3.0:1746142918.017951:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800968eb480 x1830962867612032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.017959:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb480 with x1830962867612032 ext(2097152->4194303) 00002000:00010000:3.0:1746142918.017964:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eb480 00000100:00100000:3.0:1746142918.017974:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867612160 00000100:00100000:3.0:1746142918.017975:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867612160 00002000:00100000:3.0:1746142918.017984:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880091c04380 x1830962867612160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.017990:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04380 with x1830962867612160 ext(3145728->4194303) 00002000:00010000:3.0:1746142918.017992:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c04380 00000100:00100000:3.0:1746142918.018000:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4654 00000100:00100000:3.0:1746142918.018005:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867612032:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142918.018557:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4655 00000100:00100000:2.0:1746142918.018565:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867612160:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142918.032251:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867612160:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13679us (14384us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142918.032260:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4655 00002000:00100000:2.0:1746142918.032270:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880091c04380 x1830962867612160/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.032279:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04380 with x1830962867612160 ext(3145728->4194303) 00002000:00010000:2.0:1746142918.032284:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c04380 00000100:00100000:3.0:1746142918.045746:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800968eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2006:x1830962867612032:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27322us (27506us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142918.045758:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4654 00002000:00100000:3.0:1746142918.045768:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff8800968eb480 x1830962867612032/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.045776:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800968eb480 with x1830962867612032 ext(2097152->4194303) 00002000:00010000:3.0:1746142918.045781:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800968eb480 00000100:00100000:0.0:1746142918.065828:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.066094:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867612416 00000100:00100000:3.0:1746142918.066102:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867612416 00002000:00100000:3.0:1746142918.066136:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880091c05c00 x1830962867612416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.066145:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05c00 with x1830962867612416 ext(4194304->5066751) 00002000:00010000:3.0:1746142918.066150:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c05c00 00000100:00100000:3.0:1746142918.066176:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4656 00000100:00100000:3.0:1746142918.066182:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867612416:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142918.066785:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.068365:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867612672 00000100:00100000:3.0:1746142918.068374:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867612672 00000100:00100000:3.0:1746142918.068517:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14567 00000100:00100000:3.0:1746142918.068525:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:32723:x1830962867612672:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142918.068543:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.068556:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cce704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5b5 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.068646:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068657:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068688:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068700:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068705:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068709:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068786:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068794:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068799:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142918.068806:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142918.068859:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068865:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068870:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068875:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c6200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.068878:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068883:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068892:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142918.068894:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142918.068919:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.068924:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6200/0x2fa243e067cce719 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070955:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070966:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070971:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070976:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070980:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c6800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.070983:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070988:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.070999:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142918.071002:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.071004:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071008:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6800/0x2fa243e067cce70b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071018:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071022:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071027:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071030:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c7800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.071032:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071037:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071042:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3c00) 00010000:00010000:3.0:1746142918.071044:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.071045:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071053:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7800/0x2fa243e067cce712 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.071089:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cce704 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5b5 expref: 36 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.071096:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7a00/0x2fa243e067cce704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5b5 expref: 36 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.071108:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7a00, rc 0) 00000100:00100000:3.0:1746142918.071164:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32723:x1830962867612672:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2639us (4379us total) trans 8589936758 rc 301/301 00000100:00100000:3.0:1746142918.071172:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14567 00000100:00100000:3.0:1746142918.072763:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867612416:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6576us (6937us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142918.072772:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4656 00002000:00100000:3.0:1746142918.072779:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880091c05c00 x1830962867612416/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.072787:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c05c00 with x1830962867612416 ext(4194304->5066751) 00002000:00010000:3.0:1746142918.072792:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c05c00 00000100:00100000:0.0:1746142918.081761:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.082716:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867612928 00000100:00100000:1.0:1746142918.082725:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867612928 00000100:00100000:1.0:1746142918.082775:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5343 00000100:00100000:1.0:1746142918.082782:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:32718:x1830962867612928:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142918.082981:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f39450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32718:x1830962867612928:12345-192.168.204.50@tcp:35:cat.0 Request processed in 198us (1226us total) trans 8589936759 rc 0/0 00000100:00100000:1.0:1746142918.082987:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5343 00010000:00010000:3.0:1746142918.126086:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142918.151754:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.151895:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867613184 00000100:00100000:3.0:1746142918.151973:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867613184 00000100:00100000:3.0:1746142918.152051:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14568 00000100:00100000:3.0:1746142918.152058:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+18:32727:x1830962867613184:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142918.152090:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.152115:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cce727 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5bc expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.152252:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152263:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152281:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152292:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152296:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152312:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152453:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152468:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152474:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142918.152482:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142918.152550:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152572:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152577:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152593:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c6600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.152596:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152614:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152625:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142918.152628:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142918.152642:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152646:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c6600/0x2fa243e067cce73c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152674:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152678:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152681:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152685:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152705:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c7600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.152708:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152728:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152738:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142918.152740:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.152742:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152747:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7600/0x2fa243e067cce72e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152763:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152787:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152792:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152795:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c7400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.152797:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152802:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152807:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3c00) 00010000:00010000:3.0:1746142918.152817:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.152819:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152823:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce735 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.152878:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cce727 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5bc expref: 20 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.152886:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c7000/0x2fa243e067cce727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5bc expref: 20 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.152893:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7000, rc 0) 00000100:00100000:3.0:1746142918.153016:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32727:x1830962867613184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 958us (1267us total) trans 8589936760 rc 301/301 00000100:00100000:3.0:1746142918.153038:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14568 00000100:00100000:0.0:1746142918.203107:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.203516:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867613440 00000100:00100000:3.0:1746142918.203525:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867613440 00002000:00100000:3.0:1746142918.203563:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880091c04a80 x1830962867613440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.203573:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04a80 with x1830962867613440 ext(2097152->4194303) 00002000:00010000:3.0:1746142918.203577:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c04a80 00000100:00100000:3.0:1746142918.203609:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4657 00000100:00100000:3.0:1746142918.203616:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867613440:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142918.215957:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.221332:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867613568 00000100:00100000:3.0:1746142918.221344:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867613568 00000100:00100000:3.0:1746142918.222586:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14821 00000100:00100000:3.0:1746142918.222596:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:32723:x1830962867613568:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142918.222610:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.222624:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5c3 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.222654:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.222661:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.222666:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.222668:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.222671:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2232320->3047423] (req 2232320->3047423) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.222694:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.222704:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.222714:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867905792:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.223458:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 21 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.223469:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 21 pid: 1852 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.223476:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867905920:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142918.231546:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142918.248349:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.248397:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.248462:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867613824 00000100:00100000:3.0:1746142918.248469:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867613824 00000100:00100000:3.0:1746142918.248513:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867614080 00000100:00100000:3.0:1746142918.248515:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867614080 00000100:00100000:3.0:1746142918.248539:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14569 00000100:00100000:3.0:1746142918.248547:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:32732:x1830962867613824:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142918.248566:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.248581:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b4000/0x2fa243e067cce751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5ca expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.248642:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248652:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248661:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248672:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248676:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248681:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248756:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248763:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248769:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142918.248776:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142918.248822:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248827:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248832:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248836:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c4200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.248839:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248844:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248852:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142918.248854:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142918.248857:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248861:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4200/0x2fa243e067cce766 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248876:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248881:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248888:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248892:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248895:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3b5e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.248897:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248924:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248930:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142918.248932:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.248934:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248937:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b5e00/0x2fa243e067cce758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248945:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248948:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248952:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248955:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c4400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.248957:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248964:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248968:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3d00) 00010000:00010000:3.0:1746142918.248970:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.248971:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.248975:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4400/0x2fa243e067cce75f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249001:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b4000/0x2fa243e067cce751 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ca expref: 38 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.249007:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3b4000/0x2fa243e067cce751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ca expref: 38 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.249014:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3b4000, rc 0) 00000100:00100000:3.0:1746142918.249050:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32732:x1830962867613824:12345-192.168.204.50@tcp:101:cat.0 Request processed in 504us (708us total) trans 8589936761 rc 301/301 00000100:00100000:3.0:1746142918.249055:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14569 00000100:00100000:3.0:1746142918.249068:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14570 00000100:00100000:3.0:1746142918.249072:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+19:32731:x1830962867614080:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142918.249079:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.249085:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5800/0x2fa243e067cce774 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5d1 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.249109:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249116:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249121:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249128:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249133:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249138:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249165:0:7232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249171:0:7232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249177:0:7232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00000004:00200000:3.0:1746142918.249182:0:7232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:3.0:1746142918.249203:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249208:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249212:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249216:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c5600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.249219:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249232:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249238:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142918.249240:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142918.249243:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249247:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5600/0x2fa243e067cce789 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249255:0:7232:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249259:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249263:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249268:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249271:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c4600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.249273:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249277:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249282:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142918.249283:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.249286:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249290:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c4600/0x2fa243e067cce77b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249296:0:7232:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249300:0:7232:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249304:0:7232:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249308:0:7232:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b0c5a00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.249310:0:7232:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249314:0:7232:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249318:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3200) 00010000:00010000:3.0:1746142918.249319:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142918.249321:0:7232:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249325:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5a00/0x2fa243e067cce782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7232 initiator: MDT0 00010000:00010000:3.0:1746142918.249343:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5800/0x2fa243e067cce774 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5d1 expref: 21 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.249349:0:7232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0c5800/0x2fa243e067cce774 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5d1 expref: 21 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.249356:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c5800, rc 0) 00000100:00100000:3.0:1746142918.249372:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad4f1515-ae46-4d91-8f96-492179af7039+20:32731:x1830962867614080:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 299us (975us total) trans 8589936762 rc 301/301 00000100:00100000:3.0:1746142918.249377:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14570 00000100:00100000:2.0:1746142918.254386:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867905792:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.254396:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867905920:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.254418:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2232320->3047423] (req 2232320->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.254431:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0c7400, rc 0) 00000100:00100000:2.0:1746142918.254471:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32723:x1830962867613568:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 31877us (38519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.254481:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14821 00000100:00100000:3.0:1746142918.255509:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2004:x1830962867613440:12345-192.168.204.50@tcp:3:cat.0 Request processed in 51889us (52405us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142918.255517:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4657 00002000:00100000:3.0:1746142918.255526:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880091c04a80 x1830962867613440/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.255534:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04a80 with x1830962867613440 ext(2097152->4194303) 00002000:00010000:3.0:1746142918.255539:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c04a80 00000100:00100000:0.0:1746142918.257520:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.263910:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.263995:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.264030:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867614336 00000100:00100000:0.0:1746142918.264036:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867614336 00010000:00010000:0.0:1746142918.264065:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746142918.264085:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867614464 00000100:00100000:0.0:1746142918.264088:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867614464 00010000:00010000:0.0:1746142918.264095:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 22 pid: 1852 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746142918.264115:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6733 00000100:00100000:0.0:1746142918.264122:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867614336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142918.264133:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142918.264150:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746142918.264159:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:0.0:1746142918.264240:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0200/0x2fa243e067cce6da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b592 expref: 48 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746142918.264425:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6734 00000100:00100000:1.0:1746142918.264433:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867614464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.264441:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.264449:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 22 pid: 1852 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.264456:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 22 pid: 1852 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.264467:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800971d0600/0x2fa243e067cce6b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b57d expref: 22 pid: 1852 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.264481:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.264483:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.264488:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.264499:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.264524:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.264534:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867906048:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.264602:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142918.265977:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867614208 00000100:00100000:2.0:1746142918.265984:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867614208 00000100:00100000:2.0:1746142918.266014:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14822 00000100:00100000:2.0:1746142918.266020:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867614208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.266033:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.266044:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f38ee00/0x2fa243e067cce797 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5d8 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142918.266073:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867906176:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142918.266114:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b90c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746142918.266390:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142918.266474:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.266510:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867614336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2387us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.266516:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6733 00000100:00100000:2.0:1746142918.266633:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867614592 00000100:00100000:2.0:1746142918.266637:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867614592 00000100:00100000:2.0:1746142918.266655:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14823 00000100:00100000:2.0:1746142918.266659:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+22:32727:x1830962867614592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.266666:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.266673:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5df expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.266686:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.266692:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.266693:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.266696:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.266716:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.266726:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 48 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746142918.266734:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867906304:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.266759:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.268994:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.269111:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867906048:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.269126:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.269156:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2003:x1830962867614464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4723us (5159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.269163:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6734 00000100:00100000:2.0:1746142918.269255:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867906176:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142918.269274:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f38ee00/0x2fa243e067cce797 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5d8 expref: 48 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142918.269285:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f38ee00/0x2fa243e067cce797 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5d8 expref: 48 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142918.269303:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f38ee00, rc 0) 00000100:00100000:2.0:1746142918.269320:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2006:x1830962867614208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 3300us (11807us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142918.269325:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14822 00000100:00100000:3.0:1746142918.269400:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867614848 00000100:00100000:3.0:1746142918.269405:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867614848 00002000:00100000:3.0:1746142918.269429:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2232320->2236415) req@ffff880091c06680 x1830962867614848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.269437:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06680 with x1830962867614848 ext(2232320->2236415) 00010000:00010000:3.0:1746142918.269443:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.269453:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746142918.269459:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c06680 00000100:00100000:3.0:1746142918.269598:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1445 00000100:00100000:3.0:1746142918.269605:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867614848:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142918.269698:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867614848:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 93us (710us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142918.269703:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1445 00002000:00100000:3.0:1746142918.269708:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2232320->2236415) req@ffff880091c06680 x1830962867614848/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.269714:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06680 with x1830962867614848 ext(2232320->2236415) 00010000:00010000:3.0:1746142918.269718:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.269726:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746142918.269731:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c06680 00000100:00100000:2.0:1746142918.273567:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867906304:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.273591:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 22 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.273605:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130650400, rc 0) 00000100:00100000:2.0:1746142918.273642:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:ad4f1515-ae46-4d91-8f96-492179af7039+22:32727:x1830962867614592:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6981us (7167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.273649:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14823 00000100:00100000:2.0:1746142918.286349:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.286410:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867615104 00000100:00100000:0.0:1746142918.286417:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867615104 00002000:00100000:0.0:1746142918.286453:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3043328->3047423) req@ffff880096142d80 x1830962867615104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142918.286462:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096142d80 with x1830962867615104 ext(3043328->3047423) 00010000:00010000:0.0:1746142918.286470:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.286482:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746142918.286489:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096142d80 00000100:00100000:0.0:1746142918.286512:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1446 00000100:00100000:0.0:1746142918.286518:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867615104:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142918.286626:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867615104:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 108us (284us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746142918.286631:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1446 00002000:00100000:0.0:1746142918.286636:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3043328->3047423) req@ffff880096142d80 x1830962867615104/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142918.286642:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096142d80 with x1830962867615104 ext(3043328->3047423) 00010000:00010000:0.0:1746142918.286646:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.286654:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746142918.286659:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880096142d80 00000100:00100000:0.0:1746142918.292873:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.292993:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.293071:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867615616 00000100:00100000:2.0:1746142918.293079:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867615616 00002000:00100000:2.0:1746142918.293114:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2232320->3047423) req@ffff880091c04000 x1830962867615616/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.293123:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04000 with x1830962867615616 ext(2232320->3047423) 00010000:00010000:2.0:1746142918.293130:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.293143:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 47 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746142918.293148:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c04000 00000100:00100000:2.0:1746142918.293163:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1447 00000100:00100000:2.0:1746142918.293169:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2005:x1830962867615616:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142918.293533:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867615488 00000100:00100000:3.0:1746142918.293539:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867615488 00000100:00100000:3.0:1746142918.293571:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5344 00000100:00100000:3.0:1746142918.293579:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+37:32723:x1830962867615488:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142918.293756:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32723:x1830962867615488:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 176us (887us total) trans 8589936763 rc 0/0 00000100:00100000:3.0:1746142918.293763:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5344 00000100:00100000:0.0:1746142918.296670:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.298524:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867615744 00000100:00100000:2.0:1746142918.298534:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867615744 00000100:00100000:2.0:1746142918.298583:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14824 00000100:00100000:2.0:1746142918.298590:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32732:x1830962867615744:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.298604:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.298617:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5e6 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.298648:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.298650:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.298653:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 50 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.298663:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 50 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.298671:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378c00, rc 0) 00000100:00100000:2.0:1746142918.298712:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:32732:x1830962867615744:12345-192.168.204.50@tcp:101:cat.0 Request processed in 122us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.298717:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14824 00000100:00100000:2.0:1746142918.330342:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867615616:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 37163us (37339us total) trans 21474841301 rc 0/0 00000100:00100000:2.0:1746142918.330352:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1447 00002000:00100000:2.0:1746142918.330362:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2232320->3047423) req@ffff880091c04000 x1830962867615616/t21474841301(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/448 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.330369:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c04000 with x1830962867615616 ext(2232320->3047423) 00010000:00010000:2.0:1746142918.330378:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 50 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.330391:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 50 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746142918.330397:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c04000 00000100:00100000:0.0:1746142918.336708:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.336795:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867616000 00000100:00100000:1.0:1746142918.336802:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867616000 00000100:00100000:1.0:1746142918.336855:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5345 00000100:00100000:1.0:1746142918.336864:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+6:32687:x1830962867616000:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:1.0:1746142918.337031:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+7:32687:x1830962867616000:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 169us (329us total) trans 8589936764 rc 0/0 00000100:00100000:1.0:1746142918.337037:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5345 00000100:00080000:0.0:1746142918.337183:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142918.341579:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.341648:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867616128 00000100:00100000:1.0:1746142918.341656:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867616128 00010000:00010000:1.0:1746142918.341682:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 50 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.341707:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6735 00000100:00100000:1.0:1746142918.341713:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2005:x1830962867616128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.341723:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.341737:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 50 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.341746:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 50 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.341762:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b0c7400/0x2fa243e067cce74a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2232320->3047423) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5c3 expref: 50 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.341777:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.341779:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.341784:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.341791:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.341797:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.341798:0:7219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.341800:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.341805:0:7219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.341827:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.341837:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867906432:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.341923:0:7219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 21 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.341930:0:7219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867906560:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.341950:0:7219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18840 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.345457:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867906432:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.345468:0:7219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7219:1830962867906560:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.345482:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.345512:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867616128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3798us (3938us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.345520:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6735 00000100:00100000:0.0:1746142918.345920:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.346011:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867616384 00000100:00100000:3.0:1746142918.346017:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867616384 00002000:00100000:3.0:1746142918.346048:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880091c07480 x1830962867616384/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.346061:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07480 with x1830962867616384 ext(3145728->4194303) 00002000:00010000:3.0:1746142918.346065:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c07480 00000100:00100000:3.0:1746142918.346190:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4658 00000100:00100000:3.0:1746142918.346197:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867616384:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142918.357548:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.357642:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.357717:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867616640 00000100:00100000:2.0:1746142918.357725:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867616640 00002000:00100000:2.0:1746142918.357760:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880091c06300 x1830962867616640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.357769:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06300 with x1830962867616640 ext(2097152->4194303) 00002000:00010000:2.0:1746142918.357773:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c06300 00000100:00100000:2.0:1746142918.357789:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4659 00000100:00100000:2.0:1746142918.357795:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867616640:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142918.360892:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867616896 00000100:00100000:3.0:1746142918.360946:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867616896 00000100:00100000:3.0:1746142918.360988:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5346 00000100:00100000:3.0:1746142918.360995:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+7:32687:x1830962867616896:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:3.0:1746142918.361149:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32687:x1830962867616896:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 154us (3507us total) trans 8589936765 rc 0/0 00000100:00100000:3.0:1746142918.361156:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5346 00000100:00100000:2.0:1746142918.364063:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2004:x1830962867616384:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17859us (18159us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142918.364074:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4658 00002000:00100000:2.0:1746142918.364083:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880091c07480 x1830962867616384/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.364090:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c07480 with x1830962867616384 ext(3145728->4194303) 00002000:00010000:2.0:1746142918.364095:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c07480 00000100:00100000:1.0:1746142918.375019:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.375072:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867617152 00000100:00100000:2.0:1746142918.375080:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867617152 00002000:00100000:2.0:1746142918.375114:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880093bcf100 x1830962867617152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.375123:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcf100 with x1830962867617152 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.375127:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcf100 00000100:00100000:2.0:1746142918.375143:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4660 00000100:00100000:2.0:1746142918.375150:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867617152:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142918.391853:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+22:2003:x1830962867617152:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16695us (16832us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142918.391862:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4660 00002000:00100000:3.0:1746142918.391870:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880093bcf100 x1830962867617152/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.391879:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bcf100 with x1830962867617152 ext(4194304->5066751) 00002000:00010000:3.0:1746142918.391884:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093bcf100 00000100:00100000:2.0:1746142918.392592:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867616640:12345-192.168.204.50@tcp:3:cat.0 Request processed in 34795us (35049us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142918.392599:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4659 00002000:00100000:2.0:1746142918.392604:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff880091c06300 x1830962867616640/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.392610:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c06300 with x1830962867616640 ext(2097152->4194303) 00002000:00010000:2.0:1746142918.392613:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c06300 00000100:00100000:0.0:1746142918.402462:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.402547:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867617408 00000100:00100000:1.0:1746142918.402555:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867617408 00000100:00100000:3.0:1746142918.403358:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867906688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746142918.403401:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142918.404454:0:9582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867906688 00000100:00100000:0.0:1746142918.404460:0:9582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867906688 00000100:00100000:0.0:1746142918.404502:0:9582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:0.0:1746142918.404508:0:9582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830962867906688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746142918.404528:0:9582:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1310297792 pending 6864896 free 3908063232 avail 3676540928 00000100:00100000:0.0:1746142918.404578:0:9582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3764:x1830962867906688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.404583:0:9582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00080000:0.0:1746142918.404598:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746142918.404708:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867906688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746142918.404908:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5347 00000100:00100000:1.0:1746142918.404916:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+20:32727:x1830962867617408:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142918.405061:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800949d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:32727:x1830962867617408:12345-192.168.204.50@tcp:35:cat.0 Request processed in 145us (2605us total) trans 8589936766 rc 0/0 00000100:00100000:1.0:1746142918.405066:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5347 00000100:00100000:0.0:1746142918.420079:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.420142:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867617664 00000100:00100000:2.0:1746142918.420149:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867617664 00002000:00100000:2.0:1746142918.420185:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012dbf6a00 x1830962867617664/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.420194:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6a00 with x1830962867617664 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.420198:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf6a00 00000100:00100000:2.0:1746142918.420216:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4661 00000100:00100000:2.0:1746142918.420235:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867617664:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142918.429877:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2005:x1830962867617664:12345-192.168.204.50@tcp:3:cat.0 Request processed in 9634us (9797us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142918.429888:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4661 00002000:00100000:2.0:1746142918.429897:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88012dbf6a00 x1830962867617664/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.429924:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dbf6a00 with x1830962867617664 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.429928:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dbf6a00 00000100:00100000:0.0:1746142918.435557:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.435647:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867617920 00000100:00100000:3.0:1746142918.435657:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867617920 00000100:00100000:3.0:1746142918.436003:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5348 00000100:00100000:3.0:1746142918.436011:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+38:32732:x1830962867617920:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1746142918.436180:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32732:x1830962867617920:12345-192.168.204.50@tcp:35:cat.0 Request processed in 169us (629us total) trans 8589936767 rc 0/0 00000100:00100000:3.0:1746142918.436186:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5348 00000100:00100000:0.0:1746142918.472880:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.473095:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618048 00000100:00100000:3.0:1746142918.473103:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618048 00000100:00100000:3.0:1746142918.473150:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14825 00000100:00100000:3.0:1746142918.473157:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:32731:x1830962867618048:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142918.473172:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.473185:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5ed expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.473208:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.473228:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 48 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.473235:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.473236:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.473240:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.473264:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 48 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.473273:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 48 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.473283:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867906816:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.477347:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 23 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.477362:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 23 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.477373:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867906944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142918.480540:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:3.0:1746142918.480572:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867906816:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142918.480929:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.480991:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618176 00000100:00100000:1.0:1746142918.480997:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618176 00010000:00010000:1.0:1746142918.481023:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 24 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.481044:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6736 00000100:00100000:1.0:1746142918.481050:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867618176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.481061:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.481079:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 24 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.481087:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 24 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.481107:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.481145:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867618176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.481150:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6736 00010000:00010000:3.0:1746142918.481613:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130650400/0x2fa243e067cce79e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5df expref: 23 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.481638:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867906944:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.481660:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2641920->3145727] (req 2641920->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 22 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.481668:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712be00, rc 0) 00000100:00100000:3.0:1746142918.481706:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+22:32731:x1830962867618048:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8549us (8833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142918.481711:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14825 00000100:00100000:0.0:1746142918.483039:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.483144:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618304 00000100:00100000:1.0:1746142918.483150:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618304 00010000:00010000:1.0:1746142918.483168:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.483197:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6737 00000100:00100000:1.0:1746142918.483202:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867618304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.483210:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.483232:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.483242:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.483256:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093378c00/0x2fa243e067cce7a5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5e6 expref: 49 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.483279:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.483281:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.483286:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.483293:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.483316:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.483326:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867907072:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.483377:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.484799:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.484933:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8381:1830962867907072:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.484945:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.484969:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867618304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1766us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.484975:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6737 00000100:00100000:2.0:1746142918.485661:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618560 00000100:00100000:2.0:1746142918.485666:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618560 00002000:00100000:2.0:1746142918.485699:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2641920->2646015) req@ffff88009cfeed80 x1830962867618560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.485708:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfeed80 with x1830962867618560 ext(2641920->2646015) 00002000:00010000:2.0:1746142918.485711:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfeed80 00000100:00100000:2.0:1746142918.485729:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4662 00000100:00100000:2.0:1746142918.485735:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867618560:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142918.485837:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2006:x1830962867618560:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 101us (1040us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142918.485842:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4662 00002000:00100000:2.0:1746142918.485847:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2641920->2646015) req@ffff88009cfeed80 x1830962867618560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.485853:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfeed80 with x1830962867618560 ext(2641920->2646015) 00002000:00010000:2.0:1746142918.485855:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cfeed80 00000100:00100000:0.0:1746142918.493045:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.493130:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618688 00000100:00100000:3.0:1746142918.493138:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618688 00000100:00100000:3.0:1746142918.493185:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14826 00000100:00100000:3.0:1746142918.493191:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+34:32731:x1830962867618688:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142918.493206:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.493230:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5f4 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.493255:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.493261:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.493266:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.493268:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.493271:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2539519] (req 2097152->2539519) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.493294:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.493304:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.493314:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867907200:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.494653:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 43 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.494668:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 43 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.494677:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867907328:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142918.495551:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.501400:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.501537:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867907200:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142918.501547:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867907328:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.501570:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->2539519] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 35 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.501587:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009712aa00, rc 0) 00000100:00100000:3.0:1746142918.501734:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+35:32731:x1830962867618688:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8541us (8695us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.502256:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618816 00000100:00100000:1.0:1746142918.502264:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618816 00000100:00100000:3.0:1746142918.502822:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14826 00000100:00100000:0.0:1746142918.503031:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142918.503202:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 44 pid: 1853 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.504155:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867618944 00000100:00100000:2.0:1746142918.504165:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6738 00000100:00100000:2.0:1746142918.504176:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:2004:x1830962867618816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142918.504189:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142918.504208:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 44 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.504231:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 44 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.504250:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d9800/0x2fa243e067cce6ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5a0 expref: 44 pid: 1853 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.504272:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142918.504303:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2004:x1830962867618816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 130us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.504308:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6738 00000100:00100000:1.0:1746142918.504466:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867618944 00010000:00010000:1.0:1746142918.504484:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746142918.504507:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6739 00000100:00100000:1.0:1746142918.504512:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+35:2005:x1830962867618944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.504518:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.504525:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746142918.504533:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746142918.504544:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c4d8800/0x2fa243e067cce6fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ae expref: 35 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746142918.504556:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.504557:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.504563:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.504571:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.504600:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 34 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.504610:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867907456:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.504657:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.510657:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867907456:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.510675:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.510726:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+34:2005:x1830962867618944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6212us (7694us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.510736:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6739 00000100:00100000:0.0:1746142918.518430:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.518938:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619200 00000100:00100000:2.0:1746142918.518946:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619200 00002000:00100000:2.0:1746142918.518984:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2535424->2539519) req@ffff88009cfedc00 x1830962867619200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.518993:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfedc00 with x1830962867619200 ext(2535424->2539519) 00002000:00010000:2.0:1746142918.518998:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfedc00 00000100:00100000:2.0:1746142918.519021:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4663 00000100:00100000:2.0:1746142918.519027:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867619200:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142918.519150:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+34:2003:x1830962867619200:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 122us (726us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142918.519156:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4663 00002000:00100000:2.0:1746142918.519162:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2535424->2539519) req@ffff88009cfedc00 x1830962867619200/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.519168:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cfedc00 with x1830962867619200 ext(2535424->2539519) 00002000:00010000:2.0:1746142918.519171:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cfedc00 00000100:00100000:2.0:1746142918.527487:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.527637:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619456 00000100:00100000:1.0:1746142918.527645:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619456 00000100:00100000:1.0:1746142918.528847:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5349 00000100:00100000:1.0:1746142918.528860:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f39050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+21:32731:x1830962867619456:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142918.529058:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f39050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:32731:x1830962867619456:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 202us (1576us total) trans 8589936768 rc 0/0 00000100:00100000:1.0:1746142918.531058:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5349 00000100:00100000:0.0:1746142918.546230:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.546941:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619712 00000100:00100000:1.0:1746142918.546950:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619712 00000100:00100000:1.0:1746142918.547004:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14571 00000100:00100000:1.0:1746142918.547012:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+39:32738:x1830962867619712:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142918.547029:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.547044:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b5fb expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.547107:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547117:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547125:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547135:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547375:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547382:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547460:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547468:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547473:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142918.547480:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142918.547547:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547553:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547561:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547565:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d77e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142918.547568:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547573:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547582:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142918.547585:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142918.547587:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547591:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77e00/0x2fa243e067cce7c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547617:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547622:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547626:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547630:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d77400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142918.547632:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547636:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547644:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4e00) 00010000:00010000:1.0:1746142918.547645:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142918.547647:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547650:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77400/0x2fa243e067cce7c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.547679:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5fb expref: 42 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.547689:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7cf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5fb expref: 41 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.547694:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142918.547696:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142918.547698:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d77c00, rc 0) 00000100:00100000:1.0:1746142918.549392:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32738:x1830962867619712:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2376us (3173us total) trans 8589936769 rc 0/0 00000100:00100000:1.0:1746142918.549401:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14571 00000100:00100000:3.0:1746142918.556045:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.557287:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867619840 00000100:00100000:1.0:1746142918.557296:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867619840 00000100:00100000:1.0:1746142918.557347:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 784 00000100:00100000:1.0:1746142918.557354:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867619840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.557366:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.557386:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7cf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5fb expref: 41 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.557414:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142918.557418:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.557454:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:2006:x1830962867619840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.557460:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 784 00000100:00100000:0.0:1746142918.579508:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.580063:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620096 00000100:00100000:1.0:1746142918.580074:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620096 00000100:00100000:1.0:1746142918.580747:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14572 00000100:00100000:1.0:1746142918.580755:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+40:32742:x1830962867620096:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.580775:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.580791:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b602 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.580866:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.580879:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.580888:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142918.580897:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142918.581466:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce7dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 43 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.581496:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 42 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.581507:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142918.581509:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746142918.581512:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d76a00, rc 0) 00000100:00100000:1.0:1746142918.582089:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32742:x1830962867620096:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1334us (2590us total) trans 8589936770 rc 0/0 00000100:00100000:1.0:1746142918.582096:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14572 00000100:00100000:0.0:1746142918.596812:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.597133:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620224 00000100:00100000:3.0:1746142918.597141:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620224 00000100:00100000:3.0:1746142918.597187:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14827 00000100:00100000:3.0:1746142918.597193:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867620224:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142918.597207:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.597230:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab29200/0x2fa243e067cce7f2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b609 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142918.597269:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867907584:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142918.597356:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.599147:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.600640:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620352 00000100:00100000:2.0:1746142918.600650:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620352 00000100:00100000:2.0:1746142918.600696:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14828 00000100:00100000:2.0:1746142918.600703:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867620352:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.600720:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.600733:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093378600/0x2fa243e067cce7f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b610 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142918.601373:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867907712:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142918.601456:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.614686:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.616182:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620480 00000100:00100000:1.0:1746142918.616191:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620480 00000100:00100000:1.0:1746142918.616243:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14573 00000100:00100000:1.0:1746142918.616251:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+8:32743:x1830962867620480:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142918.616272:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.616288:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76c00/0x2fa243e067cce800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b617 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.616337:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616347:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616356:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616368:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616373:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616382:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616438:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616446:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616451:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142918.616482:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:1.0:1746142918.616486:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746142918.616500:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616507:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616512:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616517:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616521:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616526:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d77c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142918.616529:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.616535:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00002000:00010000:3.0:1746142918.617881:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142918 -> 1746142919 00002000:00010000:3.0:1746142918.617886:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142918 -> 1746142919 00002000:00010000:3.0:1746142918.617888:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142918 -> 1746142919 00000100:00100000:3.0:1746142918.617916:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867907584:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142918.617940:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab29200/0x2fa243e067cce7f2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b609 expref: 49 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.617950:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab29200/0x2fa243e067cce7f2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b609 expref: 49 pid: 1397 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746142918.618311:0:1853:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142918 -> 1746142919 00002000:00010000:2.0:1746142918.618314:0:1853:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142918 -> 1746142919 00002000:00010000:2.0:1746142918.618316:0:1853:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142918 -> 1746142919 00000100:00100000:2.0:1746142918.618327:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867907712:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142918.618342:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093378600/0x2fa243e067cce7f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b610 expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142918.618350:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093378600/0x2fa243e067cce7f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b610 expref: 44 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142918.618363:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378600, rc 0) 00000100:00100000:2.0:1746142918.618404:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867620352:12345-192.168.204.50@tcp:101:cat.0 Request processed in 17700us (19261us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142918.618411:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14828 00010000:00010000:3.0:1746142918.618576:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab29200, rc 0) 00000100:00100000:3.0:1746142918.618596:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867620224:12345-192.168.204.50@tcp:101:cat.0 Request processed in 21403us (21792us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142918.618601:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14827 00010000:00010000:1.0:1746142918.622507:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142918.622513:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142918.622520:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622528:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d77c00/0x2fa243e067cce807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622548:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622553:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622558:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622562:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cde00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142918.622564:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622569:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622577:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4600) 00010000:00010000:1.0:1746142918.622578:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142918.622580:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622584:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce80e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.622618:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76c00/0x2fa243e067cce800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.622629:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 9 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.622635:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142918.622636:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142918.622638:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cc600, rc 0) 00000100:00100000:1.0:1746142918.622685:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32743:x1830962867620480:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 6434us (8004us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.622692:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14573 00000100:00100000:0.0:1746142918.664306:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.665151:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.665184:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.665208:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620608 00000100:00100000:2.0:1746142918.665224:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620608 00000100:00100000:2.0:1746142918.665266:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620736 00000100:00100000:2.0:1746142918.665269:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620736 00000100:00100000:2.0:1746142918.665286:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14829 00000100:00100000:2.0:1746142918.665292:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867620608:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.665308:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.665323:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093379000/0x2fa243e067cce81c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b61e expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142918.665369:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867907840:192.168.204.50@tcp:106: 00000100:00100000:3.0:1746142918.665483:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14830 00000100:00100000:3.0:1746142918.665490:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867620736:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142918.665496:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.665504:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067cce823 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b625 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142918.665525:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867907968:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142918.665780:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867621504 00000100:00100000:1.0:1746142918.665785:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867621504 00000100:00100000:1.0:1746142918.665816:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14574 00000100:00100000:1.0:1746142918.665821:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+22:32747:x1830962867621504:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.665833:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.665843:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067cce82a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b648 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.665892:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.665917:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.665926:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.665937:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.665946:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.665951:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666028:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce83f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666036:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce83f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666042:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce83f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746142918.666049:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142918.666104:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666109:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666114:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666118:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666123:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cc200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142918.666125:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666131:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666142:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142918.666144:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142918.666147:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666152:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc200/0x2fa243e067cce831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666166:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666171:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666175:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666179:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800968cce00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142918.666181:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666185:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666191:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4000) 00010000:00010000:1.0:1746142918.666193:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142918.666195:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666198:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cce00/0x2fa243e067cce838 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.666238:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cd200/0x2fa243e067cce82a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b648 expref: 25 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.666248:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce83f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b648 expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.666253:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142918.666255:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142918.666257:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:2.0:1746142918.666619:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.666737:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.666751:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620864 00000100:00100000:0.0:1746142918.666754:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620864 00000100:00100000:0.0:1746142918.666773:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14831 00000100:00100000:0.0:1746142918.666777:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867620864:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142918.666785:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142918.666792:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b62c expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.666804:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142918.666805:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142918.666811:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.666821:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 14 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.666830:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711aa00, rc 0) 00000100:00100000:0.0:1746142918.666846:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867620864:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 68us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.666851:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14831 00000100:00100000:0.0:1746142918.666914:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.666925:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867620992 00000100:00100000:0.0:1746142918.666928:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867620992 00000100:00100000:0.0:1746142918.666942:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14832 00000100:00100000:0.0:1746142918.666946:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867620992:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142918.666952:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142918.666959:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b633 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.666968:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142918.666969:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142918.666974:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.666982:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 15 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.666988:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711a400, rc 0) 00000100:00100000:0.0:1746142918.667003:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867620992:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 57us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.667008:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14832 00000100:00100000:0.0:1746142918.667030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.667039:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867621120 00000100:00100000:0.0:1746142918.667042:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867621120 00000100:00100000:0.0:1746142918.667052:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14833 00000100:00100000:0.0:1746142918.667056:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867621120:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142918.667062:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142918.667067:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009711b800/0x2fa243e067cce85b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b63a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142918.667086:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867908096:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142918.667108:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.667146:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.667155:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867621248 00000100:00100000:0.0:1746142918.667158:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867621248 00000100:00100000:0.0:1746142918.667179:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14834 00000100:00100000:0.0:1746142918.667184:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867621248:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142918.667189:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142918.667195:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009711ac00/0x2fa243e067cce862 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b641 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142918.667223:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867908224:192.168.204.50@tcp:106: 00000100:00100000:0.0:1746142918.667241:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:3.0:1746142918.667414:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.668081:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:32747:x1830962867621504:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2257us (3778us total) trans 8589936771 rc 0/0 00000100:00100000:1.0:1746142918.668088:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14574 00000100:00100000:0.0:1746142918.674259:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.674630:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:1853:1830962867907840:192.168.204.50@tcp:106: 00010000:00010000:3.0:1746142918.674655:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093379000/0x2fa243e067cce81c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b61e expref: 49 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.674666:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093379000/0x2fa243e067cce81c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b61e expref: 49 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.674687:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093379000, rc 0) 00000100:00100000:3.0:1746142918.674794:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2006:x1830962867620608:12345-192.168.204.50@tcp:101:cat.0 Request processed in 9501us (9644us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142918.674801:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14829 00000100:00100000:2.0:1746142918.675063:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867621632 00000100:00100000:2.0:1746142918.675069:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867621632 00000100:00100000:2.0:1746142918.675101:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 785 00000100:00100000:2.0:1746142918.675106:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867621632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142918.675116:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142918.675130:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce83f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b648 expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.675148:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142918.675151:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142918.675165:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2006:x1830962867621632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 59us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.675169:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 785 00000100:00100000:2.0:1746142918.677014:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867908096:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142918.677036:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009711b800/0x2fa243e067cce85b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b63a expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142918.677046:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009711b800/0x2fa243e067cce85b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b63a expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142918.677055:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711b800, rc 0) 00000100:00100000:2.0:1746142918.677082:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867621120:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10025us (10051us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142918.677088:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14833 00000100:00100000:1.0:1746142918.677263:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e678e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867908224:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142918.677276:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009711ac00/0x2fa243e067cce862 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b641 expref: 16 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.677284:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711ac00/0x2fa243e067cce862 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b641 expref: 16 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.677293:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009711ac00, rc 0) 00000100:00100000:1.0:1746142918.677308:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c8243383-433c-45fe-9bef-8828afa9ff81+15:2005:x1830962867621248:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 10125us (10163us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142918.677313:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14834 00000100:00100000:0.0:1746142918.677752:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867907968:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142918.677870:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067cce823 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b625 expref: 44 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.677879:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0a1200/0x2fa243e067cce823 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b625 expref: 44 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.677889:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0a1200, rc 0) 00000100:00100000:0.0:1746142918.678671:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2006:x1830962867620736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 12430us (12735us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142918.678680:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14830 00000100:00100000:0.0:1746142918.691445:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.691528:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867621760 00000100:00100000:2.0:1746142918.691537:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867621760 00000100:00100000:2.0:1746142918.693113:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14835 00000100:00100000:2.0:1746142918.693123:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:32742:x1830962867621760:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.693137:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.693151:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b64f expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.693173:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.693180:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.693181:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.693184:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 49 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.693207:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 21 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.693227:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 21 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746142918.693241:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867908352:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.694536:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.698176:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.699485:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867622016 00000100:00100000:1.0:1746142918.699493:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867622016 00000100:00100000:1.0:1746142918.699535:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14575 00000100:00100000:1.0:1746142918.699543:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32743:x1830962867622016:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:1.0:1746142918.699561:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.699577:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cda00/0x2fa243e067cce870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b656 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699657:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.699669:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699675:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 22 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699681:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699686:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746142918.699709:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699718:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 10 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.699728:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867908480:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142918.699818:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 22 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699830:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 22 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.699836:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867908608:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142918.699858:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.699865:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 41 pid: 7232 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.699871:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867908736:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142918.699886:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc18b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.703610:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.704942:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867908352:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.704968:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 49 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.704982:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093378600, rc 0) 00000100:00100000:3.0:1746142918.705025:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:32742:x1830962867621760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 11905us (13589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142918.705032:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14835 00000100:00100000:1.0:1746142918.705974:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867622272 00000100:00100000:1.0:1746142918.705981:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867622272 00000100:00100000:1.0:1746142918.706373:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14576 00000100:00100000:1.0:1746142918.706381:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:32748:x1830962867622272:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142918.706399:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.706413:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d3c00/0x2fa243e067cce87e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b65d expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.706492:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.706503:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142918.706510:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000001:00080000:0.0:1746142918.709788:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874049 is committed 00000001:00080000:0.0:1746142918.709801:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874048 is committed 00000001:00080000:0.0:1746142918.709813:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874044 is committed 00000001:00080000:0.0:1746142918.709874:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873994 is committed 00000100:00100000:0.0:1746142918.713479:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.713603:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.713626:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867622656 00000100:00100000:0.0:1746142918.713633:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867622656 00010000:00010000:0.0:1746142918.713664:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 25 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746142918.713702:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6740 00000100:00100000:0.0:1746142918.713709:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867622656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142918.713724:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142918.713729:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 25 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.713738:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 25 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.713756:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142918.713760:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.713767:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.713771:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142918.713803:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+25:2006:x1830962867622656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.713809:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6740 00000100:00100000:1.0:1746142918.713941:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867908480:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142918.713951:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d1c00/0x2fa243e067cce655 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b53e expref: 24 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.713966:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867908608:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142918.713974:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7231:1830962867908736:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142918.713992:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746142918.714049:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867622400 00000100:00100000:2.0:1746142918.714053:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867622400 00002000:00100000:2.0:1746142918.714078:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2641920->3145727) req@ffff88009cd5d500 x1830962867622400/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.714086:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d500 with x1830962867622400 ext(2641920->3145727) 00010000:00010000:2.0:1746142918.714092:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 22 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.714099:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 22 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746142918.714104:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5d500 00000100:00100000:2.0:1746142918.714116:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1448 00000100:00100000:2.0:1746142918.714121:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867622400:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142918.727338:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.728889:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.729646:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867623168 00000100:00100000:3.0:1746142918.729655:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867623168 00002000:00100000:3.0:1746142918.729691:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009cd5df80 x1830962867623168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 504/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.729700:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5df80 with x1830962867623168 ext(2097152->4194303) 00010000:00010000:3.0:1746142918.729708:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.729718:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746142918.729724:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5df80 00000100:00100000:3.0:1746142918.729749:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1449 00000100:00100000:3.0:1746142918.729756:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867623168:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142918.732686:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.732713:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867622528 00000100:00100000:0.0:1746142918.732722:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867622528 00010000:00010000:0.0:1746142918.732749:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 11 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746142918.732772:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867622784 00000100:00100000:0.0:1746142918.732774:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867622784 00010000:00010000:0.0:1746142918.732784:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 42 pid: 7232 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746142918.732804:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6741 00000100:00100000:0.0:1746142918.732811:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867622528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142918.732821:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142918.732825:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 11 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.732834:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 11 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.732852:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cc600/0x2fa243e067cce815 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b617 expref: 11 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.732868:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142918.732872:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.732878:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.732883:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142918.732934:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867622528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 123us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.732939:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6741 00000100:00100000:0.0:1746142918.732952:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6742 00000100:00100000:0.0:1746142918.732957:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2006:x1830962867622784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142918.732963:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142918.732966:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 42 pid: 7232 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.732974:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 42 pid: 7232 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.732984:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800984b0000/0x2fa243e067cce58a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ce expref: 42 pid: 7232 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.732992:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142918.732995:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.733001:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.733007:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.733013:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142918.733017:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142918.733020:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142918.733036:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142918.733051:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2006:x1830962867622784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.733055:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6742 00000100:00100000:0.0:1746142918.733513:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1746142918.733571:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746142918.733577:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746142918.733591:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142918.733693:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cda00/0x2fa243e067cce870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b656 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.733704:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b656 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.733709:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142918.733712:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142918.733713:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968cde00, rc 0) 00000100:00100000:0.0:1746142918.733737:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32743:x1830962867622016:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 34194us (35567us total) trans 8589936772 rc 0/0 00000100:00100000:0.0:1746142918.733742:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14575 00010000:00010000:0.0:1746142918.733775:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142918.733780:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142918.733788:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142918.733826:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d3c00/0x2fa243e067cce87e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 25 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.733835:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 24 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.733842:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142918.733844:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746142918.733846:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800971d2e00, rc 0) 00000100:00100000:0.0:1746142918.733861:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:32748:x1830962867622272:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 27482us (30259us total) trans 8589936773 rc 0/0 00000100:00100000:0.0:1746142918.733865:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14576 00000100:00100000:0.0:1746142918.733921:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867623296 00000100:00100000:0.0:1746142918.733925:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867623296 00002000:00100000:0.0:1746142918.733944:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2539520->4194303) req@ffff880092432a00 x1830962867623296/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142918.733952:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432a00 with x1830962867623296 ext(2539520->4194303) 00002000:00010000:0.0:1746142918.733956:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092432a00 00000100:00100000:0.0:1746142918.733968:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4664 00000100:00100000:0.0:1746142918.733973:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867623296:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142918.754414:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867622400:12345-192.168.204.50@tcp:4:cat.0 Request processed in 40282us (40931us total) trans 21474841302 rc 0/0 00000100:00100000:0.0:1746142918.754427:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1448 00002000:00100000:0.0:1746142918.754438:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (2641920->3145727) req@ffff88009cd5d500 x1830962867622400/t21474841302(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/448 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142918.754447:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5d500 with x1830962867622400 ext(2641920->3145727) 00010000:00010000:0.0:1746142918.754457:0:20331:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 26 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:0.0:1746142918.754476:0:20331:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 26 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:0.0:1746142918.754483:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5d500 00000100:00100000:3.0:1746142918.759277:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867623168:12345-192.168.204.50@tcp:3:cat.0 Request processed in 29513us (31938us total) trans 0 rc 1593344/1593344 00000100:00100000:3.0:1746142918.759289:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1449 00002000:00100000:3.0:1746142918.759299:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->4194303) req@ffff88009cd5df80 x1830962867623168/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 504/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 1593344/1593344 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.759307:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5df80 with x1830962867623168 ext(2097152->4194303) 00010000:00010000:3.0:1746142918.759315:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.759329:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746142918.759335:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009cd5df80 00000100:00100000:0.0:1746142918.769155:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.769176:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867623552 00000100:00100000:2.0:1746142918.769183:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867623552 00000100:00100000:2.0:1746142918.769245:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14577 00000100:00100000:2.0:1746142918.769253:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32743:x1830962867623552:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142918.769273:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.769275:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746142918.769296:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800968cde00/0x2fa243e067cce877 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b656 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.769330:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142918.769333:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142918.769343:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093379e00/0x2fa243e067cce89a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b664 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.769417:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142918.769428:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 23 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.769433:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142918.769455:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 23 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.769463:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 23 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746142918.769473:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867908864:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.769543:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746142918.780999:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867623296:12345-192.168.204.50@tcp:3:cat.0 Request processed in 47017us (47478us total) trans 0 rc 1654784/1654784 00000100:00100000:2.0:1746142918.781009:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4664 00002000:00100000:2.0:1746142918.781020:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2539520->4194303) req@ffff880092432a00 x1830962867623296/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1654784/1654784 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.781034:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432a00 with x1830962867623296 ext(2539520->4194303) 00002000:00010000:2.0:1746142918.781039:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092432a00 00000100:00100000:0.0:1746142918.792341:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.793097:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867908864:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.793115:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142918.793393:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.793457:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867623808 00000100:00100000:3.0:1746142918.793462:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867623808 00002000:00100000:3.0:1746142918.793494:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092432d80 x1830962867623808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.793502:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432d80 with x1830962867623808 ext(4194304->5066751) 00010000:00010000:3.0:1746142918.793508:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.793522:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746142918.793528:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092432d80 00000100:00100000:3.0:1746142918.793542:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1450 00000100:00100000:3.0:1746142918.793548:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867623808:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142918.798100:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867623936 00000100:00100000:3.0:1746142918.798110:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867623936 00000100:00100000:3.0:1746142918.798811:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14836 00000100:00100000:3.0:1746142918.798820:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32738:x1830962867623936:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:3.0:1746142918.798837:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.798851:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b66b expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.798874:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.798882:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.798888:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.798893:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.798894:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.798927:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1101824->1884159] (req 1101824->1884159) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.798953:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.798962:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.798983:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867908992:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.799081:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 10 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142918.799088:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 10 pid: 9578 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.799096:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867909120:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142918.802600:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 7 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.802615:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 7 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.802628:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867909248:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142918.802706:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179480 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.803659:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.803935:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624064 00000100:00100000:3.0:1746142918.803941:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624064 00010000:00010000:3.0:1746142918.803967:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 24 pid: 13326 timeout: 792 lvb_type: 0 00000100:00100000:3.0:1746142918.803986:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6743 00000100:00100000:3.0:1746142918.803991:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867624064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142918.804001:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142918.804006:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 24 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.804015:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 24 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.804033:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800971d2e00/0x2fa243e067cce885 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b65d expref: 24 pid: 13326 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.804048:0:7219:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142918.804052:0:7219:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804059:0:7219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804064:0:7219:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804079:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142918.804102:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867624064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142918.804107:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6743 00010000:00010000:3.0:1746142918.804137:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804143:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804157:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804162:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804167:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804171:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093378400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142918.804174:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804179:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804186:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142918.804188:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746142918.804191:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804194:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093378400/0x2fa243e067cce8a1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142918.804231:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093379e00/0x2fa243e067cce89a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b664 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.804237:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093379e00/0x2fa243e067cce89a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b664 expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.804244:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093379e00, rc 0) 00000100:00100000:3.0:1746142918.804260:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:32743:x1830962867623552:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 35009us (35114us total) trans 0 rc 301/301 00000100:00100000:3.0:1746142918.804266:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14577 00000100:00100000:2.0:1746142918.806869:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867908992:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.806879:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867909120:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.806886:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867909248:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.806932:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [1101824->1884159] (req 1101824->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.806945:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800982c7400, rc 0) 00000100:00100000:2.0:1746142918.806974:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32738:x1830962867623936:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 8156us (13581us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.806981:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14836 00000100:00100000:3.0:1746142918.811055:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867623808:12345-192.168.204.50@tcp:3:cat.0 Request processed in 17498us (18711us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142918.811066:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1450 00002000:00100000:3.0:1746142918.811076:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880092432d80 x1830962867623808/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.811084:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432d80 with x1830962867623808 ext(4194304->5066751) 00010000:00010000:3.0:1746142918.811093:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.811105:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 24 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:3.0:1746142918.811111:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092432d80 00000100:00100000:0.0:1746142918.811547:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.811585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.811720:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624192 00000100:00100000:2.0:1746142918.811727:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624192 00010000:00010000:2.0:1746142918.811749:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 11 pid: 9578 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746142918.811774:0:7219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624320 00000100:00100000:2.0:1746142918.811776:0:7219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624320 00010000:00010000:2.0:1746142918.811783:0:7219:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 8 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746142918.814460:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6744 00000100:00100000:2.0:1746142918.814475:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867624192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142918.814491:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142918.814510:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 11 pid: 9578 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746142918.814521:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 11 pid: 9578 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746142918.814539:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711a400/0x2fa243e067cce854 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b633 expref: 11 pid: 9578 timeout: 792 lvb_type: 1 00010000:00010000:2.0:1746142918.814557:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142918.814596:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8243383-433c-45fe-9bef-8828afa9ff81+10:2005:x1830962867624192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.814602:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6744 00000100:00100000:2.0:1746142918.814614:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6745 00000100:00100000:2.0:1746142918.814618:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867624320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142918.814623:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142918.814628:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 8 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.814635:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 8 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.814648:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0000/0x2fa243e067cce671 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b55a expref: 8 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.814654:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142918.814663:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867624320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 45us (3078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.814667:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6745 00000100:00100000:0.0:1746142918.820549:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.823447:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.823463:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.823531:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.823563:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624832 00000100:00100000:0.0:1746142918.823570:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624832 00000100:00100000:0.0:1746142918.823600:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14837 00000100:00100000:0.0:1746142918.823606:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+24:32747:x1830962867624832:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142918.823618:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142918.823631:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b672 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.823650:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142918.823652:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142918.823656:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.823664:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.823673:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a0800, rc 0) 00000100:00100000:1.0:1746142918.823820:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624704 00000100:00100000:1.0:1746142918.823825:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624704 00000100:00100000:1.0:1746142918.823855:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5350 00000100:00100000:1.0:1746142918.823859:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+9:32743:x1830962867624704:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:3.0:1746142918.823972:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624448 00000100:00100000:3.0:1746142918.823977:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624448 00000100:00100000:1.0:1746142918.823993:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c8243383-433c-45fe-9bef-8828afa9ff81+10:32743:x1830962867624704:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 133us (3450us total) trans 8589936774 rc 0/0 00010000:00010000:3.0:1746142918.823995:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:1.0:1746142918.824000:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5350 00000100:00100000:3.0:1746142918.824015:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867624960 00000100:00100000:3.0:1746142918.824017:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867624960 00000100:00100000:1.0:1746142918.824018:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6746 00000100:00100000:1.0:1746142918.824022:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867624448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142918.824024:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 26 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.824030:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746142918.824035:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6747 00010000:00010000:1.0:1746142918.824043:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746142918.824052:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.824054:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+26:2005:x1830962867624960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142918.824060:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.824067:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800971d1600/0x2fa243e067cce6e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b58b expref: 26 pid: 1853 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746142918.824070:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 26 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.824075:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.824076:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.824078:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 26 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.824080:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.824086:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.824088:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009712be00/0x2fa243e067cce7ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2641920->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5ed expref: 26 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:3.0:1746142918.824098:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.824099:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.824102:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.824106:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 25 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.824109:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.824114:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142918.824115:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746142918.824115:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867909376:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142918.824117:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.824123:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.824141:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.824147:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142918.824148:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867909504:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142918.824175:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142918.824181:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867909632:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142918.824193:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.824913:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+25:32747:x1830962867624832:12345-192.168.204.50@tcp:101:cat.0 Request processed in 100us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.824918:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14837 00000100:00100000:3.0:1746142918.832962:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867909504:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142918.832972:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867909632:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142918.832987:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142918.833020:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867624960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8979us (9488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142918.833028:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6747 00000100:00100000:1.0:1746142918.833101:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867909376:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.833110:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.833123:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867624448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9100us (9682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.833128:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6746 00000100:00100000:0.0:1746142918.844817:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.844845:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.845157:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867625344 00000100:00100000:3.0:1746142918.845165:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867625344 00002000:00100000:3.0:1746142918.845197:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1101824->1105919) req@ffff880092d08700 x1830962867625344/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.845205:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08700 with x1830962867625344 ext(1101824->1105919) 00002000:00010000:3.0:1746142918.845218:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d08700 00000100:00100000:0.0:1746142918.846013:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.847139:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.847335:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867625728 00000100:00100000:3.0:1746142918.847340:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867625728 00002000:00100000:3.0:1746142918.847361:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092d08a80 x1830962867625728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.847368:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08a80 with x1830962867625728 ext(2097152->3145727) 00002000:00010000:3.0:1746142918.847372:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d08a80 00000100:00100000:3.0:1746142918.847391:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4665 00000100:00100000:3.0:1746142918.847397:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867625344:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142918.847499:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867625344:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 102us (2651us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142918.847504:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4665 00002000:00100000:3.0:1746142918.847508:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1101824->1105919) req@ffff880092d08700 x1830962867625344/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.847514:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08700 with x1830962867625344 ext(1101824->1105919) 00002000:00010000:3.0:1746142918.847517:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d08700 00000100:00100000:3.0:1746142918.847527:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4666 00000100:00100000:3.0:1746142918.847531:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867625728:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142918.849206:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867625088 00000100:00100000:0.0:1746142918.849222:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867625088 00000100:00100000:0.0:1746142918.849248:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14838 00000100:00100000:0.0:1746142918.849254:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+7:32748:x1830962867625088:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:0.0:1746142918.849265:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142918.849278:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b679 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.849298:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.849305:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 9 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.849311:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.849320:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142918.849321:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142918.849324:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [1253376->1773567] (req 1253376->1773567) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.849344:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 8 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.849354:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 8 pid: 1852 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746142918.849362:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867909760:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142918.849418:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 9 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142918.849425:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 9 pid: 11943 timeout: 792 lvb_type: 1 00000100:00100000:0.0:1746142918.849431:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867909888:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142918.849448:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142918.849454:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 24 pid: 9578 timeout: 792 lvb_type: 0 00000100:00100000:0.0:1746142918.849464:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867910016:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142918.849475:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.849549:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867625856 00000100:00100000:1.0:1746142918.849554:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867625856 00002000:00100000:1.0:1746142918.849572:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092d0ad80 x1830962867625856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.849584:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0ad80 with x1830962867625856 ext(3145728->4194303) 00002000:00010000:1.0:1746142918.849587:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0ad80 00000100:00100000:1.0:1746142918.849597:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4667 00000100:00100000:1.0:1746142918.849601:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867625856:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142918.872444:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.872470:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.872755:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867625984 00000100:00100000:3.0:1746142918.872762:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867625984 00010000:00010000:3.0:1746142918.872790:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 9 pid: 1852 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.872815:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867626112 00000100:00100000:3.0:1746142918.872817:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867626112 00010000:00010000:3.0:1746142918.872824:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 10 pid: 11943 timeout: 792 lvb_type: 1 00000100:00100000:3.0:1746142918.872848:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6748 00000100:00100000:3.0:1746142918.872855:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867625984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142918.872866:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142918.872883:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 9 pid: 1852 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746142918.872893:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 9 pid: 1852 timeout: 792 lvb_type: 1 00010000:00010000:3.0:1746142918.872927:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.873140:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6749 00000100:00100000:1.0:1746142918.873146:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2003:x1830962867626112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.873155:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.873162:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 10 pid: 11943 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746142918.873169:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 10 pid: 11943 timeout: 792 lvb_type: 1 00010000:00010000:1.0:1746142918.873178:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142918.874464:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5e00/0x2fa243e067cce5c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b506 expref: 9 pid: 1852 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746142918.874481:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867909760:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.874491:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009711aa00/0x2fa243e067cce84d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b62c expref: 10 pid: 11943 timeout: 792 lvb_type: 1 00000100:00100000:2.0:1746142918.874497:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867909888:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.874504:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867910016:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.874525:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1253376->1773567] (req 1253376->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.874534:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b2a0e00, rc 0) 00000100:00100000:3.0:1746142918.874582:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867625984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1727us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142918.874590:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6748 00000100:00100000:1.0:1746142918.874647:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867626112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1501us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.874652:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6749 00000100:00100000:0.0:1746142918.874726:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.874951:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867625728:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 27419us (28938us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142918.874957:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4666 00002000:00100000:0.0:1746142918.874964:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff880092d08a80 x1830962867625728/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142918.874971:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d08a80 with x1830962867625728 ext(2097152->3145727) 00002000:00010000:0.0:1746142918.874975:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d08a80 00000100:00100000:2.0:1746142918.875049:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+7:32748:x1830962867625088:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 25794us (30237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.875057:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14838 00000100:00100000:1.0:1746142918.875217:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867626240 00000100:00100000:1.0:1746142918.875222:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867626240 00010000:00010000:1.0:1746142918.875237:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 25 pid: 9578 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.875260:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6750 00000100:00100000:1.0:1746142918.875265:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867626240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.875273:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.875283:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 25 pid: 9578 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.875291:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 25 pid: 9578 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.875304:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800984b1200/0x2fa243e067cce5bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4ff expref: 25 pid: 9578 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.875313:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.875315:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.875321:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 6 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.875327:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 6 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.875346:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 6 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.875353:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867910144:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.875400:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142918.881004:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.881037:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.881061:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.881081:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867626752 00000100:00100000:0.0:1746142918.881089:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867626752 00000100:00100000:0.0:1746142918.881130:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867627008 00000100:00100000:0.0:1746142918.881133:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867627008 00000100:00100000:0.0:1746142918.881146:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 899 00000100:00100000:0.0:1746142918.881153:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962867626752:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142918.881202:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+309:2005:x1830962867626752:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.881208:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 899 00000100:00100000:0.0:1746142918.881233:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 900 00000100:00100000:0.0:1746142918.881238:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+5:2005:x1830962867627008:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142918.881258:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c8243383-433c-45fe-9bef-8828afa9ff81+5:2005:x1830962867627008:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 20us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.881262:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 900 00000100:00080000:0.0:1746142918.881273:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746142918.881296:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.881311:0:8097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867626624 00000100:00100000:0.0:1746142918.881313:0:8097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867626624 00000100:00100000:0.0:1746142918.881331:0:8097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:0.0:1746142918.881335:0:8097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9590e9a3-538a-49d5-a431-e1408ed78761+15:2005:x1830962867626624:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142918.881353:0:8097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130dd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9590e9a3-538a-49d5-a431-e1408ed78761+15:2005:x1830962867626624:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 18us (57us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.881357:0:8097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 187 00000100:00100000:0.0:1746142918.881447:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.881459:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867626880 00000100:00100000:0.0:1746142918.881461:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867626880 00000100:00100000:0.0:1746142918.881477:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 901 00000100:00100000:0.0:1746142918.881481:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+5:2005:x1830962867626880:12345-192.168.204.50@tcp:400:kworker.0 00000100:00100000:0.0:1746142918.881497:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097348e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad4f1515-ae46-4d91-8f96-492179af7039+5:2005:x1830962867626880:12345-192.168.204.50@tcp:400:kworker.0 Request processed in 17us (52us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142918.881501:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 901 00000100:00080000:0.0:1746142918.881509:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746142918.881671:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+24:2006:x1830962867625856:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 32069us (34532us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142918.881678:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4667 00002000:00100000:1.0:1746142918.881688:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880092d0ad80 x1830962867625856/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.881696:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0ad80 with x1830962867625856 ext(3145728->4194303) 00002000:00010000:1.0:1746142918.881700:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092d0ad80 00000100:00100000:1.0:1746142918.881710:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867626496 00000100:00100000:1.0:1746142918.881712:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867626496 00002000:00100000:1.0:1746142918.881727:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1880064->1884159) req@ffff880092d0b480 x1830962867626496/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.881733:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0b480 with x1830962867626496 ext(1880064->1884159) 00002000:00010000:1.0:1746142918.881735:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d0b480 00000100:00100000:1.0:1746142918.881743:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4668 00000100:00100000:1.0:1746142918.881747:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867626496:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142918.881813:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867626496:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 65us (816us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142918.881817:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4668 00002000:00100000:1.0:1746142918.881821:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x79:0x0] (1880064->1884159) req@ffff880092d0b480 x1830962867626496/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.881826:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092d0b480 with x1830962867626496 ext(1880064->1884159) 00002000:00010000:1.0:1746142918.881828:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092d0b480 00000100:00100000:0.0:1746142918.886955:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.887016:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867627136 00000100:00100000:2.0:1746142918.887024:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867627136 00000100:00100000:2.0:1746142918.887061:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14839 00000100:00100000:2.0:1746142918.887068:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32742:x1830962867627136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142918.887081:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142918.887095:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b680 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.887117:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 6 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.887124:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.887125:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142918.887128:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.887151:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 6 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.887160:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 6 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:2.0:1746142918.887170:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867910272:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142918.887874:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9180 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.890562:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867910144:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.890581:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.890743:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092d08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867626240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 15476us (16014us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.890751:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6750 00000100:00100000:2.0:1746142918.890995:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.891030:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.891085:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867910272:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142918.891102:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 25 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142918.891114:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a2a200, rc 0) 00000100:00100000:2.0:1746142918.891136:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097349f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32742:x1830962867627136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4069us (4187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142918.891142:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14839 00000100:00100000:3.0:1746142918.891755:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867627648 00000100:00100000:3.0:1746142918.891760:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867627648 00002000:00100000:3.0:1746142918.891791:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1253376->1257471) req@ffff880096141880 x1830962867627648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.891799:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141880 with x1830962867627648 ext(1253376->1257471) 00002000:00010000:3.0:1746142918.891803:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141880 00000100:00100000:3.0:1746142918.891817:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4669 00000100:00100000:3.0:1746142918.891823:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867627648:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142918.891943:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867627648:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 118us (911us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142918.891951:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4669 00002000:00100000:3.0:1746142918.891956:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1253376->1257471) req@ffff880096141880 x1830962867627648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142918.891962:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096141880 with x1830962867627648 ext(1253376->1257471) 00002000:00010000:3.0:1746142918.891964:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096141880 00000100:00100000:1.0:1746142918.892014:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867627392 00000100:00100000:1.0:1746142918.892017:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867627392 00000100:00100000:1.0:1746142918.892042:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5351 00000100:00100000:1.0:1746142918.892046:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:32738:x1830962867627392:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:1.0:1746142918.892163:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:32738:x1830962867627392:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 116us (1169us total) trans 8589936775 rc 0/0 00000100:00100000:1.0:1746142918.892168:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5351 00000100:00100000:0.0:1746142918.892181:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.893569:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867627776 00000100:00100000:2.0:1746142918.893575:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867627776 00002000:00100000:2.0:1746142918.893598:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2539519) req@ffff88009734bb80 x1830962867627776/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.893606:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734bb80 with x1830962867627776 ext(2097152->2539519) 00010000:00010000:2.0:1746142918.893612:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 7 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.893623:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 7 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746142918.893629:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734bb80 00000100:00100000:2.0:1746142918.893642:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1451 00000100:00100000:2.0:1746142918.893646:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+7:2005:x1830962867627776:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142918.904016:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.905294:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142918.905379:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867628160 00000100:00100000:3.0:1746142918.905386:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867628160 00000100:00100000:3.0:1746142918.905423:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14840 00000100:00100000:3.0:1746142918.905429:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32747:x1830962867628160:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142918.905442:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142918.905455:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b687 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.905474:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142918.905476:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142918.905479:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 12 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.905489:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 12 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142918.905496:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c881000, rc 0) 00000100:00100000:3.0:1746142918.905527:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:32747:x1830962867628160:12345-192.168.204.50@tcp:101:cat.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142918.905531:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14840 00000100:00100000:1.0:1746142918.906057:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867628032 00000100:00100000:1.0:1746142918.906062:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867628032 00002000:00100000:1.0:1746142918.906082:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1769472->1773567) req@ffff88009734aa00 x1830962867628032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.906089:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734aa00 with x1830962867628032 ext(1769472->1773567) 00002000:00010000:1.0:1746142918.906093:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734aa00 00000100:00100000:1.0:1746142918.906108:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4670 00000100:00100000:1.0:1746142918.906112:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867628032:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142918.906188:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ad4f1515-ae46-4d91-8f96-492179af7039+12:2004:x1830962867628032:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 75us (2178us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142918.906193:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4670 00002000:00100000:1.0:1746142918.906196:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (1769472->1773567) req@ffff88009734aa00 x1830962867628032/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/4536 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.906202:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734aa00 with x1830962867628032 ext(1769472->1773567) 00002000:00010000:1.0:1746142918.906204:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009734aa00 00000100:00100000:2.0:1746142918.907335:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867627776:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 13686us (15153us total) trans 17179874050 rc 0/0 00000100:00100000:2.0:1746142918.907345:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1451 00002000:00100000:2.0:1746142918.907350:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->2539519) req@ffff88009734bb80 x1830962867627776/t17179874050(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/448 e 0 to 0 dl 1746142929 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.907356:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009734bb80 with x1830962867627776 ext(2097152->2539519) 00010000:00010000:2.0:1746142918.907361:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 10 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:2.0:1746142918.907371:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 10 pid: 1397 timeout: 792 lvb_type: 0 00002000:00010000:2.0:1746142918.907377:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009734bb80 00000100:00100000:0.0:1746142918.910296:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.910748:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867628416 00000100:00100000:2.0:1746142918.910756:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867628416 00000100:00100000:2.0:1746142918.910802:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5352 00000100:00100000:2.0:1746142918.910810:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+23:32748:x1830962867628416:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142918.911015:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+24:32748:x1830962867628416:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 205us (725us total) trans 8589936776 rc 0/0 00000100:00100000:2.0:1746142918.911022:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5352 00000100:00100000:0.0:1746142918.913564:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.913767:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867628544 00000100:00100000:1.0:1746142918.913775:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867628544 00010000:00010000:1.0:1746142918.913802:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 10 pid: 1397 timeout: 792 lvb_type: 0 00000100:00100000:1.0:1746142918.913838:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6751 00000100:00100000:1.0:1746142918.913846:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867628544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142918.913857:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142918.913873:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 10 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.913883:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 10 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.913938:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009712aa00/0x2fa243e067cce7b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b5f4 expref: 10 pid: 1397 timeout: 792 lvb_type: 0 00010000:00010000:1.0:1746142918.913953:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.913955:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.913961:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.913968:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.913975:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.913976:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142918.913979:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.913984:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142918.914009:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 9 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.914020:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867910400:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.915660:0:8381:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.915672:0:8381:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867910528:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142918.915709:0:8381:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.919037:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867910400:192.168.204.50@tcp:105: 00000100:00100000:0.0:1746142918.919417:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.919804:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867628800 00000100:00100000:2.0:1746142918.919810:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867628800 00002000:00100000:2.0:1746142918.919846:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880096af1880 x1830962867628800/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.919854:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af1880 with x1830962867628800 ext(3145728->4194303) 00002000:00010000:2.0:1746142918.919858:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af1880 00000100:00100000:2.0:1746142918.919886:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4671 00000100:00100000:2.0:1746142918.919893:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867628800:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142918.922004:0:8381:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8381:1830962867910528:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142918.922024:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142918.922055:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867628544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8210us (8497us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142918.922063:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6751 00000100:00100000:0.0:1746142918.931117:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.931152:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.931318:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867629184 00000100:00100000:1.0:1746142918.931325:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867629184 00002000:00100000:1.0:1746142918.931357:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096af3100 x1830962867629184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.931366:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3100 with x1830962867629184 ext(3145728->4194303) 00002000:00010000:1.0:1746142918.931371:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af3100 00000100:00100000:1.0:1746142918.931396:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867629312 00000100:00100000:1.0:1746142918.931398:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867629312 00002000:00100000:1.0:1746142918.931409:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096af2d80 x1830962867629312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.931415:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2d80 with x1830962867629312 ext(2097152->4194303) 00002000:00010000:1.0:1746142918.931418:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af2d80 00000100:00100000:1.0:1746142918.931430:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4672 00000100:00100000:1.0:1746142918.931437:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867629184:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142918.932024:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4673 00000100:00100000:2.0:1746142918.932033:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867629312:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142918.951323:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867628800:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 31422us (31899us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142918.951333:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4671 00002000:00100000:2.0:1746142918.951343:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->4194303) req@ffff880096af1880 x1830962867628800/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.951350:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af1880 with x1830962867628800 ext(3145728->4194303) 00002000:00010000:2.0:1746142918.951355:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af1880 00000100:00100000:1.0:1746142918.951479:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2006:x1830962867629184:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 20041us (20368us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142918.951485:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4672 00002000:00100000:1.0:1746142918.951490:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff880096af3100 x1830962867629184/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142918.951497:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af3100 with x1830962867629184 ext(3145728->4194303) 00002000:00010000:1.0:1746142918.951500:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880096af3100 00000100:00100000:2.0:1746142918.960353:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867629312:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 28314us (29191us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746142918.960362:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4673 00002000:00100000:2.0:1746142918.960372:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff880096af2d80 x1830962867629312/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.960380:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880096af2d80 with x1830962867629312 ext(2097152->4194303) 00002000:00010000:2.0:1746142918.960385:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880096af2d80 00000100:00100000:0.0:1746142918.960794:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.961565:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867629440 00000100:00100000:1.0:1746142918.961573:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867629440 00000100:00100000:1.0:1746142918.961616:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14841 00000100:00100000:1.0:1746142918.961623:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867629440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.961636:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.961649:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba200/0x2fa243e067cce8cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b68e expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.961690:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867910656:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142918.961758:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00002000:00010000:1.0:1746142918.968203:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime: 1746142918 -> 1746142919 00002000:00010000:1.0:1746142918.968219:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime: 1746142918 -> 1746142919 00002000:00010000:1.0:1746142918.968222:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime: 1746142918 -> 1746142919 00000100:00100000:1.0:1746142918.968240:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867910656:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142918.968265:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fba200/0x2fa243e067cce8cb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b68e expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.968278:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba200/0x2fa243e067cce8cb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b68e expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.968301:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba200, rc 0) 00000100:00100000:1.0:1746142918.968347:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867629440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6724us (7552us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142918.968354:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14841 00000100:00100000:0.0:1746142918.968959:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142918.968994:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.969042:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867629824 00000100:00100000:2.0:1746142918.969048:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867629824 00002000:00100000:2.0:1746142918.969079:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880088d7dc00 x1830962867629824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.969087:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7dc00 with x1830962867629824 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.969091:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7dc00 00000100:00100000:2.0:1746142918.969108:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4674 00000100:00100000:2.0:1746142918.969114:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867629824:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142918.970115:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867629696 00000100:00100000:1.0:1746142918.970120:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867629696 00000100:00100000:1.0:1746142918.970154:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14842 00000100:00100000:1.0:1746142918.970159:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867629696:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.970168:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.970180:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cce8d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b695 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.970224:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867910784:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142918.970273:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142918.977489:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867629824:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 8367us (8486us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142918.977499:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4674 00002000:00100000:2.0:1746142918.977508:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880088d7dc00 x1830962867629824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 872448/872448 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.977516:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7dc00 with x1830962867629824 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.977522:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7dc00 00002000:00010000:1.0:1746142918.978442:0:1397:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746142918 -> 1746142919 00002000:00010000:1.0:1746142918.978446:0:1397:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746142918 -> 1746142919 00002000:00010000:1.0:1746142918.978448:0:1397:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746142918 -> 1746142919 00000100:00100000:1.0:1746142918.978461:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867910784:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142918.978483:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cce8d2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b695 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.978494:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fbaa00/0x2fa243e067cce8d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b695 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.978513:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbaa00, rc 0) 00000100:00100000:1.0:1746142918.978534:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867629696:12345-192.168.204.50@tcp:101:cat.0 Request processed in 8375us (9576us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142918.978539:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14842 00000100:00100000:0.0:1746142918.983220:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.983296:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630080 00000100:00100000:2.0:1746142918.983303:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630080 00002000:00100000:2.0:1746142918.983338:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880088d7ed80 x1830962867630080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/0 e 0 to 0 dl 1746142929 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.983346:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ed80 with x1830962867630080 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.983350:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7ed80 00000100:00100000:2.0:1746142918.983375:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4675 00000100:00100000:2.0:1746142918.983382:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867630080:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142918.988192:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142918.988582:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867630080:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5198us (5375us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142918.988591:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4675 00002000:00100000:2.0:1746142918.988601:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff880088d7ed80 x1830962867630080/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:69/0 lens 488/440 e 0 to 0 dl 1746142929 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142918.988614:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880088d7ed80 with x1830962867630080 ext(4194304->5066751) 00002000:00010000:2.0:1746142918.988618:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880088d7ed80 00000100:00100000:1.0:1746142918.988728:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630208 00000100:00100000:1.0:1746142918.988735:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630208 00000100:00100000:1.0:1746142918.988774:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14843 00000100:00100000:1.0:1746142918.988780:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867630208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.988792:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.988804:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd83400/0x2fa243e067cce8d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b69c expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.988844:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867910912:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142918.988891:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142918.995676:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867910912:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142918.995706:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83400/0x2fa243e067cce8d9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b69c expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.995718:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83400/0x2fa243e067cce8d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b69c expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142918.996443:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83400, rc 0) 00000100:00100000:1.0:1746142918.996493:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867630208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7711us (8306us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142918.996500:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14843 00000100:00100000:0.0:1746142918.998368:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142918.998443:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630336 00000100:00100000:1.0:1746142918.998450:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630336 00000100:00100000:1.0:1746142918.998491:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14844 00000100:00100000:1.0:1746142918.998497:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867630336:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142918.998511:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142918.998522:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067cce8e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6a3 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142918.998560:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911040:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142918.999865:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.000248:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911040:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142919.000268:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067cce8e0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6a3 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.000277:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83600/0x2fa243e067cce8e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6a3 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.000285:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83600, rc 0) 00000100:00100000:1.0:1746142919.000311:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867630336:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1814us (1947us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142919.000321:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14844 00000100:00100000:0.0:1746142919.005397:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.005463:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630464 00000100:00100000:1.0:1746142919.005471:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630464 00000100:00100000:1.0:1746142919.005521:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14845 00000100:00100000:1.0:1746142919.005529:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867630464:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.005543:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.005556:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067cce8e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6aa expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.005598:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911168:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142919.005673:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00080000:0.0:1746142919.005823:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746142919.007871:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911168:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142919.007894:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067cce8e7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6aa expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.007927:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd83e00/0x2fa243e067cce8e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6aa expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.007939:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:1.0:1746142919.007976:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880088d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867630464:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2448us (2586us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142919.007982:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14845 00000100:00100000:0.0:1746142919.013248:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.013329:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630592 00000100:00100000:1.0:1746142919.013337:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630592 00000100:00100000:1.0:1746142919.013387:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14846 00000100:00100000:1.0:1746142919.013394:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867630592:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.013409:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.013424:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cd82400/0x2fa243e067cce8ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6b1 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.013470:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911296:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142919.014305:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130e60b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.015733:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911296:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142919.015752:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cd82400/0x2fa243e067cce8ee lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b1 expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.015762:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cd82400/0x2fa243e067cce8ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b1 expref: 10 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.015772:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd82400, rc 0) 00000100:00100000:0.0:1746142919.015856:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867630592:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2461us (2614us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142919.015862:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14846 00000100:00100000:0.0:1746142919.019007:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.019138:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630848 00000100:00100000:1.0:1746142919.019145:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630848 00000100:00080000:0.0:1746142919.019228:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746142919.019322:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5353 00000100:00100000:1.0:1746142919.019330:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+24:32747:x1830962867630848:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1746142919.019484:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+25:32747:x1830962867630848:12345-192.168.204.50@tcp:35:cat.0 Request processed in 154us (483us total) trans 8589936777 rc 0/0 00000100:00100000:1.0:1746142919.019490:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5353 00000100:00100000:0.0:1746142919.038520:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.038606:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867630976 00000100:00100000:3.0:1746142919.038614:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867630976 00000100:00100000:3.0:1746142919.038812:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14578 00000100:00100000:3.0:1746142919.038972:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:32756:x1830962867630976:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142919.038991:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142919.039005:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce8f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6b8 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.039051:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039061:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039071:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039079:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039084:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039088:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039197:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039216:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039222:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:3.0:1746142919.039255:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142919.039259:0:13326:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142919.039271:0:13326:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039278:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039282:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039287:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039291:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039296:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142919.039299:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039303:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039315:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142919.039317:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142919.039320:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039324:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881400/0x2fa243e067cce8fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039347:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039352:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039356:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039359:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c880e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142919.039362:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039365:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039370:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff88009a9d3500) 00010000:00010000:3.0:1746142919.039372:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142919.039373:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039377:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c880e00/0x2fa243e067cce903 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.039397:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c881e00/0x2fa243e067cce8f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.039405:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.039411:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142919.039413:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142919.039414:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc07600, rc 0) 00000100:00100000:3.0:1746142919.039462:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:32756:x1830962867630976:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 492us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.039468:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14578 00000100:00100000:0.0:1746142919.041602:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.043509:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867631104 00000100:00100000:2.0:1746142919.043518:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867631104 00000100:00100000:2.0:1746142919.043564:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14847 00000100:00100000:2.0:1746142919.043570:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+9:2003:x1830962867631104:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142919.043583:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.043595:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c2f600/0x2fa243e067cce911 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6bf expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142919.043631:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911424:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142919.043690:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00080000:2.0:1746142919.043705:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746142919.043740:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.043796:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.043853:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.043881:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867631232 00000100:00100000:3.0:1746142919.043885:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867631232 00000100:00100000:3.0:1746142919.043928:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867631360 00000100:00100000:3.0:1746142919.043930:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867631360 00000100:00080000:2.0:1746142919.043947:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746142919.043954:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867631488 00000100:00100000:3.0:1746142919.043956:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867631488 00000100:00100000:3.0:1746142919.043968:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14848 00000100:00100000:3.0:1746142919.043973:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+12:2003:x1830962867631232:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:1.0:1746142919.043974:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14849 00010000:00010000:3.0:1746142919.043979:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142919.043981:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+12:2004:x1830962867631360:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142919.043986:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce918 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6c6 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.043988:0:1852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.043995:0:1852:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6cd expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.044005:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.044006:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746142919.044010:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867911552:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142919.044012:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.044029:0:1852:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 13 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.044036:0:1852:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cd83e00, rc 0) 00000100:00100000:3.0:1746142919.044044:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.044057:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14850 00000100:00100000:3.0:1746142919.044063:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867631488:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:1.0:1746142919.044066:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+13:2004:x1830962867631360:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 86us (270us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142919.044069:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142919.044071:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14849 00010000:00010000:3.0:1746142919.044074:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6d4 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.044084:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.044086:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.044090:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.044105:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 14 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.044111:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670600, rc 0) 00000100:00100000:3.0:1746142919.044126:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867631488:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.044131:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14850 00000100:00100000:0.0:1746142919.047136:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867911552:192.168.204.50@tcp:106: 00010000:00010000:0.0:1746142919.047162:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce918 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6c6 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.047173:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c880c00/0x2fa243e067cce918 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6c6 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.047197:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c880c00, rc 0) 00000100:00100000:2.0:1746142919.047303:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096142a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1397:1830962867911424:192.168.204.50@tcp:106: 00010000:00010000:2.0:1746142919.047320:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c2f600/0x2fa243e067cce911 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6bf expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.047328:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c2f600/0x2fa243e067cce911 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6bf expref: 12 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.047337:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2f600, rc 0) 00000100:00100000:0.0:1746142919.047657:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+11:2003:x1830962867631232:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 3681us (3915us total) trans 0 rc 301/301 00000100:00100000:0.0:1746142919.047664:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14848 00000100:00100000:2.0:1746142919.047766:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2003:x1830962867631104:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 4195us (6168us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142919.047772:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14847 00000100:00100000:0.0:1746142919.049680:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.049741:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867631744 00000100:00100000:3.0:1746142919.049747:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867631744 00000100:00100000:3.0:1746142919.049780:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14579 00000100:00100000:3.0:1746142919.049786:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+11:32756:x1830962867631744:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:3.0:1746142919.049800:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142919.049813:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671800/0x2fa243e067cce92d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6db expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.049886:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.049897:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.049940:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.049963:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.049977:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 12 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.049987:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867911680:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142919.053281:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.055539:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867911680:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.055557:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:0.0:1746142919.056995:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.062659:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867631872 00000100:00100000:1.0:1746142919.062668:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867631872 00010000:00010000:1.0:1746142919.062698:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 13 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.062732:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6752 00000100:00100000:1.0:1746142919.062737:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a730bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867631872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.062749:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.062753:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 13 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.062762:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 13 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.062779:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc07600/0x2fa243e067cce90a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6b8 expref: 13 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.062793:0:8381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.062798:0:8381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.062806:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.062811:0:8381:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.062836:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142919.062872:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a730bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867631872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 134us (5880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.062878:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6752 00010000:00010000:2.0:1746142919.062968:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.062974:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142919.062989:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142919.063088:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671800/0x2fa243e067cce92d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6db expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.063103:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6db expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.063109:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.063111:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142919.063113:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671200, rc 0) 00000100:00100000:2.0:1746142919.063136:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32756:x1830962867631744:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 13350us (13460us total) trans 8589936778 rc 0/0 00000100:00100000:2.0:1746142919.063142:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14579 00000100:00100000:2.0:1746142919.067324:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.067406:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632128 00000100:00100000:0.0:1746142919.067414:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632128 00000100:00100000:0.0:1746142919.067456:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14580 00000100:00100000:0.0:1746142919.067463:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+12:32756:x1830962867632128:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:0.0:1746142919.067484:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.067487:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746142919.067507:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e671200/0x2fa243e067cce934 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6db expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.067538:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.067542:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142919.067552:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067cce942 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6e2 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.067627:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130600/0x2fa243e067cce949 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142919.067637:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880096130600/0x2fa243e067cce949 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:0.0:1746142919.067644:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880096130600/0x2fa243e067cce949 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:0.0:1746142919.067653:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:0.0:1746142919.067724:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130c00/0x2fa243e067cce942 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6e2 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.067734:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130600/0x2fa243e067cce949 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6e2 expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.067740:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.067743:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746142919.067744:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880096130600, rc 0) 00000100:00100000:0.0:1746142919.067788:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:32756:x1830962867632128:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 325us (470us total) trans 8589936779 rc 0/0 00000100:00100000:0.0:1746142919.067793:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14580 00000100:00100000:1.0:1746142919.072135:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.072758:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632256 00000100:00100000:2.0:1746142919.072765:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632256 00000100:00100000:2.0:1746142919.072810:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14581 00000100:00100000:2.0:1746142919.072817:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:32756:x1830962867632256:12345-192.168.204.50@tcp:101:mirror_io.0 00010000:00010000:2.0:1746142919.072833:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.072847:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f000/0x2fa243e067cce957 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6e9 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.072888:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f000/0x2fa243e067cce957 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6e9 expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.072920:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f000/0x2fa243e067cce957 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6e9 expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.072933:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.072935:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142919.072938:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c2f000, rc 0) 00000100:00100000:2.0:1746142919.076687:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:32756:x1830962867632256:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 3858us (4548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.076698:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14581 00000100:00100000:0.0:1746142919.083734:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.083862:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632384 00000100:00100000:2.0:1746142919.083870:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632384 00000100:00100000:2.0:1746142919.083934:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14851 00000100:00100000:2.0:1746142919.083940:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+13:2006:x1830962867632384:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:2.0:1746142919.083974:0:1397:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.083988:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.085287:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 48 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.085295:0:1397:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.085301:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.085303:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.085414:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 6/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.085447:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 13 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.085457:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 13 pid: 9579 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746142919.085468:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867911808:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.085472:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.085487:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.085507:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.085538:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632512 00000100:00100000:0.0:1746142919.085543:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632512 00010000:00010000:2.0:1746142919.085547:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 48 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.085554:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 48 pid: 9578 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746142919.085561:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867911936:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142919.085564:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632640 00000100:00100000:0.0:1746142919.085565:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632640 00000100:00100000:0.0:1746142919.085573:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632896 00000100:00100000:0.0:1746142919.085574:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632896 00000100:00100000:0.0:1746142919.085592:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14852 00000100:00100000:0.0:1746142919.085599:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867632512:12345-192.168.204.50@tcp:1:mirror_io.0 00000100:00100000:3.0:1746142919.085622:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14853 00010000:00010000:0.0:1746142919.085622:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.085628:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+11:2005:x1830962867632640:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:0.0:1746142919.085632:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.085637:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142919.085638:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142919.085640:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.085641:0:1853:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.085649:0:1853:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 24 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.085654:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142919.085654:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.085655:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746142919.085657:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.085662:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 8 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.085669:0:1853:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 24 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.085669:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867912064:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.085676:0:1853:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 24 pid: 1397 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.085683:0:1853:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867912192:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.085723:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14854 00010000:00010000:2.0:1746142919.085724:0:1397:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 23 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.085729:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867632896:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:2.0:1746142919.085731:0:1397:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 23 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.085744:0:12211:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.085752:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.085758:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 14 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.085763:0:12211:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 23 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.085771:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.085772:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.085773:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.085786:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 23 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.085792:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 23 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.085799:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867912448:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.085822:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 14 pid: 1852 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.085830:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 14 pid: 1852 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.085837:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867912576:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.085857:0:12211:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 48 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.085863:0:12211:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 48 pid: 1397 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.085875:0:12211:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867912704:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.085891:0:12211:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.085957:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.085969:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867632768 00000100:00100000:1.0:1746142919.085971:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867632768 00000100:00100000:1.0:1746142919.085988:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14855 00000100:00100000:1.0:1746142919.085992:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+15:2006:x1830962867632768:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:1.0:1746142919.086006:0:1852:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086014:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 15 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.086020:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 48 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.086025:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086029:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.086030:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.086032:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 6/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086045:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086056:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.086064:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867912832:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.086088:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 48 pid: 9579 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.086095:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 48 pid: 9579 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.086102:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867912960:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.086121:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 15 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.086127:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 15 pid: 12211 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.086134:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867913088:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.086144:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c51c300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.086184:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.086200:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633024 00000100:00100000:1.0:1746142919.086203:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633024 00000100:00100000:1.0:1746142919.086233:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14856 00000100:00100000:1.0:1746142919.086237:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+12:2006:x1830962867633024:12345-192.168.204.50@tcp:1:mirror_io.0 00010000:00010000:1.0:1746142919.086251:0:9580:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086259:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086264:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.086270:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086274:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.086275:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.086276:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086287:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 8 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086293:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 8 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.086299:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867913216:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.086318:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 12 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.086328:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 12 pid: 1853 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.086335:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867913344:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.086349:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 24 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.086356:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 24 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.086362:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867913472:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.086371:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c51cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.086670:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.086857:0:1853:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092179f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142919.087045:0:1397:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867912320:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.087185:0:1397:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.098792:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.098809:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.098933:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867911808:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.098945:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867911936:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.098971:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867912832:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.098978:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867912960:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.098984:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867913088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.099006:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142919.099028:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d08000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867913216:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.099034:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867913344:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.099041:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867913472:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.099054:0:9580:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.099136:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bce300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867912448:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.099143:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867912576:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.099149:0:12211:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12211:1830962867912704:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.099162:0:12211:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.099387:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.099414:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.099425:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.099454:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867912064:192.168.204.50@tcp:104: 00010000:00010000:0.0:1746142919.099467:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.099485:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633280 00000100:00100000:0.0:1746142919.099489:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633280 00010000:00010000:0.0:1746142919.099516:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 49 pid: 9578 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746142919.099535:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633536 00000100:00100000:0.0:1746142919.099537:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633536 00010000:00010000:0.0:1746142919.099545:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 24 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.099554:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633152 00000100:00100000:0.0:1746142919.099555:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633152 00010000:00010000:0.0:1746142919.099561:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 16 pid: 9579 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746142919.099567:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633408 00000100:00100000:0.0:1746142919.099568:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633408 00010000:00010000:0.0:1746142919.099573:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 17 pid: 1852 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746142919.099579:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634048 00000100:00100000:0.0:1746142919.099580:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634048 00010000:00010000:0.0:1746142919.099586:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 50 pid: 9579 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746142919.099595:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6753 00000100:00100000:0.0:1746142919.099601:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+50:2004:x1830962867633280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.099611:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.099627:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 50 pid: 9578 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.099634:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 50 pid: 9578 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.099651:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c3be00/0x2fa243e067cce591 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4d5 expref: 50 pid: 9578 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.099666:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142919.099728:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6754 00000100:00100000:1.0:1746142919.099734:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+24:2004:x1830962867633536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.099740:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.099748:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 24 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.099755:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 24 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.099765:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b2a0800/0x2fa243e067cce8af lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b672 expref: 24 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.099776:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.100255:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6755 00000100:00100000:3.0:1746142919.100262:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+17:2004:x1830962867633152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.100269:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.100277:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 17 pid: 9579 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746142919.100284:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 17 pid: 9579 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746142919.100293:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cce4c6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b442 expref: 17 pid: 9579 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746142919.100305:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.100779:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6756 00000100:00100000:2.0:1746142919.100787:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+16:2004:x1830962867633408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142919.100793:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142919.100802:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 16 pid: 1852 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.100809:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 16 pid: 1852 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.100818:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83e00/0x2fa243e067cce91f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6cd expref: 16 pid: 1852 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.100835:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142919.101446:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:ad4f1515-ae46-4d91-8f96-492179af7039+23:2004:x1830962867633536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1710us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.101453:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6754 00000100:00100000:1.0:1746142919.101470:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6757 00000100:00100000:1.0:1746142919.101475:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+49:2004:x1830962867634048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.101482:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.101490:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 49 pid: 9579 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.101498:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 49 pid: 9579 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.101509:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091fc3600/0x2fa243e067cce598 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b4e3 expref: 49 pid: 9579 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.101517:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142919.101533:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+48:2004:x1830962867634048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 58us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.101545:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6757 00000100:00100000:3.0:1746142919.101659:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097430000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8243383-433c-45fe-9bef-8828afa9ff81+15:2004:x1830962867633152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1397us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.101665:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6755 00000100:00100000:2.0:1746142919.101702:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c8243383-433c-45fe-9bef-8828afa9ff81+14:2004:x1830962867633408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 916us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.101707:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6756 00000100:00080000:2.0:1746142919.101726:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142919.101763:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867633280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2161us (2976us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.101768:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6753 00000100:00100000:3.0:1746142919.101957:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.102013:0:1853:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:1853:1830962867912192:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.102026:0:1853:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.102045:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.102081:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.102088:0:1397:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1397:1830962867912320:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142919.102089:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634560 00000100:00100000:0.0:1746142919.102093:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634560 00010000:00010000:3.0:1746142919.102104:0:1397:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102104:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 47 pid: 1397 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.102116:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633664 00000100:00100000:0.0:1746142919.102118:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633664 00010000:00010000:0.0:1746142919.102124:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 14 pid: 12211 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746142919.102135:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6758 00000100:00100000:0.0:1746142919.102140:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+47:2004:x1830962867634560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.102146:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.102153:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 47 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102160:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 47 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102170:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093378600/0x2fa243e067cce869 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b64f expref: 47 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102178:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.102180:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.102184:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102190:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.102193:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6759 00000100:00100000:1.0:1746142919.102200:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4839c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867633664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.102223:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142919.102228:0:12211:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.102237:0:12211:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.102241:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+46:2004:x1830962867634560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.102245:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6758 00010000:00010000:1.0:1746142919.102251:0:12211:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.102257:0:12211:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.102263:0:12211:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.102269:0:12211:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cd83600 already unused, calling callback (ffffffffa087bd70) 00000100:00100000:0.0:1746142919.102269:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142919.102272:0:12211:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.102279:0:12211:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.102279:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633920 00000100:00100000:0.0:1746142919.102281:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633920 00010000:00010000:1.0:1746142919.102288:0:12211:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102290:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 13 pid: 1853 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.102293:0:12211:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cd83600/0x2fa243e067cce973 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.102307:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6760 00000100:00100000:0.0:1746142919.102312:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+13:2005:x1830962867633920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746142919.102316:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634304 00000100:00100000:2.0:1746142919.102318:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634304 00010000:00010000:0.0:1746142919.102318:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142919.102327:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c8243383-433c-45fe-9bef-8828afa9ff81+14:2005:x1830962867632896:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 16598us (16819us total) trans 0 rc 0/0 00010000:00010000:0.0:1746142919.102327:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 13 pid: 1853 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.102333:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 13 pid: 1853 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.102334:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14854 00002000:00100000:2.0:1746142919.102341:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1253376->1773567) req@ffff880092134000 x1830962867634304/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746142919.102343:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e670600/0x2fa243e067cce926 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6d4 expref: 13 pid: 1853 timeout: 793 lvb_type: 1 00002000:00100000:2.0:1746142919.102348:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134000 with x1830962867634304 ext(1253376->1773567) 00010000:00010000:1.0:1746142919.102348:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.102350:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142919.102353:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 9 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.102356:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 13 pid: 12211 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.102361:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 9 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.102363:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867633920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (94us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142919.102364:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 13 pid: 12211 timeout: 793 lvb_type: 1 00002000:00010000:2.0:1746142919.102366:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134000 00000100:00100000:0.0:1746142919.102368:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6760 00010000:00010000:1.0:1746142919.102374:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cc79200/0x2fa243e067cce4b1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b457 expref: 13 pid: 12211 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746142919.102378:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1452 00010000:00010000:1.0:1746142919.102382:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.102383:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867634304:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1746142919.102395:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4839c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8243383-433c-45fe-9bef-8828afa9ff81+12:2005:x1830962867633664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 196us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.102398:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.102400:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6759 00000100:00100000:0.0:1746142919.102416:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.102424:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867633792 00000100:00100000:0.0:1746142919.102426:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867633792 00010000:00010000:0.0:1746142919.102434:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.102443:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.102486:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634432 00000100:00100000:2.0:1746142919.102489:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634432 00002000:00100000:2.0:1746142919.102506:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1101824->1884159) req@ffff880135d70a80 x1830962867634432/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.102512:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d70a80 with x1830962867634432 ext(1101824->1884159) 00010000:00010000:2.0:1746142919.102517:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 25 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.102524:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 25 pid: 1397 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746142919.102529:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d70a80 00000100:00100000:2.0:1746142919.102539:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1453 00000100:00100000:2.0:1746142919.102544:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867634432:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1746142919.102562:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634176 00000100:00100000:0.0:1746142919.102565:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634176 00010000:00010000:0.0:1746142919.102576:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.102589:0:7219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6761 00000100:00100000:1.0:1746142919.102596:0:7219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+11:2005:x1830962867633792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746142919.102597:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6762 00000100:00100000:0.0:1746142919.102602:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867634176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.102603:0:7219:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.102608:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.102610:0:7219:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 11 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102614:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.102618:0:7219:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 11 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102621:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102632:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880096130000/0x2fa243e067cce528 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b48f expref: 23 pid: 12211 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102639:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.102641:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.102643:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102649:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102662:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.102676:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867634176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.102681:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6762 00000100:00100000:0.0:1746142919.102727:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1746142919.102737:0:7219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881000/0x2fa243e067cce8c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b687 expref: 11 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.102739:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634688 00000100:00100000:0.0:1746142919.102741:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634688 00010000:00010000:1.0:1746142919.102747:0:7219:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142919.102751:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 26 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.102761:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6763 00000100:00100000:1.0:1746142919.102762:0:7219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867633792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.102765:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867634688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142919.102767:0:7219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6761 00010000:00010000:0.0:1746142919.102771:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.102777:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 26 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102783:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 26 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102793:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a2a200/0x2fa243e067cce8bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b680 expref: 26 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.102799:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.102800:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.102803:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102808:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.102834:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1746142919.102851:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746142919.102860:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.102867:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.102878:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.102884:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.102889:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.102894:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc06600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142919.102896:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.102915:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.102920:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867634688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 153us (192us total) trans 0 rc 0/0 00010000:00010000:3.0:1746142919.102923:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.102928:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6763 00010000:00010000:3.0:1746142919.102932:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc06600/0x2fa243e067cce97a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.102961:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867632768:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 16968us (17004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.102961:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.102967:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14855 00000100:00100000:0.0:1746142919.102970:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634816 00000100:00100000:0.0:1746142919.102972:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634816 00010000:00010000:0.0:1746142919.102980:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 22 pid: 1397 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.102991:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6764 00000100:00100000:0.0:1746142919.102994:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+22:2005:x1830962867634816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.102999:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.103004:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 22 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.103010:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 22 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.103020:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb25400/0x2fa243e067cce45d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b418 expref: 22 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.103027:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.103028:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.103030:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103032:0:9580:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.103035:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103038:0:9580:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103048:0:9580:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.103048:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142919.103052:0:9580:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103058:0:9580:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.103058:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+21:2005:x1830962867634816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64us (98us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142919.103063:0:9580:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092733a00 already unused, calling callback (ffffffffa087bd70) 00000100:00100000:0.0:1746142919.103063:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6764 00010000:00010000:1.0:1746142919.103065:0:9580:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103070:0:9580:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103078:0:9580:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.103082:0:9580:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092733a00/0x2fa243e067cce981 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.103113:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c8243383-433c-45fe-9bef-8828afa9ff81+11:2006:x1830962867633024:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 16875us (16929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.103118:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14856 00010000:00010000:3.0:1746142919.103398:0:1397:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103530:0:1397:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103542:0:1397:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103547:0:1397:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103552:0:1397:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103556:0:1397:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c2ee00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142919.103558:0:1397:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103563:0:1397:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103572:0:1397:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.103577:0:1397:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c2ee00/0x2fa243e067cce95e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.103724:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867632384:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 19783us (19996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.103730:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14851 00000100:00100000:0.0:1746142919.114385:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867634304:12345-192.168.204.50@tcp:4:cat.0 Request processed in 11994us (12420us total) trans 17179874051 rc 0/0 00000100:00100000:0.0:1746142919.114395:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1452 00002000:00100000:0.0:1746142919.114407:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1253376->1773567) req@ffff880092134000 x1830962867634304/t17179874051(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/448 e 0 to 0 dl 1746142930 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142919.114415:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092134000 with x1830962867634304 ext(1253376->1773567) 00010000:00010000:0.0:1746142919.114424:0:29472:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.114434:0:29472:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00002000:00010000:0.0:1746142919.114440:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092134000 00000100:00100000:2.0:1746142919.117500:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867634432:12345-192.168.204.50@tcp:4:cat.0 Request processed in 14948us (15093us total) trans 17179874052 rc 0/0 00000100:00100000:2.0:1746142919.117510:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1453 00002000:00100000:2.0:1746142919.117519:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1101824->1884159) req@ffff880135d70a80 x1830962867634432/t17179874052(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/448 e 0 to 0 dl 1746142930 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.117527:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d70a80 with x1830962867634432 ext(1101824->1884159) 00010000:00010000:2.0:1746142919.117535:0:9585:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.117547:0:9585:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746142919.117553:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135d70a80 00000100:00100000:0.0:1746142919.125310:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.125391:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867634944 00000100:00100000:2.0:1746142919.125399:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867634944 00010000:00010000:2.0:1746142919.125428:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.125504:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6765 00000100:00100000:2.0:1746142919.125511:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867634944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142919.125523:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142919.125539:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.125548:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.125565:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b2a0e00/0x2fa243e067cce8b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1773567) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b679 expref: 10 pid: 9578 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.125815:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.125818:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.125822:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.125829:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.125858:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142919.126729:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126737:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126755:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126761:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126767:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126773:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c881e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142919.126775:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126781:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126790:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.126795:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c881e00/0x2fa243e067cce965 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142919.127662:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.127740:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c8243383-433c-45fe-9bef-8828afa9ff81+10:2006:x1830962867632512:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 42140us (42265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.127749:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14852 00000100:00100000:2.0:1746142919.127812:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867634944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2301us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.127819:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6765 00010000:00010000:2.0:1746142919.129513:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746142919.129522:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867635072 00000100:00100000:2.0:1746142919.129530:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867635072 00010000:00010000:2.0:1746142919.129555:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.129723:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6766 00000100:00100000:3.0:1746142919.129731:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867635072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.129742:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.129757:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.129766:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.129782:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800982c7400/0x2fa243e067cce8a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1884159) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b66b expref: 26 pid: 1397 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.129797:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.129799:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.129803:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129813:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129840:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746142919.129857:0:1853:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129864:0:1853:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129875:0:1853:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129881:0:1853:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129886:0:1853:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129891:0:1853:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e670c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142919.129894:0:1853:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129923:0:1853:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129932:0:1853:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.129936:0:1853:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e670c00/0x2fa243e067cce96c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.129990:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867632640:12345-192.168.204.50@tcp:1:mirror_io.0 Request processed in 44362us (44501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.129997:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14853 00000100:00100000:3.0:1746142919.130020:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867635072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 291us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.130025:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6766 00000100:00100000:0.0:1746142919.132364:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.132426:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867635328 00000100:00100000:2.0:1746142919.132432:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867635328 00000100:00100000:2.0:1746142919.132461:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14582 00000100:00100000:2.0:1746142919.132466:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+14:32756:x1830962867635328:12345-192.168.204.50@tcp:36:mirror_io.0 00010000:00010000:2.0:1746142919.132498:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142919.132513:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c2f000/0x2fa243e067cce957 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6e9 expref: 14 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132626:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.132630:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142919.132661:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.132670:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 24 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132676:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132681:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132686:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 41 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132693:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.132715:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 41 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132724:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 41 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.132734:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913600:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.132961:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 41 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.132968:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 41 pid: 7232 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.132975:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913728:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.133006:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.133012:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.133019:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913856:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.133040:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 24 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.133047:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 24 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.133057:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913984:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.133071:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.138731:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.138845:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913600:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142919.138947:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.138960:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867635712 00000100:00100000:0.0:1746142919.138964:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867635712 00000100:00100000:1.0:1746142919.139047:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867635584 00000100:00100000:1.0:1746142919.139049:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867635584 00000100:00100000:1.0:1746142919.139077:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5354 00000100:00100000:1.0:1746142919.139084:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:27292:x1830962867635584:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746142919.139248:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+44:27292:x1830962867635584:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 164us (522us total) trans 8589936780 rc 0/0 00000100:00100000:1.0:1746142919.139254:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5354 00000100:00100000:2.0:1746142919.139309:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913728:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.139315:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.139320:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867913984:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.139341:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.139397:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 43 pid: 7232 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.139420:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6767 00000100:00100000:0.0:1746142919.139424:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+43:2005:x1830962867635712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.139432:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.139436:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 43 pid: 7232 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.139444:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 43 pid: 7232 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.139459:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce536 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b49d expref: 43 pid: 7232 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.139477:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.139481:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.139487:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.139500:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867635712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.139504:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6767 00000100:00100000:0.0:1746142919.139525:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.139534:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867635968 00000100:00100000:0.0:1746142919.139537:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867635968 00010000:00010000:0.0:1746142919.139544:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 25 pid: 13326 timeout: 793 lvb_type: 0 00000100:00080000:3.0:1746142919.139650:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142919.140055:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6768 00000100:00100000:0.0:1746142919.140061:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+25:2005:x1830962867635968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.140069:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.140072:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 25 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.140080:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 25 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.140089:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130200/0x2fa243e067cce521 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b488 expref: 25 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:0.0:1746142919.140096:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.140098:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.140103:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.140117:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867635968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.140122:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6768 00000100:00100000:0.0:1746142919.140335:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.140379:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867635840 00000100:00100000:1.0:1746142919.140383:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867635840 00010000:00010000:1.0:1746142919.140393:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.140664:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6769 00000100:00100000:1.0:1746142919.140669:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+24:2005:x1830962867635840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.140675:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.140678:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.140685:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.140695:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce52f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b496 expref: 24 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.140702:0:11911:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.140704:0:11911:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.140709:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746142919.140723:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+23:2005:x1830962867635840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 55us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.140728:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6769 00000100:00100000:0.0:1746142919.142605:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.142721:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867636096 00000100:00100000:3.0:1746142919.142727:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867636096 00010000:00010000:3.0:1746142919.142746:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 42 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.142778:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6770 00000100:00100000:3.0:1746142919.142784:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+42:2005:x1830962867636096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.142794:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.142799:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 42 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.142808:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 42 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.142834:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d76a00/0x2fa243e067cce7e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b602 expref: 42 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.142864:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142919.142867:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.142874:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.142879:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.142929:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.142958:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+41:2005:x1830962867636096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.142964:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6770 00010000:00010000:0.0:1746142919.143298:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.143304:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000040:00080000:0.0:1746142919.143495:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].698, 88 off69144 00000004:00080000:0.0:1746142919.143500:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142600166ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143520:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].778, 88 off76280 00000004:00080000:0.0:1746142919.143524:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142624286ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143535:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].779, 88 off76368 00000004:00080000:0.0:1746142919.143537:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142637249ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143544:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].699, 88 off69232 00000004:00080000:0.0:1746142919.143546:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142646507ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143553:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].700, 88 off69320 00000004:00080000:0.0:1746142919.143555:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142655004ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143563:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].780, 88 off76456 00000004:00080000:0.0:1746142919.143565:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142665303ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143571:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].781, 88 off76544 00000004:00080000:0.0:1746142919.143574:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142673883ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143580:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].701, 88 off69408 00000004:00080000:0.0:1746142919.143582:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142682309ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143589:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].782, 88 off76632 00000004:00080000:0.0:1746142919.143591:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142691752ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143598:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].702, 88 off69496 00000004:00080000:0.0:1746142919.143600:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142700506ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143607:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].783, 88 off76720 00000004:00080000:0.0:1746142919.143609:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142709194ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143616:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].703, 88 off69584 00000004:00080000:0.0:1746142919.143618:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142718033ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143624:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].784, 88 off76808 00000004:00080000:0.0:1746142919.143627:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142726892ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143708:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].704, 88 off69672 00000004:00080000:0.0:1746142919.143712:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142812382ns, next at 629431245375ns, rc = 0 00000040:00080000:0.0:1746142919.143724:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].785, 88 off76896 00000004:00080000:0.0:1746142919.143726:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142826754ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143734:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].786, 88 off76984 00000004:00080000:0.0:1746142919.143737:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693142836968ns, next at 629431169684ns, rc = 0 00000040:00080000:0.0:1746142919.143745:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].705, 88 off69760 00000004:00080000:0.0:1746142919.143747:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693142847056ns, next at 629431245375ns, rc = 0 00000001:00080000:3.0:1746142919.147179:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936781 is committed 00000004:00080000:3.0:1746142919.147189:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 693 committed 00000004:00080000:3.0:1746142919.147724:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 774 committed 00000100:00100000:2.0:1746142919.148377:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867914496:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.148428:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.148450:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867915008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.148464:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.148496:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867914368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142919.148643:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 773 committed 00000004:00080000:3.0:1746142919.148645:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 692 committed 00000004:00080000:3.0:1746142919.148647:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 772 committed 00000004:00080000:3.0:1746142919.148648:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 691 committed 00000004:00080000:3.0:1746142919.148649:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 771 committed 00000004:00080000:3.0:1746142919.148651:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 690 committed 00000004:00080000:3.0:1746142919.148652:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 770 committed 00000004:00080000:3.0:1746142919.148653:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 689 committed 00000004:00080000:3.0:1746142919.148654:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 769 committed 00000004:00080000:3.0:1746142919.148655:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 768 committed 00000004:00080000:3.0:1746142919.148656:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 688 committed 00000004:00080000:3.0:1746142919.148657:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 687 committed 00000004:00080000:3.0:1746142919.148658:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 767 committed 00000004:00080000:3.0:1746142919.148659:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 766 committed 00000004:00080000:3.0:1746142919.148661:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 686 committed 00000001:00080000:3.0:1746142919.148668:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936780 is committed 00000001:00080000:3.0:1746142919.148676:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936777 is committed 00000100:00100000:3.0:1746142919.148730:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867914112:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.148749:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867914240:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1746142919.148818:0:7230:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009734f100 reply state ffff88009cf57800 transno 8589936781 ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.148833:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.148840:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.148843:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746142919.148845:0:7230:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746142919.148928:0:7230:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746142919.148939:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32756:x1830962867635328:12345-192.168.204.50@tcp:36:mirror_io.0 Request processed in 16471us (16580us total) trans 8589936781 rc 0/0 00000100:00100000:0.0:1746142919.148947:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14582 00010000:00010000:0.0:1746142919.148973:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.148980:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.148985:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.148989:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:0.0:1746142919.148993:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.149001:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.149009:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.149011:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746142919.149013:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:0.0:1746142919.149017:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce988 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00000100:00100000:2.0:1746142919.150274:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746142919.150280:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867915136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.150304:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.150325:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914496 00000100:00100000:2.0:1746142919.150332:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914496 00000100:00100000:2.0:1746142919.150361:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915008 00000100:00100000:2.0:1746142919.150363:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915008 00000100:00100000:2.0:1746142919.150372:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915136 00000100:00100000:2.0:1746142919.150373:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915136 00000100:00100000:2.0:1746142919.150388:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14857 00000100:00100000:2.0:1746142919.150393:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3764:x1830962867914496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.150512:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3764:x1830962867914496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (2084us total) trans 21474841303 rc 0/0 00000100:00100000:2.0:1746142919.150517:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14857 00000100:00100000:2.0:1746142919.150527:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14858 00000100:00100000:2.0:1746142919.150531:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3764:x1830962867915008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.150581:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+55:3764:x1830962867915008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (2116us total) trans 21474841304 rc 0/0 00000100:00100000:2.0:1746142919.150586:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14858 00000100:00100000:2.0:1746142919.150593:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14859 00000100:00100000:2.0:1746142919.150597:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3764:x1830962867915136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.150644:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3764:x1830962867915136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (340us total) trans 17179874053 rc 0/0 00000100:00100000:2.0:1746142919.150648:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14859 00000100:00080000:2.0:1746142919.150660:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746142919.150662:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746142919.150678:0:3764:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874044 gen 2 00000004:00080000:2.0:1746142919.150681:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098190e00, transno 17179873982 00000004:00080000:2.0:1746142919.150684:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098190380, transno 17179873983 00000004:00080000:2.0:1746142919.150686:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098191500, transno 17179873984 00000004:00080000:2.0:1746142919.150688:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098190000, transno 17179873985 00000004:00080000:2.0:1746142919.150689:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098192d80, transno 17179873986 00000004:00080000:2.0:1746142919.150691:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098193b80, transno 17179873987 00000004:00080000:2.0:1746142919.150692:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098191880, transno 17179873988 00000004:00080000:2.0:1746142919.150694:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098191180, transno 17179873989 00000004:00080000:2.0:1746142919.150695:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb0380, transno 17179873990 00000004:00080000:2.0:1746142919.150697:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc63b80, transno 17179873995 00000004:00080000:2.0:1746142919.150699:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc62d80, transno 17179873996 00000004:00080000:2.0:1746142919.150701:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de13480, transno 17179873997 00000004:00080000:2.0:1746142919.150703:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc61c00, transno 17179873998 00000004:00080000:2.0:1746142919.150705:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1a3100, transno 17179873999 00000004:00080000:2.0:1746142919.150707:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b1a0380, transno 17179874000 00000004:00080000:2.0:1746142919.150708:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012de10380, transno 17179874001 00000004:00080000:2.0:1746142919.150710:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862f800, transno 17179874002 00000004:00080000:2.0:1746142919.150712:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009862ce00, transno 17179874003 00000004:00080000:2.0:1746142919.150714:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb3800, transno 17179874004 00000004:00080000:2.0:1746142919.150715:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb0e00, transno 17179874005 00000004:00080000:2.0:1746142919.150717:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb1880, transno 17179874006 00000004:00080000:2.0:1746142919.150718:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb2300, transno 17179874007 00000004:00080000:2.0:1746142919.150720:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb2680, transno 17179874008 00000004:00080000:2.0:1746142919.150721:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb3100, transno 17179874009 00000004:00080000:2.0:1746142919.150723:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb1180, transno 17179874010 00000004:00080000:2.0:1746142919.150724:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb3b80, transno 17179874011 00000004:00080000:2.0:1746142919.150726:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1500, transno 17179874012 00000004:00080000:2.0:1746142919.150727:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1180, transno 17179874018 00000004:00080000:2.0:1746142919.150729:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0a80, transno 17179874019 00000004:00080000:2.0:1746142919.150731:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0380, transno 17179874020 00000004:00080000:2.0:1746142919.150732:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af2a00, transno 17179874021 00000004:00080000:2.0:1746142919.150734:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af3480, transno 17179874022 00000004:00080000:2.0:1746142919.150736:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af3800, transno 17179874023 00000004:00080000:2.0:1746142919.150737:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af2680, transno 17179874024 00000004:00080000:2.0:1746142919.150739:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af0000, transno 17179874025 00000004:00080000:2.0:1746142919.150741:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092136680, transno 17179874026 00000004:00080000:2.0:1746142919.150743:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1180, transno 17179874027 00000004:00080000:2.0:1746142919.150745:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a3100, transno 17179874028 00000004:00080000:2.0:1746142919.150746:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1880, transno 17179874029 00000004:00080000:2.0:1746142919.150748:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1f80, transno 17179874030 00000004:00080000:2.0:1746142919.150750:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2a00, transno 17179874031 00000004:00080000:2.0:1746142919.150752:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2300, transno 17179874032 00000004:00080000:2.0:1746142919.150754:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2d80, transno 17179874033 00000004:00080000:2.0:1746142919.150755:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a3480, transno 17179874034 00000004:00080000:2.0:1746142919.150757:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a1c00, transno 17179874035 00000004:00080000:2.0:1746142919.150758:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809d500, transno 17179874036 00000004:00080000:2.0:1746142919.150760:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809c000, transno 17179874037 00000004:00080000:2.0:1746142919.150762:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809d880, transno 17179874038 00000004:00080000:2.0:1746142919.150763:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809fb80, transno 17179874039 00000004:00080000:2.0:1746142919.150765:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809ea00, transno 17179874040 00000004:00080000:2.0:1746142919.150766:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ceb3480, transno 17179874041 00000004:00080000:2.0:1746142919.150768:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809ed80, transno 17179874042 00000004:00080000:2.0:1746142919.150770:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809e680, transno 17179874043 00000004:00080000:2.0:1746142919.150771:0:3764:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009809c380, transno 17179874044 00000100:00100000:2.0:1746142919.150775:0:3764:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880091c06a00 x1830962867915136/t17179874053(17179874053) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142935 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746142919.150782:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c06a00/2, rc 0, transno 17179874053 00000100:00100000:2.0:1746142919.150786:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867915136:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142919.150793:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096143100/2, rc 0, transno 21474841303 00000100:00100000:2.0:1746142919.150796:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867914496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142919.150800:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a358e00/2, rc 0, transno 21474841304 00000100:00100000:2.0:1746142919.150802:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867915008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.150997:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.151027:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867914880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.151048:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.151063:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142919.151067:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.151080:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.151096:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914368 00000100:00100000:0.0:1746142919.151099:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914368 00000100:00100000:0.0:1746142919.151112:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914880 00000100:00100000:0.0:1746142919.151113:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914880 00000100:00100000:0.0:1746142919.151126:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915264 00000100:00100000:0.0:1746142919.151128:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915264 00000100:00100000:0.0:1746142919.151136:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14860 00000100:00100000:0.0:1746142919.151141:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3763:x1830962867914368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.151200:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009734dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3763:x1830962867914368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (202us total) trans 21474841305 rc 0/0 00000100:00100000:0.0:1746142919.151215:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14860 00000100:00100000:0.0:1746142919.151225:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14861 00000100:00100000:0.0:1746142919.151229:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3763:x1830962867914880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.151333:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.151348:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867914752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.151361:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.151400:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914240 00000100:00100000:1.0:1746142919.151404:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914240 00000100:00100000:1.0:1746142919.151414:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914752 00000100:00100000:1.0:1746142919.151416:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914752 00000100:00100000:1.0:1746142919.151422:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14862 00000100:00100000:1.0:1746142919.151425:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3763:x1830962867915264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142919.151482:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3763:x1830962867915264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (400us total) trans 17179874054 rc 0/0 00000100:00100000:1.0:1746142919.151487:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14862 00000100:00100000:1.0:1746142919.151496:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14863 00000100:00100000:1.0:1746142919.151500:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3762:x1830962867914240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142919.151599:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3762:x1830962867914240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (303us total) trans 21474841307 rc 0/0 00000100:00100000:1.0:1746142919.151605:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14863 00000100:00100000:1.0:1746142919.151615:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14864 00000100:00100000:1.0:1746142919.151620:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3762:x1830962867914752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142919.151669:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3762:x1830962867914752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (306us total) trans 21474841308 rc 0/0 00000100:00100000:1.0:1746142919.151673:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14864 00000004:00080000:1.0:1746142919.152005:0:8111:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 7 changes, 2 in progress, 1 in flight, 54 done 00002000:00010000:0.0:1746142919.152287:0:11943:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746142919.152290:0:11943:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.152292:0:11943:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142919.152294:0:11943:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.152295:0:11943:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:0.0:1746142919.152316:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3763:x1830962867914880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1086us (1267us total) trans 21474841306 rc 0/0 00000100:00100000:0.0:1746142919.152321:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14861 00000100:00100000:0.0:1746142919.152338:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.152355:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.152370:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.152381:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142919.152395:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07800/2, rc 0, transno 17179874054 00000100:00100000:0.0:1746142919.152399:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142919.152405:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096140a80/2, rc 0, transno 21474841305 00000100:00100000:0.0:1746142919.152407:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867914368:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142919.152412:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35bb80/2, rc 0, transno 21474841306 00000100:00100000:0.0:1746142919.152414:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867914880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.152419:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746142919.152422:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.152434:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.152449:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915392 00000100:00100000:0.0:1746142919.152452:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915392 00000100:00100000:0.0:1746142919.152463:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915904 00000100:00100000:0.0:1746142919.152465:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915904 00000100:00100000:0.0:1746142919.152471:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915776 00000100:00100000:0.0:1746142919.152473:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915776 00000100:00100000:0.0:1746142919.152480:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14865 00000100:00100000:0.0:1746142919.152484:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3763:x1830962867915392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.152546:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3763:x1830962867915392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (188us total) trans 17179874055 rc 0/0 00000100:00100000:0.0:1746142919.152551:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14865 00000100:00100000:0.0:1746142919.152564:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14866 00000100:00100000:0.0:1746142919.152570:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3763:x1830962867915904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.152614:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3763:x1830962867915904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (232us total) trans 17179874056 rc 0/0 00000100:00100000:0.0:1746142919.152618:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14866 00000100:00100000:0.0:1746142919.152625:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14867 00000100:00100000:0.0:1746142919.152628:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3763:x1830962867915776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142919.152661:0:1854:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:0.0:1746142919.152663:0:1854:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142919.152665:0:1854:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142919.152666:0:1854:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:0.0:1746142919.152667:0:1854:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:0.0:1746142919.152682:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3763:x1830962867915776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (247us total) trans 17179874057 rc 0/0 00000100:00100000:0.0:1746142919.152686:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14867 00000004:00080000:0.0:1746142919.152703:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05f80/2, rc 0, transno 17179874057 00000100:00100000:0.0:1746142919.152706:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142919.152711:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c04700/2, rc 0, transno 17179874055 00000100:00100000:0.0:1746142919.152714:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142919.152718:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07b80/2, rc 0, transno 17179874056 00000100:00100000:0.0:1746142919.152720:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867915904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142919.152935:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096143b80/2, rc 0, transno 21474841307 00000100:00100000:3.0:1746142919.152939:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867914240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142919.152946:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc61500/2, rc 0, transno 21474841308 00000100:00100000:3.0:1746142919.152948:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867914752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.152960:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.152974:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867914624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.152991:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.153002:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867915648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.153015:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.153024:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867916160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.153036:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.153042:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746142919.153046:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867915520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.153058:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.153064:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867916032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.153075:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.153090:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914112 00000100:00100000:3.0:1746142919.153093:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914112 00000100:00100000:3.0:1746142919.153104:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867914624 00000100:00100000:3.0:1746142919.153106:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867914624 00000100:00100000:3.0:1746142919.153111:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915648 00000100:00100000:3.0:1746142919.153113:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915648 00000100:00100000:3.0:1746142919.153118:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867916160 00000100:00100000:3.0:1746142919.153119:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867916160 00000100:00100000:3.0:1746142919.153124:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867915520 00000100:00100000:3.0:1746142919.153125:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867915520 00000100:00100000:3.0:1746142919.153131:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867916032 00000100:00100000:3.0:1746142919.153132:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867916032 00000100:00100000:3.0:1746142919.153139:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14868 00000100:00100000:3.0:1746142919.153143:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3765:x1830962867914112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.153181:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14869 00000100:00100000:3.0:1746142919.153185:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3765:x1830962867914624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.153302:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14870 00000100:00100000:2.0:1746142919.153309:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867915648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.153349:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746142919.153351:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.153353:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142919.153355:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.153356:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:2.0:1746142919.153378:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867915648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (362us total) trans 17179874058 rc 0/0 00000100:00100000:2.0:1746142919.153383:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14870 00000100:00100000:2.0:1746142919.153392:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14871 00000100:00100000:2.0:1746142919.153396:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867916160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.153445:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867916160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (408us total) trans 17179874059 rc 0/0 00000100:00100000:2.0:1746142919.153450:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14871 00000100:00100000:2.0:1746142919.153458:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14872 00000100:00100000:2.0:1746142919.153461:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867915520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.153492:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142919.153495:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.153497:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:2.0:1746142919.153498:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.153500:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746142919.153516:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867915520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (458us total) trans 17179874060 rc 0/0 00000100:00100000:2.0:1746142919.153521:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14872 00000100:00100000:2.0:1746142919.153529:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14873 00000100:00100000:2.0:1746142919.153533:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867916032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.153566:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:2.0:1746142919.153568:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.153570:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142919.153572:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.153573:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:2.0:1746142919.153590:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867916032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (513us total) trans 17179874061 rc 0/0 00000100:00100000:2.0:1746142919.153594:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14873 00000004:00080000:3.0:1746142919.153645:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05880/2, rc 0, transno 17179874060 00000100:00100000:3.0:1746142919.153649:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867915520:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142919.153654:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05500/2, rc 0, transno 17179874061 00000100:00100000:3.0:1746142919.153656:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867916032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142919.153661:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07100/2, rc 0, transno 17179874058 00000100:00100000:3.0:1746142919.153664:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867915648:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142919.153668:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc63b80/2, rc 0, transno 17179874059 00000100:00100000:3.0:1746142919.153670:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867916160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142919.153829:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.153869:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867636224 00000100:00100000:0.0:1746142919.153872:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867636224 00000100:00100000:0.0:1746142919.153894:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14583 00000100:00100000:2.0:1746142919.153895:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092136a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3765:x1830962867914112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 752us (935us total) trans 21474841309 rc 0/0 00000100:00100000:0.0:1746142919.153914:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:32756:x1830962867636224:12345-192.168.204.50@tcp:101:mirror_io.0 00000100:00100000:2.0:1746142919.153915:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14868 00010000:00010000:0.0:1746142919.153926:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.153938:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6f0 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746142919.153964:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096af1f80/2, rc 0, transno 21474841309 00000100:00100000:3.0:1746142919.153967:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867914112:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746142919.153973:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.153996:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.154010:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3765:x1830962867914624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 824us (1018us total) trans 21474841310 rc 0/0 00010000:00010000:0.0:1746142919.154010:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.154012:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746142919.154015:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14869 00010000:00010000:0.0:1746142919.154015:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbbe00, rc 0) 00000100:00100000:0.0:1746142919.154038:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32756:x1830962867636224:12345-192.168.204.50@tcp:101:mirror_io.0 Request processed in 139us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.154042:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14583 00000004:00080000:2.0:1746142919.154103:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092d08000/2, rc 0, transno 21474841310 00000100:00100000:2.0:1746142919.154109:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867914624:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1746142919.155217:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841308 is committed 00000001:00080000:0.0:1746142919.155229:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841302 is committed 00000001:00080000:0.0:1746142919.155235:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841301 is committed 00000001:00080000:0.0:1746142919.155304:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841252 is committed 00000100:00100000:0.0:1746142919.157045:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.157270:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867636352 00000100:00100000:2.0:1746142919.157277:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867636352 00000100:00100000:2.0:1746142919.158485:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 786 00000100:00100000:2.0:1746142919.158495:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:32756:x1830962867636352:12345-192.168.204.50@tcp:103:mirror_io.0 00010000:00010000:2.0:1746142919.158508:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142919.158528:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880096130600/0x2fa243e067cce949 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6e2 expref: 8 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.158548:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.158552:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.160014:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+7:32756:x1830962867636352:12345-192.168.204.50@tcp:103:mirror_io.0 Request processed in 1518us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.160023:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 786 00000100:00100000:0.0:1746142919.162505:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.162566:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867636608 00000100:00100000:2.0:1746142919.162572:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867636608 00000100:00100000:2.0:1746142919.162608:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5355 00000100:00100000:2.0:1746142919.162614:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f38c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+7:32756:x1830962867636608:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:2.0:1746142919.163291:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f38c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32756:x1830962867636608:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 676us (791us total) trans 8589936782 rc 0/0 00000100:00100000:2.0:1746142919.163297:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5355 00000100:00100000:0.0:1746142919.166792:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.166956:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867636864 00000100:00100000:2.0:1746142919.166963:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867636864 00000100:00100000:2.0:1746142919.167012:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5356 00000100:00100000:2.0:1746142919.167019:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+8:32756:x1830962867636864:12345-192.168.204.50@tcp:35:mirror_io.0 00000100:00100000:2.0:1746142919.167198:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c8243383-433c-45fe-9bef-8828afa9ff81+9:32756:x1830962867636864:12345-192.168.204.50@tcp:35:mirror_io.0 Request processed in 179us (412us total) trans 8589936783 rc 0/0 00000100:00100000:2.0:1746142919.167217:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5356 00000100:00100000:3.0:1746142919.168010:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867916288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746142919.168043:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.168392:0:9581:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867916288 00000100:00100000:1.0:1746142919.168397:0:9581:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867916288 00000100:00100000:1.0:1746142919.168428:0:9581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1746142919.168433:0:9581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830962867916288:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1746142919.168438:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1746142919.168451:0:9581:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1182124864 pending 0 free 3906605056 avail 3675082752 00000100:00100000:1.0:1746142919.168479:0:9581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830962867916288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.168484:0:9581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1746142919.168558:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867916288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746142919.187152:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.187226:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867637120 00000100:00100000:2.0:1746142919.187235:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867637120 00000100:00100000:2.0:1746142919.187288:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14584 00000100:00100000:2.0:1746142919.187295:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:32761:x1830962867637120:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142919.187314:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.187329:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067cce996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6f7 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.187383:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187392:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187401:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187411:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187415:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187419:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187501:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733000/0x2fa243e067cce9ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187509:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092733000/0x2fa243e067cce9ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187515:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092733000/0x2fa243e067cce9ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:2.0:1746142919.187521:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142919.187577:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187583:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187587:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187591:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732c00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142919.187594:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187600:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187608:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142919.187611:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142919.187614:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187618:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732c00/0x2fa243e067cce99d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187644:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187648:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187651:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187655:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092732400 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142919.187656:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187661:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187666:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736a00) 00010000:00010000:2.0:1746142919.187668:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142919.187670:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187674:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092732400/0x2fa243e067cce9a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.187705:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097420e00/0x2fa243e067cce996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f7 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.187720:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092733000/0x2fa243e067cce9ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f7 expref: 28 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.187725:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.187727:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142919.187729:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092733000, rc 0) 00000100:00100000:2.0:1746142919.187780:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32761:x1830962867637120:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 485us (634us total) trans 8589936784 rc 0/0 00000100:00100000:2.0:1746142919.187785:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14584 00000100:00100000:0.0:1746142919.189679:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.189793:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867637376 00000100:00100000:2.0:1746142919.189799:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867637376 00000100:00100000:2.0:1746142919.189829:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14585 00000100:00100000:2.0:1746142919.189834:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+7:32762:x1830962867637376:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142919.189849:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.189860:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8e200/0x2fa243e067cce9b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b6fe expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.189933:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.189942:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.189949:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.189958:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.189966:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.189971:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190031:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190037:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190042:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142919.190050:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142919.190092:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190096:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190101:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190106:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190111:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd8ec00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142919.190114:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190119:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190138:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142919.190141:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142919.190144:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190148:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ec00/0x2fa243e067cce9c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190157:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190162:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190166:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190170:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cd8fe00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142919.190172:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190176:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190181:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736e00) 00010000:00010000:2.0:1746142919.190183:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142919.190185:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190189:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fe00/0x2fa243e067cce9c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.190223:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8e200/0x2fa243e067cce9b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.190233:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.190239:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.190240:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142919.190242:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8ee00, rc 0) 00000100:00100000:2.0:1746142919.192111:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32762:x1830962867637376:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2270us (2429us total) trans 8589936785 rc 0/0 00000100:00100000:2.0:1746142919.192120:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14585 00000100:00100000:0.0:1746142919.267825:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.267959:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867637632 00000100:00100000:2.0:1746142919.267967:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867637632 00000100:00100000:2.0:1746142919.268006:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14586 00000100:00100000:2.0:1746142919.268013:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32767:x1830962867637632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.268033:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.268049:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce9dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b705 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.268132:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce9e3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.268144:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.268153:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce9e3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142919.268161:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142919.268250:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067cce9dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b705 expref: 31 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.268278:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce9e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b705 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.268284:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.268286:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746142919.268289:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8f200, rc 0) 00000100:00100000:2.0:1746142919.268330:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32767:x1830962867637632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 317us (511us total) trans 8589936786 rc 0/0 00000100:00100000:2.0:1746142919.268335:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14586 00000100:00100000:0.0:1746142919.274183:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.274966:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.275005:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.275018:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.275037:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867637760 00000100:00100000:0.0:1746142919.275038:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.275045:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867637760 00000100:00100000:0.0:1746142919.275052:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638016 00000100:00100000:0.0:1746142919.275054:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638016 00000100:00100000:3.0:1746142919.275127:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867637888 00000100:00100000:0.0:1746142919.275127:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638400 00000100:00100000:3.0:1746142919.275129:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867637888 00000100:00100000:0.0:1746142919.275129:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638400 00000100:00100000:0.0:1746142919.275142:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14874 00000100:00100000:3.0:1746142919.275146:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14875 00000100:00100000:0.0:1746142919.275148:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+21:2005:x1830962867637760:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1746142919.275150:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867638016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142919.275162:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.275162:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142919.275176:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b71a expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.275176:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b70c expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142919.275194:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c7, atime: 0x681406c6, ctime: 0x681406c7, blocks: 0x800 00002000:00010000:0.0:1746142919.275194:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x7f0 00010000:00010000:3.0:1746142919.275218:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.275218:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.275219:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.275219:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.275226:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 27 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.275226:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.275239:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 27 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.275239:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 22 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.275247:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671400, rc 0) 00010000:00010000:0.0:1746142919.275247:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbb200, rc 0) 00000100:00100000:3.0:1746142919.275280:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867638016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 129us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.275283:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14876 00000100:00100000:3.0:1746142919.275289:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14875 00000100:00100000:1.0:1746142919.275289:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2005:x1830962867638400:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.275295:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746142919.275300:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14877 00000100:00100000:3.0:1746142919.275304:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867637888:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.275304:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b728 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.275308:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746142919.275313:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c7, atime: 0x681406c6, ctime: 0x681406c7, blocks: 0x16b0 00010000:00010000:3.0:1746142919.275314:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b713 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.275319:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.275320:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746142919.275321:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c7, atime: 0x681406c6, ctime: 0x681406c7, blocks: 0x808 00010000:00010000:1.0:1746142919.275324:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.275325:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.275327:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.275329:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 27 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.275332:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.275336:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 27 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.275338:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800981a1200, rc 0) 00010000:00010000:3.0:1746142919.275342:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670400, rc 0) 00000100:00100000:0.0:1746142919.275367:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867637760:12345-192.168.204.50@tcp:101:cat.0 Request processed in 220us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.275372:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14874 00000100:00100000:0.0:1746142919.275398:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.275407:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638144 00000100:00100000:0.0:1746142919.275410:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638144 00000100:00100000:0.0:1746142919.275421:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14878 00000100:00100000:0.0:1746142919.275425:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867638144:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142919.275429:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.275435:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b721 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142919.275444:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x808 00010000:00010000:0.0:1746142919.275449:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.275450:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.275453:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.275460:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.275466:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fbb000, rc 0) 00000100:00100000:0.0:1746142919.275478:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2005:x1830962867638144:12345-192.168.204.50@tcp:101:cat.0 Request processed in 52us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.275484:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14878 00000100:00100000:0.0:1746142919.275526:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.275536:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638656 00000100:00100000:0.0:1746142919.275538:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638656 00000100:00100000:0.0:1746142919.275548:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14879 00000100:00100000:0.0:1746142919.275552:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867638656:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142919.275557:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.275563:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b736 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746142919.275571:0:9580:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c7, atime: 0x681406c7, ctime: 0x681406c7, blocks: 0x1008 00010000:00010000:0.0:1746142919.275576:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.275578:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142919.275581:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 29 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.275588:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 29 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142919.275594:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fba800, rc 0) 00000100:00100000:0.0:1746142919.275605:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867638656:12345-192.168.204.50@tcp:101:cat.0 Request processed in 52us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.275608:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14879 00000100:00100000:2.0:1746142919.275755:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638528 00000100:00100000:2.0:1746142919.275759:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638528 00000100:00100000:2.0:1746142919.275786:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14587 00000100:00100000:2.0:1746142919.275791:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:304:x1830962867638528:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.275803:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.275811:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccea1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b72f expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.275881:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.275889:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.275896:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000100:00100000:1.0:1746142919.276005:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867638400:12345-192.168.204.50@tcp:101:cat.0 Request processed in 715us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.276010:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14876 00000004:00200000:2.0:1746142919.276325:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142919.276397:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccea1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 12 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.276413:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.276419:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.276422:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746142919.276424:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8f000, rc 0) 00000100:00100000:2.0:1746142919.277550:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:304:x1830962867638528:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1753us (3370us total) trans 8589936787 rc 0/0 00000100:00100000:2.0:1746142919.277557:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14587 00000100:00100000:3.0:1746142919.281735:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867637888:12345-192.168.204.50@tcp:101:cat.0 Request processed in 6417us (6682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.281747:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14877 00000100:00100000:2.0:1746142919.283428:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.283482:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638784 00000100:00100000:3.0:1746142919.283490:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638784 00000100:00100000:3.0:1746142919.283532:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14880 00000100:00100000:2.0:1746142919.283533:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.283539:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+5:2003:x1830962867638784:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142919.283553:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142919.283568:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e670200/0x2fa243e067ccea30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b73d expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.283587:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.283589:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.283596:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e670200/0x2fa243e067ccea30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b73d expref: 6 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.283609:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e670200/0x2fa243e067ccea30 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b73d expref: 6 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.283619:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e670200, rc 0) 00000100:00100000:3.0:1746142919.283657:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+6:2003:x1830962867638784:12345-192.168.204.50@tcp:101:cat.0 Request processed in 118us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.283662:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14880 00000100:00100000:3.0:1746142919.283673:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867639040 00000100:00100000:3.0:1746142919.283677:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867639040 00000100:00100000:3.0:1746142919.283695:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14881 00000100:00100000:3.0:1746142919.283700:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867639040:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1746142919.283707:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142919.283716:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b74b expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.283727:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.283729:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.283733:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 10 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.283744:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 10 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142919.283752:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e671000, rc 0) 00000100:00100000:3.0:1746142919.283767:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867639040:12345-192.168.204.50@tcp:101:cat.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.283772:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14881 00000100:00100000:2.0:1746142919.288191:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.288220:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.288246:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.288295:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.288322:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867639296 00000100:00100000:2.0:1746142919.288330:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867639296 00000100:00100000:2.0:1746142919.288364:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867638912 00000100:00100000:2.0:1746142919.288367:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867638912 00000100:00100000:2.0:1746142919.288383:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867639168 00000100:00100000:2.0:1746142919.288385:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867639168 00000100:00100000:2.0:1746142919.288398:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867639424 00000100:00100000:2.0:1746142919.288400:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867639424 00000100:00100000:2.0:1746142919.288416:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14882 00000100:00100000:2.0:1746142919.288424:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867639296:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.288441:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.288457:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b759 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.288480:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288483:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288492:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 8 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288507:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 8 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288518:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf15c00, rc 0) 00000100:00100000:2.0:1746142919.288564:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867639296:12345-192.168.204.50@tcp:101:cat.0 Request processed in 139us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.288570:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14882 00000100:00100000:2.0:1746142919.288586:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14883 00000100:00100000:2.0:1746142919.288593:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867638912:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.288602:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.288612:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd8f600/0x2fa243e067ccea45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b744 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.288624:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288626:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288631:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8f600/0x2fa243e067ccea45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b744 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288640:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8f600/0x2fa243e067ccea45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b744 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288652:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8f600, rc 0) 00000100:00100000:2.0:1746142919.288674:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867638912:12345-192.168.204.50@tcp:101:cat.0 Request processed in 81us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.288679:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14883 00000100:00100000:2.0:1746142919.288692:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14884 00000100:00100000:2.0:1746142919.288698:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+7:2003:x1830962867639168:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.288706:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.288713:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b752 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.288724:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288725:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288730:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 8 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288739:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 8 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288746:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8fe00, rc 0) 00000100:00100000:2.0:1746142919.288767:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867639168:12345-192.168.204.50@tcp:101:cat.0 Request processed in 68us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.288772:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14884 00000100:00100000:2.0:1746142919.288785:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14885 00000100:00100000:2.0:1746142919.288791:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:2003:x1830962867639424:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.288800:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.288808:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b760 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.288818:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288819:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.288823:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288832:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 12 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.288839:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cd8ec00, rc 0) 00000100:00100000:2.0:1746142919.288860:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867639424:12345-192.168.204.50@tcp:101:cat.0 Request processed in 69us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.288866:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14885 00000100:00100000:0.0:1746142919.309695:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.310533:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.310650:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867639680 00000100:00100000:1.0:1746142919.310660:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867639680 00002000:00100000:1.0:1746142919.310705:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009cd5c700 x1830962867639680/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.310715:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c700 with x1830962867639680 ext(0->1048575) 00002000:00010000:1.0:1746142919.310721:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5c700 00000100:00100000:1.0:1746142919.310759:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867639936 00000100:00100000:1.0:1746142919.310764:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867639936 00002000:00100000:1.0:1746142919.310781:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009cd5fb80 x1830962867639936/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.310794:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5fb80 with x1830962867639936 ext(1048576->2097151) 00002000:00010000:1.0:1746142919.310798:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5fb80 00000100:00100000:1.0:1746142919.310816:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4676 00000100:00100000:1.0:1746142919.310825:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867639680:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142919.312623:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4677 00000100:00100000:1.0:1746142919.312635:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867639936:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142919.325655:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.325696:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.326889:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867640192 00000100:00100000:2.0:1746142919.326915:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867640192 00002000:00100000:2.0:1746142919.326954:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012e679880 x1830962867640192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142919.326960:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867640448 00000100:00100000:3.0:1746142919.326963:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867640448 00002000:00100000:2.0:1746142919.326963:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679880 with x1830962867640192 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.326968:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e679880 00002000:00100000:3.0:1746142919.326978:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e67ad80 x1830962867640448/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.326984:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67ad80 with x1830962867640448 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.326987:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67ad80 00000100:00100000:2.0:1746142919.326987:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4678 00000100:00100000:2.0:1746142919.326993:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867640192:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142919.327003:0:13318:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4679 00000100:00100000:3.0:1746142919.327007:0:13318:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867640448:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142919.335586:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.335636:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.335681:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.335703:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.339812:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867639680:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28980us (30115us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746142919.339823:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4676 00002000:00100000:0.0:1746142919.339833:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88009cd5c700 x1830962867639680/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142919.339843:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5c700 with x1830962867639680 ext(0->1048575) 00002000:00010000:0.0:1746142919.339848:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009cd5c700 00000100:00100000:0.0:1746142919.339871:0:29472:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867640832 00000100:00100000:0.0:1746142919.339877:0:29472:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867640832 00002000:00100000:0.0:1746142919.339922:0:29472:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012e678e00 x1830962867640832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746142919.339929:0:29472:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678e00 with x1830962867640832 ext(0->1048575) 00002000:00010000:0.0:1746142919.339932:0:29472:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e678e00 00000100:00100000:3.0:1746142919.340216:0:20331:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867640960 00000100:00100000:3.0:1746142919.340220:0:20331:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867640960 00000100:00100000:2.0:1746142919.340234:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867641344 00002000:00100000:3.0:1746142919.340236:0:20331:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e679c00 x1830962867640960/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142919.340238:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867641344 00002000:00100000:3.0:1746142919.340242:0:20331:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679c00 with x1830962867640960 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.340244:0:20331:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e679c00 00002000:00100000:2.0:1746142919.340255:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880092432300 x1830962867641344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746142919.340258:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867641216 00000100:00100000:3.0:1746142919.340260:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867641216 00002000:00100000:2.0:1746142919.340261:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432300 with x1830962867641344 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.340263:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092432300 00002000:00100000:3.0:1746142919.340269:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092432680 x1830962867641216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746142919.340274:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4680 00002000:00100000:3.0:1746142919.340275:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432680 with x1830962867641216 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.340277:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092432680 00000100:00100000:2.0:1746142919.340279:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867640832:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142919.340286:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4681 00000100:00100000:3.0:1746142919.340290:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2003:x1830962867640960:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142919.340784:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4682 00000100:00100000:3.0:1746142919.340789:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867641344:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142919.340851:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4683 00000100:00100000:2.0:1746142919.340855:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867641216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1746142919.354036:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867639936:12345-192.168.204.50@tcp:3:cat.0 Request processed in 41396us (43497us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142919.354047:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4677 00002000:00100000:1.0:1746142919.354058:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff88009cd5fb80 x1830962867639936/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.354066:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009cd5fb80 with x1830962867639936 ext(1048576->2097151) 00002000:00010000:1.0:1746142919.354071:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009cd5fb80 00000100:00100000:2.0:1746142919.360736:0:13318:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2006:x1830962867640448:12345-192.168.204.50@tcp:3:cat.0 Request processed in 33720us (35031us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142919.360747:0:13318:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4679 00002000:00100000:2.0:1746142919.360758:0:13318:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e67ad80 x1830962867640448/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.360766:0:13318:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e67ad80 with x1830962867640448 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.360771:0:13318:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e67ad80 00000100:00100000:2.0:1746142919.362526:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867640192:12345-192.168.204.50@tcp:3:cat.0 Request processed in 35526us (36872us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142919.362535:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4678 00002000:00100000:2.0:1746142919.362542:0:9585:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff88012e679880 x1830962867640192/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.362549:0:9585:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679880 with x1830962867640192 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.362553:0:9585:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e679880 00000100:00100000:3.0:1746142919.367474:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867640960:12345-192.168.204.50@tcp:3:cat.0 Request processed in 27174us (31830us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.367483:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4681 00002000:00100000:3.0:1746142919.367491:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88012e679c00 x1830962867640960/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.367500:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e679c00 with x1830962867640960 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.367505:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e679c00 00000100:00100000:0.0:1746142919.373085:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.376450:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867641728 00000100:00100000:2.0:1746142919.376461:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867641728 00000100:00100000:2.0:1746142919.376510:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14588 00000100:00100000:2.0:1746142919.376517:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32761:x1830962867641728:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142919.376536:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.376538:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746142919.376559:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f200/0x2fa243e067cce9e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b705 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376584:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092733000/0x2fa243e067cce9ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f7 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376591:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.376595:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142919.376606:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccea5a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b767 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376642:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.376652:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376659:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376665:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376670:0:13326:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142919.376693:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 10 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376704:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 10 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.376714:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092407800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867916416:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.376785:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376793:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 8 pid: 7230 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.376799:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092405880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867916544:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142919.376821:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.376828:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 10 pid: 7230 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.376834:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092405f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867916672:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142919.376844:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.377739:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+8:2003:x1830962867640832:12345-192.168.204.50@tcp:3:cat.0 Request processed in 37457us (42159us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.377748:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4680 00002000:00100000:3.0:1746142919.377755:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x97:0x0] (0->1048575) req@ffff88012e678e00 x1830962867640832/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.377764:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e678e00 with x1830962867640832 ext(0->1048575) 00002000:00010000:3.0:1746142919.377768:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e678e00 00000100:00100000:0.0:1746142919.379473:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.383950:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867641984 00000100:00100000:1.0:1746142919.383960:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867641984 00000100:00100000:1.0:1746142919.384002:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14589 00000100:00100000:1.0:1746142919.384008:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:32762:x1830962867641984:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.384028:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.384031:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746142919.384043:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 11 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.384062:0:7230:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 11 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:1.0:1746142919.384072:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.384075:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.384082:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.384086:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142919.384096:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3c00/0x2fa243e067ccea68 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b76e expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.384582:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.384591:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.384596:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.384609:0:7230:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.384617:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142919.387821:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.388054:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642112 00000100:00100000:1.0:1746142919.388061:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642112 00000100:00100000:1.0:1746142919.388091:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14590 00000100:00100000:1.0:1746142919.388096:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32767:x1830962867642112:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.388112:0:7232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.388126:0:7232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b775 expref: -99 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.388163:0:7232:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.388169:0:7232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 31 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.388181:0:7232:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.388189:0:7232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 31 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.388198:0:7232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.388210:0:7232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142919.388211:0:7232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.388217:0:7232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2800, rc 0) 00000100:00100000:1.0:1746142919.388251:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32767:x1830962867642112:12345-192.168.204.50@tcp:101:cat.0 Request processed in 154us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.388256:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14590 00010000:00010000:2.0:1746142919.388607:0:13326:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@ffff880092407800 x1830962867916416) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 12 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.388618:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8f000/0x2fa243e067ccea22 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b72f expref: 12 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.388635:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092407800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867916416:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142919.389511:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867641344:12345-192.168.204.50@tcp:3:cat.0 Request processed in 48719us (53828us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.389519:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4682 00002000:00100000:3.0:1746142919.389526:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff880092432300 x1830962867641344/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.389539:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432300 with x1830962867641344 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.389543:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092432300 00000100:00100000:0.0:1746142919.389950:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.389968:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.390175:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+12:2003:x1830962867641216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 49318us (54471us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142919.390181:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4683 00000100:00100000:3.0:1746142919.390239:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092405880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867916544:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.390249:0:13326:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@ffff880092405f80 x1830962867916672) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 1/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 11 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.390258:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8ee00/0x2fa243e067cce9ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6fe expref: 11 pid: 7230 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.390271:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092405f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867916672:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.390287:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142919.390291:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.390297:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.390303:0:13326:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00000100:00100000:3.0:1746142919.390326:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642240 00000100:00100000:3.0:1746142919.390330:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642240 00010000:00010000:3.0:1746142919.390348:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 9 pid: 7230 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.390365:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6771 00000100:00100000:3.0:1746142919.390371:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+9:2005:x1830962867642240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.390380:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.390384:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 9 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.390392:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 9 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.390407:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fbbe00/0x2fa243e067cce98f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b6f0 expref: 9 pid: 7230 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.390414:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142919.390416:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.390422:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.390426:0:7217:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.390431:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.390435:0:7217:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.390445:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.390460:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8243383-433c-45fe-9bef-8828afa9ff81+8:2005:x1830962867642240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.390466:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6771 00010000:00010000:3.0:1746142919.390482:0:13326:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142919.390487:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13326 initiator: MDT0 00000040:00080000:3.0:1746142919.390671:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].706, 88 off69848 00000004:00080000:3.0:1746142919.390675:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389774962ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390693:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].787, 88 off77072 00000004:00080000:3.0:1746142919.390696:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389796198ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390707:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].788, 88 off77160 00000004:00080000:3.0:1746142919.390711:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389810814ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390719:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].707, 88 off69936 00000004:00080000:3.0:1746142919.390721:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389821027ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390727:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].708, 88 off70024 00000004:00080000:3.0:1746142919.390730:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389829702ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390737:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].789, 88 off77248 00000004:00080000:3.0:1746142919.390740:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389839808ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390747:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].790, 88 off77336 00000004:00080000:3.0:1746142919.390749:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389849704ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390756:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].709, 88 off70112 00000004:00080000:3.0:1746142919.390758:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389858696ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390766:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].791, 88 off77424 00000004:00080000:3.0:1746142919.390768:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389868622ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390776:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].710, 88 off70200 00000004:00080000:3.0:1746142919.390779:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389878866ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390785:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].792, 88 off77512 00000004:00080000:3.0:1746142919.390787:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389887479ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390793:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].711, 88 off70288 00000004:00080000:3.0:1746142919.390795:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389895059ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390802:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].793, 88 off77600 00000004:00080000:3.0:1746142919.390805:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389904814ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390811:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].712, 88 off70376 00000004:00080000:3.0:1746142919.390812:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389912712ns, next at 629431245375ns, rc = 0 00000040:00080000:3.0:1746142919.390818:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].794, 88 off77688 00000004:00080000:3.0:1746142919.390820:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389920388ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390826:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].795, 88 off77776 00000004:00080000:3.0:1746142919.390828:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693389928017ns, next at 629431169684ns, rc = 0 00000040:00080000:3.0:1746142919.390833:0:13326:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].713, 88 off70464 00000004:00080000:3.0:1746142919.390835:0:13326:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693389935186ns, next at 629431245375ns, rc = 0 00002000:00100000:2.0:1746142919.391138:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff880092432680 x1830962867641216/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.391147:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092432680 with x1830962867641216 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.391151:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092432680 00000100:00100000:1.0:1746142919.391286:0:22383:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642368 00000100:00100000:1.0:1746142919.391290:0:22383:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642368 00000100:00100000:1.0:1746142919.391310:0:22383:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14591 00000100:00100000:1.0:1746142919.391315:0:22383:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:304:x1830962867642368:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.391324:0:22383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.391333:0:22383:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b77c expref: -99 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.391362:0:22383:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 12 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.391370:0:22383:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 12 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.391377:0:22383:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.391379:0:22383:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142919.391381:0:22383:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.391386:0:22383:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d3400, rc 0) 00000100:00100000:1.0:1746142919.391407:0:22383:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:304:x1830962867642368:12345-192.168.204.50@tcp:101:cat.0 Request processed in 91us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.391412:0:22383:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14591 00000001:00080000:0.0:1746142919.394538:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936788 is committed 00000004:00080000:0.0:1746142919.394547:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 701 committed 00000004:00080000:0.0:1746142919.394880:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 783 committed 00000004:00080000:0.0:1746142919.396823:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 782 committed 00000004:00080000:0.0:1746142919.396827:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 700 committed 00000004:00080000:0.0:1746142919.396830:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 781 committed 00000004:00080000:0.0:1746142919.396831:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 699 committed 00000004:00080000:0.0:1746142919.396832:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 780 committed 00000004:00080000:0.0:1746142919.396834:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 698 committed 00000004:00080000:0.0:1746142919.396835:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 779 committed 00000004:00080000:0.0:1746142919.396836:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 697 committed 00000004:00080000:0.0:1746142919.396838:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 778 committed 00000004:00080000:0.0:1746142919.396839:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 777 committed 00000004:00080000:0.0:1746142919.396841:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 696 committed 00000004:00080000:0.0:1746142919.396842:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 695 committed 00000004:00080000:0.0:1746142919.396843:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 776 committed 00000004:00080000:0.0:1746142919.396844:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 775 committed 00000004:00080000:0.0:1746142919.396846:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 694 committed 00000001:00080000:0.0:1746142919.396852:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936787 is committed 00000001:00080000:0.0:1746142919.396860:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936783 is committed 00000100:00100000:0.0:1746142919.396882:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867916800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.396945:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.396977:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867916800 00000100:00100000:0.0:1746142919.396982:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867916800 00000100:00100000:0.0:1746142919.397011:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14886 00000100:00100000:0.0:1746142919.397016:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3763:x1830962867916800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142919.397119:0:1397:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142919.397122:0:1397:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.397124:0:1397:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.397128:0:1397:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.397130:0:1397:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142919.397154:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3763:x1830962867916800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (209us total) trans 21474841311 rc 0/0 00000100:00100000:0.0:1746142919.397162:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14886 00000100:00100000:2.0:1746142919.398053:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867916928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.398078:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.398384:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746142919.398409:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867917056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.398425:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.398712:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867916928 00000100:00100000:1.0:1746142919.398717:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867916928 00000100:00100000:3.0:1746142919.398724:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142919.398737:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917056 00000100:00100000:1.0:1746142919.398739:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917056 00000100:00100000:3.0:1746142919.398744:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.398748:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917184 00000100:00100000:1.0:1746142919.398750:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917184 00000100:00100000:3.0:1746142919.398755:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142919.398760:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14887 00000100:00100000:1.0:1746142919.398766:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3764:x1830962867916928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.398767:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.398778:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746142919.398782:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.398795:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.398806:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.398818:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746142919.398841:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142919.398843:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142919.398845:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142919.398847:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:1.0:1746142919.398849:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142919.398872:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092406a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3764:x1830962867916928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (792us total) trans 21474841312 rc 0/0 00000100:00100000:3.0:1746142919.398875:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917696 00000100:00100000:1.0:1746142919.398877:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14887 00000100:00100000:3.0:1746142919.398878:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917696 00000100:00100000:1.0:1746142919.398886:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917312 00000100:00100000:1.0:1746142919.398888:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917312 00000100:00100000:1.0:1746142919.398896:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917824 00000100:00100000:1.0:1746142919.398910:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917824 00000100:00100000:1.0:1746142919.398920:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14888 00000100:00100000:1.0:1746142919.398924:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3764:x1830962867917056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.398939:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14889 00000100:00100000:3.0:1746142919.398944:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3762:x1830962867917184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142919.398962:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:1.0:1746142919.398965:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:1.0:1746142919.398967:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142918 -> 1746142918 00002000:00010000:1.0:1746142919.398968:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:1.0:1746142919.398970:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:1.0:1746142919.398988:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092405500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3764:x1830962867917056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (561us total) trans 21474841313 rc 0/0 00000100:00100000:1.0:1746142919.398993:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14888 00000100:00100000:1.0:1746142919.399003:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14890 00000100:00100000:1.0:1746142919.399007:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867917312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.399026:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867917184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (281us total) trans 21474841314 rc 0/0 00000100:00100000:3.0:1746142919.399031:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14889 00000100:00100000:3.0:1746142919.399040:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14891 00000100:00100000:3.0:1746142919.399043:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3762:x1830962867917824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142919.399053:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142919.399055:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:1.0:1746142919.399056:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142918 -> 1746142918 00002000:00010000:1.0:1746142919.399058:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:1.0:1746142919.399059:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142919.399077:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3762:x1830962867917312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (280us total) trans 17179874062 rc 0/0 00000100:00100000:1.0:1746142919.399081:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14890 00000100:00100000:1.0:1746142919.399091:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14892 00000100:00100000:1.0:1746142919.399095:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830962867917696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142919.399124:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746142919.399126:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142919.399128:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746142919.399130:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:1.0:1746142919.399131:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142919.399145:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cfedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867917696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (377us total) trans 21474841316 rc 0/0 00000100:00100000:3.0:1746142919.399148:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867917824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (328us total) trans 21474841315 rc 0/0 00000100:00100000:1.0:1746142919.399150:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14892 00000100:00100000:3.0:1746142919.399164:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14891 00000004:00080000:3.0:1746142919.399198:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092407b80/2, rc 0, transno 17179874062 00000100:00100000:3.0:1746142919.399212:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092407b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142919.399214:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867917568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.399220:0:3762:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841308 gen 2 00000004:00080000:3.0:1746142919.399223:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de0a80, transno 21474841241 00000004:00080000:3.0:1746142919.399228:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de0000, transno 21474841242 00000004:00080000:3.0:1746142919.399230:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a359500, transno 21474841243 00000004:00080000:3.0:1746142919.399232:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de2a00, transno 21474841244 00000100:00100000:1.0:1746142919.399232:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746142919.399234:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de3100, transno 21474841245 00000004:00080000:3.0:1746142919.399236:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a358000, transno 21474841246 00000004:00080000:3.0:1746142919.399238:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734df80, transno 21474841247 00000004:00080000:3.0:1746142919.399240:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091de0e00, transno 21474841248 00000004:00080000:3.0:1746142919.399242:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a35ad80, transno 21474841253 00000004:00080000:3.0:1746142919.399244:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a359880, transno 21474841254 00000004:00080000:3.0:1746142919.399246:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a358700, transno 21474841255 00000100:00100000:1.0:1746142919.399247:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:3.0:1746142919.399248:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a35b480, transno 21474841256 00000004:00080000:3.0:1746142919.399249:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a359c00, transno 21474841257 00000004:00080000:3.0:1746142919.399251:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5f800, transno 21474841258 00000004:00080000:3.0:1746142919.399253:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a35b800, transno 21474841259 00000004:00080000:3.0:1746142919.399255:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a35aa00, transno 21474841260 00000004:00080000:3.0:1746142919.399257:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644e300, transno 21474841261 00000004:00080000:3.0:1746142919.399258:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644e680, transno 21474841262 00000004:00080000:3.0:1746142919.399260:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644d880, transno 21474841263 00000004:00080000:3.0:1746142919.399262:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644dc00, transno 21474841264 00000004:00080000:3.0:1746142919.399264:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644f100, transno 21474841265 00000004:00080000:3.0:1746142919.399266:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644ea00, transno 21474841266 00000004:00080000:3.0:1746142919.399268:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644d180, transno 21474841267 00000004:00080000:3.0:1746142919.399269:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013644ed80, transno 21474841268 00000004:00080000:3.0:1746142919.399271:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d7f480, transno 21474841275 00000004:00080000:3.0:1746142919.399273:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097349c00, transno 21474841276 00000004:00080000:3.0:1746142919.399275:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009734b480, transno 21474841277 00000004:00080000:3.0:1746142919.399277:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092d0bb80, transno 21474841278 00000004:00080000:3.0:1746142919.399279:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092433b80, transno 21474841279 00000004:00080000:3.0:1746142919.399281:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d7fb80, transno 21474841280 00000004:00080000:3.0:1746142919.399283:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097349880, transno 21474841281 00000004:00080000:3.0:1746142919.399285:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880088d7d880, transno 21474841282 00000100:00100000:2.0:1746142919.399858:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867917952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.399877:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.399923:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867918464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.399936:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746142919.400874:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938de300, transno 21474841283 00000004:00080000:3.0:1746142919.400877:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938dca80, transno 21474841284 00000004:00080000:3.0:1746142919.400879:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981ce680, transno 21474841285 00000004:00080000:3.0:1746142919.400881:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938ddf80, transno 21474841286 00000004:00080000:3.0:1746142919.400883:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cdf80, transno 21474841287 00000004:00080000:3.0:1746142919.400885:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938df100, transno 21474841288 00000004:00080000:3.0:1746142919.400887:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cca80, transno 21474841289 00000004:00080000:3.0:1746142919.400889:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800981cdc00, transno 21474841290 00000004:00080000:3.0:1746142919.400891:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924a2680, transno 21474841291 00000004:00080000:3.0:1746142919.400893:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13ca80, transno 21474841292 00000004:00080000:3.0:1746142919.400895:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13e680, transno 21474841293 00000004:00080000:3.0:1746142919.400912:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13f800, transno 21474841294 00000004:00080000:3.0:1746142919.400914:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13c700, transno 21474841295 00000004:00080000:3.0:1746142919.400915:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13f480, transno 21474841296 00000004:00080000:3.0:1746142919.400917:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13f100, transno 21474841297 00000004:00080000:3.0:1746142919.400919:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011e13ce00, transno 21474841298 00000004:00080000:3.0:1746142919.400921:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096143100, transno 21474841303 00000004:00080000:3.0:1746142919.400923:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a358e00, transno 21474841304 00000004:00080000:3.0:1746142919.400926:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096140a80, transno 21474841305 00000004:00080000:3.0:1746142919.400927:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a35bb80, transno 21474841306 00000004:00080000:3.0:1746142919.400929:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096143b80, transno 21474841307 00000004:00080000:3.0:1746142919.400931:0:3762:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc61500, transno 21474841308 00000100:00100000:3.0:1746142919.400937:0:3762:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880096af1f80 x1830962867914112/t21474841309(21474841309) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142935 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746142919.400993:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092135500/2, rc 0, transno 21474841311 00000100:00100000:0.0:1746142919.400998:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092135500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867916800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142919.401299:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092136a00/2, rc 0, transno 21474841313 00000100:00100000:2.0:1746142919.401303:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867917056:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142919.401318:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092136d80/2, rc 0, transno 21474841312 00000100:00100000:2.0:1746142919.401320:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867916928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.401327:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746142919.401332:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867918080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.401356:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.403263:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867917440:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142919.403310:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.406507:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917568 00000100:00100000:2.0:1746142919.406517:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917568 00000004:00080000:3.0:1746142919.406520:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092136300/2, rc 0, transno 21474841315 00000100:00100000:3.0:1746142919.406530:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.406548:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917952 00000100:00100000:2.0:1746142919.406550:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917952 00000004:00080000:3.0:1746142919.406558:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092137100/2, rc 0, transno 21474841314 00000100:00100000:3.0:1746142919.406560:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.406563:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918464 00000100:00100000:2.0:1746142919.406564:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918464 00000004:00080000:3.0:1746142919.406567:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092137800/2, rc 0, transno 21474841316 00000100:00100000:3.0:1746142919.406570:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867917696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.406572:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918080 00000100:00100000:2.0:1746142919.406574:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918080 00000100:00100000:2.0:1746142919.406580:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867917440 00000100:00100000:2.0:1746142919.406581:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867917440 00000100:00100000:3.0:1746142919.406582:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867918208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.406590:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14893 00000100:00100000:2.0:1746142919.406596:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867917568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.406621:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.406716:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3765:x1830962867917568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (7482us total) trans 21474841317 rc 0/0 00000100:00100000:2.0:1746142919.406721:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14893 00000100:00100000:2.0:1746142919.406731:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918208 00000100:00100000:2.0:1746142919.406733:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918208 00000100:00100000:2.0:1746142919.406741:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14894 00000100:00100000:2.0:1746142919.406744:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830962867917952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.406792:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142919.406794:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:2.0:1746142919.406796:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142918 -> 1746142918 00002000:00010000:2.0:1746142919.406798:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:2.0:1746142919.406800:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746142919.406815:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3764:x1830962867917952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (6937us total) trans 17179874063 rc 0/0 00000100:00100000:2.0:1746142919.406819:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14894 00000100:00100000:2.0:1746142919.406827:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14895 00000100:00100000:2.0:1746142919.406831:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830962867918464:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142919.406860:0:8109:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 10 in progress, 2 in flight, 54 done 00002000:00010000:2.0:1746142919.406860:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142919.406863:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142919.406864:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142919.406866:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142919.406867:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:2.0:1746142919.406882:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3764:x1830962867918464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (6945us total) trans 17179874064 rc 0/0 00000100:00100000:2.0:1746142919.406887:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14895 00000100:00100000:2.0:1746142919.406894:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14896 00000100:00100000:2.0:1746142919.406912:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3764:x1830962867918080:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746142919.406934:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.406944:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00002000:00010000:2.0:1746142919.406944:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142919.406946:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00010000:00010000:3.0:1746142919.406947:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00002000:00010000:2.0:1746142919.406948:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142919 -> 1746142919 00010000:00010000:3.0:1746142919.406950:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00002000:00010000:2.0:1746142919.406950:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:2.0:1746142919.406952:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00010000:00010000:3.0:1746142919.406957:0:13326:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.406962:0:13326:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00000100:00100000:2.0:1746142919.406967:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3764:x1830962867918080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (5611us total) trans 17179874065 rc 0/0 00000100:00100000:2.0:1746142919.406971:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14896 00000100:00100000:2.0:1746142919.406979:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14897 00010000:00010000:3.0:1746142919.406983:0:13326:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 29 pid: 13326 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142919.406983:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867917440:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746142919.406993:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 29 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.407001:0:13326:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867918976:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142919.407045:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14898 00000100:00100000:0.0:1746142919.407051:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3762:x1830962867918208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142919.407101:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142919.407103:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.407105:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:0.0:1746142919.407107:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.407108:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000004:00080000:1.0:1746142919.407166:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092134a80/2, rc 0, transno 21474841317 00000100:00100000:1.0:1746142919.407171:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867917568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142919.407211:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867918336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.407920:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3765:x1830962867917440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 936us (4609us total) trans 21474841318 rc 0/0 00000100:00100000:2.0:1746142919.407926:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14897 00000100:00100000:2.0:1746142919.407959:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867918720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.407976:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.407993:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918720 00000100:00100000:2.0:1746142919.407996:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918720 00000100:00100000:2.0:1746142919.408007:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14899 00000100:00100000:2.0:1746142919.408011:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867918720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.408051:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:2.0:1746142919.408052:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.408054:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142919.408055:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.408057:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:2.0:1746142919.408073:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867918720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (97us total) trans 17179874067 rc 0/0 00000100:00100000:2.0:1746142919.408077:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14899 00000004:00080000:2.0:1746142919.408092:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924f4e00/2, rc 0, transno 17179874067 00000100:00100000:2.0:1746142919.408095:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867918720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142919.408110:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092134380/2, rc 0, transno 21474841318 00000100:00100000:2.0:1746142919.408113:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867917440:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142919.408130:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092405880/2, rc 0, transno 17179874065 00000100:00100000:2.0:1746142919.408133:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092405880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867918080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.408137:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867918592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.408150:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746142919.408161:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092405f80/2, rc 0, transno 17179874063 00000100:00100000:2.0:1746142919.408163:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092405f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867917952:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142919.408168:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924f7b80/2, rc 0, transno 17179874064 00000100:00100000:2.0:1746142919.408171:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867918464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.408178:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918592 00000100:00100000:2.0:1746142919.408180:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918592 00000100:00100000:2.0:1746142919.408190:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14900 00000100:00100000:2.0:1746142919.408193:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867918592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.408247:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867918592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (96us total) trans 17179874068 rc 0/0 00000100:00100000:2.0:1746142919.408251:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14900 00000004:00080000:2.0:1746142919.408267:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924f5500/2, rc 0, transno 17179874068 00000100:00100000:2.0:1746142919.408270:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867918592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.408350:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867918208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1299us (1728us total) trans 17179874066 rc 0/0 00000100:00100000:0.0:1746142919.408354:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14898 00000004:00080000:2.0:1746142919.408518:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092407800/2, rc 0, transno 17179874066 00000100:00100000:2.0:1746142919.408522:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092407800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867918208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142919.408856:0:13326:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.409801:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.409819:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867918848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142919.409836:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.409915:0:13326:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13326:1830962867918976:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.409941:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cd8fa00/0x2fa243e067ccea5a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 29 pid: 13326 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746142919.409971:0:13326:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 28 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.409978:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 28 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.409999:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ed1000, rc 0) 00000100:00100000:3.0:1746142919.410023:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32761:x1830962867641728:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 33507us (36947us total) trans 8589936788 rc 0/0 00000100:00100000:3.0:1746142919.410029:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14588 00000100:00100000:0.0:1746142919.410359:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918336 00000100:00100000:0.0:1746142919.410364:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918336 00000100:00100000:0.0:1746142919.410394:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867918848 00000100:00100000:0.0:1746142919.410396:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867918848 00000100:00100000:0.0:1746142919.410412:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14901 00000100:00100000:2.0:1746142919.410416:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14902 00000100:00100000:0.0:1746142919.410417:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867918336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.410421:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3763:x1830962867918848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142919.410497:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746142919.410500:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.410502:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142919.410503:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.410505:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000100:00100000:2.0:1746142919.410514:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867918848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (677us total) trans 17179874069 rc 0/0 00000100:00100000:2.0:1746142919.410519:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14902 00000100:00100000:0.0:1746142919.410523:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867918336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (723us total) trans 17179874070 rc 0/0 00000100:00100000:0.0:1746142919.410528:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14901 00000004:00080000:1.0:1746142919.411164:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924f4380/2, rc 0, transno 17179874070 00000100:00100000:1.0:1746142919.411170:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867918336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142919.411177:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800924f6680/2, rc 0, transno 17179874069 00000100:00100000:1.0:1746142919.411179:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867918848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.412052:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.412106:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642496 00000100:00100000:3.0:1746142919.412111:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642496 00010000:00010000:3.0:1746142919.412132:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 28 pid: 13326 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.412155:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6772 00000100:00100000:3.0:1746142919.412160:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867642496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.412168:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.412172:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 28 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.412180:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 28 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.412196:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ed1000/0x2fa243e067ccea61 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b767 expref: 28 pid: 13326 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.412219:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142919.412223:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.412229:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.412234:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142919.412240:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 27 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.412263:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.412291:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867642496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.412298:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6772 00010000:00010000:1.0:1746142919.412485:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00010000:00010000:1.0:1746142919.412491:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7230 initiator: MDT0 00000040:00080000:1.0:1746142919.412712:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].714, 88 off70552 00000004:00080000:1.0:1746142919.412717:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693411816822ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.412821:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].796, 88 off77864 00000004:00080000:1.0:1746142919.412826:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693411926218ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.412853:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].797, 88 off77952 00000004:00080000:1.0:1746142919.412856:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693411956036ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413473:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].715, 88 off70640 00000004:00080000:1.0:1746142919.413478:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412578043ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.413593:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].716, 88 off70728 00000004:00080000:1.0:1746142919.413597:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412697259ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.413644:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].798, 88 off78040 00000004:00080000:1.0:1746142919.413647:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412747187ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413726:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].799, 88 off78128 00000004:00080000:1.0:1746142919.413730:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412829907ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413739:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].717, 88 off70816 00000004:00080000:1.0:1746142919.413741:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412841254ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.413752:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].800, 88 off78216 00000004:00080000:1.0:1746142919.413755:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412855103ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413762:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].718, 88 off70904 00000004:00080000:1.0:1746142919.413765:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412864749ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.413772:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].801, 88 off78304 00000004:00080000:1.0:1746142919.413775:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412874839ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413781:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].719, 88 off70992 00000004:00080000:1.0:1746142919.413784:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412884348ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.413791:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].802, 88 off78392 00000004:00080000:1.0:1746142919.413793:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412893183ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413800:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].720, 88 off71080 00000004:00080000:1.0:1746142919.413803:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412902962ns, next at 629431245375ns, rc = 0 00000040:00080000:1.0:1746142919.413810:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].803, 88 off78480 00000004:00080000:1.0:1746142919.413812:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412912646ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413819:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].804, 88 off78568 00000004:00080000:1.0:1746142919.413822:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 693412921817ns, next at 629431169684ns, rc = 0 00000040:00080000:1.0:1746142919.413830:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].721, 88 off71168 00000004:00080000:1.0:1746142919.413832:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 693412932154ns, next at 629431245375ns, rc = 0 00000001:00080000:2.0:1746142919.415893:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936789 is committed 00000004:00080000:2.0:1746142919.415918:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 709 committed 00000004:00080000:2.0:1746142919.416025:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 792 committed 00000004:00080000:2.0:1746142919.416153:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 791 committed 00000004:00080000:2.0:1746142919.416156:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 708 committed 00000004:00080000:2.0:1746142919.416157:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 790 committed 00000004:00080000:2.0:1746142919.416158:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 707 committed 00000004:00080000:2.0:1746142919.416160:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 789 committed 00000004:00080000:2.0:1746142919.416161:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 706 committed 00000004:00080000:2.0:1746142919.416163:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 788 committed 00000004:00080000:2.0:1746142919.416164:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 705 committed 00000004:00080000:2.0:1746142919.416165:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 787 committed 00000004:00080000:2.0:1746142919.416166:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 786 committed 00000004:00080000:2.0:1746142919.416168:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 704 committed 00000004:00080000:2.0:1746142919.416169:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 703 committed 00000004:00080000:2.0:1746142919.416170:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 785 committed 00000004:00080000:2.0:1746142919.416171:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 784 committed 00000004:00080000:2.0:1746142919.416173:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 702 committed 00000100:00100000:0.0:1746142919.416220:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867919104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.416270:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.416296:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746142919.416300:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867919232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.416313:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.416334:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919104 00000100:00100000:0.0:1746142919.416340:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919104 00000100:00100000:0.0:1746142919.416364:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14903 00000100:00100000:0.0:1746142919.416370:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3764:x1830962867919104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142919.416465:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746142919.416468:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.416469:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.416471:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.416472:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:0.0:1746142919.416498:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867919104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 127us (227us total) trans 21474841319 rc 0/0 00000100:00100000:0.0:1746142919.416504:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14903 00000100:00100000:0.0:1746142919.416515:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919232 00000100:00100000:0.0:1746142919.416517:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919232 00000100:00100000:0.0:1746142919.416529:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14904 00000100:00100000:0.0:1746142919.416533:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3764:x1830962867919232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142919.416570:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142919.416572:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.416574:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.416576:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142916 00002000:00010000:0.0:1746142919.416577:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142919.416595:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3764:x1830962867919232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (280us total) trans 21474841320 rc 0/0 00000100:00100000:0.0:1746142919.416600:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14904 00000004:00080000:0.0:1746142919.416627:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096140a80/2, rc 0, transno 21474841320 00000100:00100000:0.0:1746142919.416631:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867919232:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142919.416637:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096143100/2, rc 0, transno 21474841319 00000100:00100000:0.0:1746142919.416640:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867919104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.416799:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867919360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.416819:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.416832:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867919872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.416845:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.416856:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746142919.416860:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867919488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.416875:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.416883:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867920000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.416896:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.416928:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919360 00000100:00100000:3.0:1746142919.416932:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919360 00000100:00100000:3.0:1746142919.416946:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919872 00000100:00100000:3.0:1746142919.416948:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919872 00000100:00100000:3.0:1746142919.416961:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919488 00000100:00100000:3.0:1746142919.416964:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919488 00000100:00100000:3.0:1746142919.416972:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867920000 00000100:00100000:3.0:1746142919.416974:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867920000 00010000:00010000:1.0:1746142919.417127:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b76e expref: 10 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417138:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.417140:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746142919.417144:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417151:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417157:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417166:0:7230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417171:0:7230:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417176:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.417194:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.417212:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc62300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867920128:192.168.204.50@tcp:105: 00010000:00010000:1.0:1746142919.417260:0:7230:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 26 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.417267:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867920256:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142919.417282:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c51c300 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.417572:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14905 00000100:00100000:3.0:1746142919.417577:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867919360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142919.417636:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:3.0:1746142919.417638:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:3.0:1746142919.417639:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142918 -> 1746142918 00002000:00010000:3.0:1746142919.417641:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:3.0:1746142919.417642:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:3.0:1746142919.417664:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867919360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (844us total) trans 21474841321 rc 0/0 00000100:00100000:3.0:1746142919.417669:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14905 00000100:00100000:3.0:1746142919.417678:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14906 00000100:00100000:3.0:1746142919.417683:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867919872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142919.417718:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142919.417720:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142919.417721:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142919.417723:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142919.417724:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:3.0:1746142919.417740:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867919872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (894us total) trans 21474841322 rc 0/0 00000100:00100000:3.0:1746142919.417749:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14906 00000100:00100000:3.0:1746142919.417758:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14907 00000100:00100000:3.0:1746142919.417762:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867919488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.417807:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867919488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (931us total) trans 21474841323 rc 0/0 00000100:00100000:3.0:1746142919.417811:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14907 00000100:00100000:3.0:1746142919.417893:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14908 00000100:00100000:3.0:1746142919.417897:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867920000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142919.417962:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867920000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1064us total) trans 21474841324 rc 0/0 00000100:00100000:3.0:1746142919.417967:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14908 00000100:00100000:2.0:1746142919.419507:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867919744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.419535:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.419546:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919744 00000100:00100000:0.0:1746142919.419551:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919744 00000100:00100000:2.0:1746142919.419552:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746142919.419556:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867919616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.419565:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.419580:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867919616 00000100:00100000:2.0:1746142919.419583:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867919616 00000100:00100000:2.0:1746142919.419599:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14909 00000100:00100000:2.0:1746142919.419604:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3765:x1830962867919616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.419668:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14910 00000100:00100000:2.0:1746142919.419669:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3765:x1830962867919616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (102us total) trans 21474841325 rc 0/0 00000100:00100000:2.0:1746142919.419673:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14909 00000100:00100000:0.0:1746142919.419675:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3765:x1830962867919744:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746142919.419694:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130377100/2, rc 0, transno 21474841325 00000100:00100000:2.0:1746142919.419698:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867919616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142919.419767:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867920512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.419781:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.419793:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867921024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.419805:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.419812:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746142919.419815:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867920384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.419826:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.419831:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867920896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.419842:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.419852:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867920512 00000100:00100000:2.0:1746142919.419854:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867920512 00000100:00100000:2.0:1746142919.419865:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921024 00000100:00100000:2.0:1746142919.419866:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921024 00000100:00100000:2.0:1746142919.419871:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867920384 00000100:00100000:2.0:1746142919.419872:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867920384 00000100:00100000:2.0:1746142919.419878:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867920896 00000100:00100000:2.0:1746142919.419879:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867920896 00000100:00100000:2.0:1746142919.419885:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14911 00000100:00100000:2.0:1746142919.419888:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3765:x1830962867920512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.419954:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142919.419957:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:2.0:1746142919.419959:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142918 -> 1746142918 00002000:00010000:2.0:1746142919.419960:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:2.0:1746142919.419962:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746142919.419982:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3765:x1830962867920512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (199us total) trans 17179874071 rc 0/0 00000100:00100000:2.0:1746142919.419986:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14911 00000100:00100000:2.0:1746142919.419995:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14912 00000100:00100000:2.0:1746142919.419999:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3765:x1830962867921024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.420032:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 3616768 -> 3616768 00002000:00010000:2.0:1746142919.420034:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142919.420035:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142919.420037:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746142872 -> 1746142872 00002000:00010000:2.0:1746142919.420039:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 920 -> 920 00000100:00100000:2.0:1746142919.420053:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3765:x1830962867921024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (247us total) trans 17179874072 rc 0/0 00000100:00100000:2.0:1746142919.420058:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14912 00000100:00100000:2.0:1746142919.420066:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14913 00000100:00100000:2.0:1746142919.420070:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3765:x1830962867920384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.420100:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3765:x1830962867919744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 426us (564us total) trans 21474841326 rc 0/0 00002000:00010000:2.0:1746142919.420102:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142919.420104:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:2.0:1746142919.420106:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142918 -> 1746142918 00002000:00010000:2.0:1746142919.420107:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00000100:00100000:0.0:1746142919.420107:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14910 00002000:00010000:2.0:1746142919.420108:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746142919.420117:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14914 00000100:00100000:0.0:1746142919.420121:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3765:x1830962867920896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420124:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3765:x1830962867920384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (297us total) trans 17179874073 rc 0/0 00000100:00100000:2.0:1746142919.420128:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14913 00000004:00080000:2.0:1746142919.420145:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e88700/2, rc 0, transno 17179874073 00000100:00100000:2.0:1746142919.420151:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867920384:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746142919.420157:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e88a80/2, rc 0, transno 17179874071 00000100:00100000:2.0:1746142919.420159:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867920512:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142919.420161:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 3145728 -> 3145728 00000004:00080000:2.0:1746142919.420164:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e8a680/2, rc 0, transno 17179874072 00002000:00010000:0.0:1746142919.420164:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00000100:00100000:2.0:1746142919.420166:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867921024:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746142919.420166:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746142919.420167:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:0.0:1746142919.420169:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 3848 -> 3848 00000004:00080000:2.0:1746142919.420171:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009cd5f800/2, rc 0, transno 21474841326 00000100:00100000:2.0:1746142919.420174:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009cd5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867919744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.420191:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3765:x1830962867920896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (347us total) trans 17179874074 rc 0/0 00000100:00100000:0.0:1746142919.420196:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14914 00000004:00080000:2.0:1746142919.420209:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e8a300/2, rc 0, transno 17179874074 00000100:00100000:2.0:1746142919.420212:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867920896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420217:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746142919.420221:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867921408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420235:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.420252:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867920768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420262:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.420272:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921408 00000100:00100000:2.0:1746142919.420274:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921408 00000100:00100000:0.0:1746142919.420274:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc62300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867920128:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142919.420283:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867920768 00000100:00100000:2.0:1746142919.420284:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867920768 00000100:00100000:0.0:1746142919.420287:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14915 00000100:00100000:2.0:1746142919.420292:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14916 00000100:00100000:0.0:1746142919.420293:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3765:x1830962867921408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420296:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3763:x1830962867920768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746142919.420325:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142919.420327:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.420329:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:2.0:1746142919.420330:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.420332:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:2.0:1746142919.420347:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3763:x1830962867920768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (84us total) trans 17179874075 rc 0/0 00000100:00100000:2.0:1746142919.420351:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14916 00000100:00100000:0.0:1746142919.420353:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3765:x1830962867921408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (117us total) trans 17179874076 rc 0/0 00000100:00100000:0.0:1746142919.420358:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14915 00000004:00080000:2.0:1746142919.420369:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e89880/2, rc 0, transno 17179874075 00000100:00100000:2.0:1746142919.420372:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867920768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142919.420375:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938df100/2, rc 0, transno 17179874076 00000100:00100000:2.0:1746142919.420377:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867921280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.420379:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867921408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420391:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142919.420403:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746142919.420406:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867920640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420420:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.420425:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867920256:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142919.420431:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921280 00000100:00100000:2.0:1746142919.420434:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921280 00000100:00100000:2.0:1746142919.420444:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867920640 00000100:00100000:2.0:1746142919.420446:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867920640 00000100:00100000:2.0:1746142919.420452:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14917 00010000:00010000:0.0:1746142919.420454:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3c00/0x2fa243e067ccea68 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b76e expref: 10 pid: 7230 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1746142919.420455:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3763:x1830962867921280:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746142919.420474:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b76e expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.420494:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800974d2a00, rc 0) 00002000:00010000:2.0:1746142919.420496:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb size from disk: 7811072 -> 7811072 00002000:00010000:2.0:1746142919.420498:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.420499:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142919.420501:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142919.420502:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7e:0x0] updating lvb blocks from disk: 6808 -> 6808 00000100:00100000:3.0:1746142919.420516:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14918 00000100:00100000:2.0:1746142919.420518:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867921280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (127us total) trans 17179874077 rc 0/0 00000100:00100000:0.0:1746142919.420519:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32762:x1830962867641984:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 36511us (41051us total) trans 8589936789 rc 0/0 00000100:00100000:2.0:1746142919.420523:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14917 00000100:00100000:0.0:1746142919.420525:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14589 00000100:00100000:3.0:1746142919.420526:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867920640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420537:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867921152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142919.420549:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746142919.420564:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e88000/2, rc 0, transno 17179874077 00000100:00100000:2.0:1746142919.420567:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867921280:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142919.420586:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142919.420589:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142919 -> 1746142919 00002000:00010000:3.0:1746142919.420591:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142919 -> 1746142919 00002000:00010000:3.0:1746142919.420593:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142919 -> 1746142919 00002000:00010000:3.0:1746142919.420595:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746142919.420608:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921152 00000100:00100000:0.0:1746142919.420612:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921152 00000100:00100000:3.0:1746142919.420620:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867920640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (198us total) trans 17179874078 rc 0/0 00000100:00100000:3.0:1746142919.420626:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14918 00000004:00080000:2.0:1746142919.420630:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e8b100/2, rc 0, transno 17179874078 00000100:00100000:2.0:1746142919.420633:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867920640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.420634:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14919 00000100:00100000:0.0:1746142919.420639:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3763:x1830962867921152:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142919.420661:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093bcd500/2, rc 0, transno 21474841323 00000100:00100000:3.0:1746142919.420665:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867919488:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142919.420673:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092433b80/2, rc 0, transno 21474841324 00000100:00100000:3.0:1746142919.420675:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867920000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142919.420681:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880096143b80/2, rc 0, transno 21474841321 00000100:00100000:3.0:1746142919.420684:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867919360:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142919.420691:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092d0bb80/2, rc 0, transno 21474841322 00000100:00100000:3.0:1746142919.420693:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867919872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142919.420697:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3763:x1830962867921152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (146us total) trans 17179874079 rc 0/0 00000100:00100000:0.0:1746142919.420702:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14919 00000100:00100000:0.0:1746142919.421526:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:2.0:1746142919.422078:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e8aa00/2, rc 0, transno 17179874079 00000100:00100000:2.0:1746142919.422083:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867921152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142919.422992:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.423325:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642624 00000100:00100000:1.0:1746142919.423332:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642624 00000100:00100000:1.0:1746142919.423370:0:7234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642752 00000100:00100000:1.0:1746142919.423373:0:7234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642752 00000100:00100000:1.0:1746142919.423383:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5357 00000100:00100000:1.0:1746142919.423389:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:304:x1830962867642624:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:1.0:1746142919.423471:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:304:x1830962867642624:12345-192.168.204.50@tcp:49:cat.0 Request processed in 81us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.423479:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5357 00000100:00100000:1.0:1746142919.423492:0:7234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5358 00000100:00100000:1.0:1746142919.423496:0:7234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32767:x1830962867642752:12345-192.168.204.50@tcp:49:cat.0 00000100:00100000:1.0:1746142919.423529:0:7234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32767:x1830962867642752:12345-192.168.204.50@tcp:49:cat.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.423534:0:7234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5358 00000100:00100000:2.0:1746142919.423685:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.423752:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.423787:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867643008 00000100:00100000:3.0:1746142919.423791:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867643008 00000100:00100000:3.0:1746142919.423808:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5359 00000100:00100000:3.0:1746142919.423813:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32762:x1830962867643008:12345-192.168.204.50@tcp:49:multiop.0 00000100:00100000:3.0:1746142919.423861:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+9:32762:x1830962867643008:12345-192.168.204.50@tcp:49:multiop.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.423867:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5359 00000100:00100000:1.0:1746142919.424038:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867642880 00000100:00100000:1.0:1746142919.424041:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867642880 00000100:00100000:1.0:1746142919.424060:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14592 00000100:00100000:1.0:1746142919.424064:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32761:x1830962867642880:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.424071:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.424084:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb6000/0x2fa243e067ccea84 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b783 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.424114:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb6000/0x2fa243e067ccea84 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b783 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.424124:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb6000/0x2fa243e067ccea84 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b783 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.424137:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.424139:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746142919.424141:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fb6000, rc 0) 00000100:00100000:1.0:1746142919.424159:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32761:x1830962867642880:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.424163:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14592 00000100:00100000:2.0:1746142919.424527:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867921536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746142919.424559:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.424601:0:9266:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921536 00000100:00100000:3.0:1746142919.424605:0:9266:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921536 00000100:00100000:3.0:1746142919.424626:0:9266:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1746142919.424632:0:9266:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830962867921536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746142919.424651:0:9266:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445654528 avail 1316192256 00000100:00100000:3.0:1746142919.424680:0:9266:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3765:x1830962867921536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.424685:0:9266:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1746142919.425076:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867921536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746142919.438129:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.438172:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.438192:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867643392 00000100:00100000:0.0:1746142919.438207:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867643392 00000100:00100000:0.0:1746142919.438311:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 787 00000100:00100000:0.0:1746142919.438318:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867643392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.438332:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.438352:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb6000/0x2fa243e067ccea84 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b783 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.438366:0:7217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:0.0:1746142919.438370:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.438403:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867643392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.438409:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 787 00000100:00100000:0.0:1746142919.439683:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.439923:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867643264 00000100:00100000:2.0:1746142919.439928:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867643264 00002000:00100000:2.0:1746142919.439955:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800924a2d80 x1830962867643264/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.439963:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a2d80 with x1830962867643264 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.439967:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a2d80 00000100:00100000:2.0:1746142919.439978:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867643648 00000100:00100000:2.0:1746142919.439979:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867643648 00002000:00100000:2.0:1746142919.439986:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800924a1c00 x1830962867643648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.439991:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1c00 with x1830962867643648 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.439994:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1c00 00000100:00100000:2.0:1746142919.440003:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4684 00000100:00100000:2.0:1746142919.440008:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867643264:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142919.440093:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4685 00000100:00100000:0.0:1746142919.440098:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867643648:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142919.440681:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3764:1830962867921920:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.440716:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.440739:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3764:1830962867922432:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.440752:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.440765:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746142919.440769:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867922048:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.440784:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.440797:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3764:1830962867922560:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.440809:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.441099:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867921792:0@lo:400:kworker.0 00000100:00100000:3.0:1746142919.441124:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.441146:0:7235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921792 00000100:00100000:3.0:1746142919.441153:0:7235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921792 00000100:00100000:3.0:1746142919.441174:0:7235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1746142919.441179:0:7235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3763:x1830962867921792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746142919.441219:0:7235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3763:x1830962867921792:12345-0@lo:400:kworker.0 Request processed in 40us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.441224:0:7235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1746142919.441255:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3763:1830962867921792:0@lo:400:kworker.0 00000100:00100000:3.0:1746142919.441260:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3763:1830962867922304:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.442706:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867922048 00000100:00100000:1.0:1746142919.442712:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867922048 00000100:00100000:1.0:1746142919.442739:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1746142919.442744:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3764:x1830962867922048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.442777:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3764:x1830962867922048:12345-0@lo:400:kworker.0 Request processed in 33us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.442781:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1746142919.442801:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921920 00000100:00100000:1.0:1746142919.442804:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921920 00000100:00100000:1.0:1746142919.442820:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867922432 00000100:00100000:1.0:1746142919.442822:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867922432 00000100:00100000:1.0:1746142919.442851:0:7232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867922560 00000100:00100000:1.0:1746142919.442853:0:7232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867922560 00000100:00100000:1.0:1746142919.442866:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1746142919.442870:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3764:x1830962867921920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.442894:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3764:x1830962867921920:12345-0@lo:400:kworker.0 Request processed in 24us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.442916:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1746142919.442926:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1746142919.442930:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830962867922432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.442952:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3764:x1830962867922432:12345-0@lo:400:kworker.0 Request processed in 22us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.442956:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1746142919.442963:0:7232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1746142919.442967:0:7232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3764:x1830962867922560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.442984:0:7232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3764:x1830962867922560:12345-0@lo:400:kworker.0 Request processed in 18us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.442989:0:7232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:1.0:1746142919.443007:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3762:1830962867921664:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443027:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.443044:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3762:1830962867922176:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443057:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.443067:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830962867922688:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443079:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142919.443097:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867922176 00000100:00100000:1.0:1746142919.443099:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867922176 00000100:00100000:1.0:1746142919.443113:0:10924:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867922688 00000100:00100000:1.0:1746142919.443114:0:10924:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867922688 00000100:00100000:1.0:1746142919.443122:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1746142919.443125:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3762:x1830962867922176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443147:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3762:x1830962867922176:12345-0@lo:400:kworker.0 Request processed in 21us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.443151:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1746142919.443158:0:10924:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1746142919.443162:0:10924:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830962867922688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443179:0:10924:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830962867922688:12345-0@lo:400:kworker.0 Request processed in 17us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.443183:0:10924:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1746142919.443216:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3762:1830962867922176:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443223:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830962867922688:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443243:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3764:1830962867922048:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443250:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3764:1830962867922560:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443258:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3764:1830962867921920:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.443265:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3764:1830962867922432:0@lo:400:kworker.0 00000100:00080000:2.0:1746142919.443796:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746142919.443799:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746142919.444054:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.444182:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867922304 00000100:00100000:0.0:1746142919.444185:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867922304 00000100:00100000:0.0:1746142919.444248:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1746142919.444254:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3763:x1830962867922304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746142919.444281:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3763:x1830962867922304:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.444286:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1746142919.444339:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.444355:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.444381:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00080000:2.0:1746142919.444525:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746142919.444534:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867643904 00000100:00100000:2.0:1746142919.444537:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867643904 00002000:00100000:2.0:1746142919.444560:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800924a1500 x1830962867643904/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.444569:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1500 with x1830962867643904 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.444573:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a1500 00000100:00100000:2.0:1746142919.444585:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4686 00000100:00100000:2.0:1746142919.444590:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867643904:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142919.445382:0:8100:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867921664 00000100:00100000:1.0:1746142919.445386:0:8100:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867921664 00000100:00100000:1.0:1746142919.445408:0:8100:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1746142919.445412:0:8100:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11bfc4f8-19ff-4a85-a693-c4a0691b96f7+23:3762:x1830962867921664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.445441:0:8100:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:11bfc4f8-19ff-4a85-a693-c4a0691b96f7+23:3762:x1830962867921664:12345-0@lo:400:kworker.0 Request processed in 29us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.445446:0:8100:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1746142919.445466:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867644032 00000100:00100000:1.0:1746142919.445469:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867644032 00000100:00100000:1.0:1746142919.445481:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867644160 00000100:00100000:1.0:1746142919.445482:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867644160 00000100:00100000:1.0:1746142919.445494:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14920 00000100:00100000:1.0:1746142919.445498:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:32762:x1830962867644032:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.445506:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.445518:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b78a expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.445537:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445544:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445550:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.445552:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.445555:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.445576:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445586:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 11 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.445595:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867922816:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.445635:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445642:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.445649:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867922944:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.445666:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ace6f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.445683:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14921 00000100:00100000:1.0:1746142919.445688:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:32761:x1830962867644160:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.445694:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.445700:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b791 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.445712:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445718:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445722:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.445723:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.445726:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1204224->1998847] (req 1204224->1998847) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 24 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.445731:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3763:1830962867922304:0@lo:400:kworker.0 00010000:00010000:1.0:1746142919.445738:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 11 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445744:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 11 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.445751:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867923072:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.445771:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.445779:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 24 pid: 1854 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746142919.446265:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:11bfc4f8-19ff-4a85-a693-c4a0691b96f7:3762:1830962867921664:0@lo:400:kworker.0 00000100:00100000:1.0:1746142919.446446:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867923200:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.447372:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.448430:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867922816:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.448445:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867923072:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142919.448957:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.449013:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867644288 00000100:00100000:3.0:1746142919.449018:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867644288 00010000:00010000:3.0:1746142919.449040:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 12 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746142919.449066:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6773 00000100:00100000:3.0:1746142919.449074:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867644288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.449084:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.449101:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 12 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746142919.449110:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 12 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:0.0:1746142919.449110:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.449119:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867644544 00000100:00100000:0.0:1746142919.449122:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867644544 00010000:00010000:3.0:1746142919.449126:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf15c00/0x2fa243e067ccea3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b759 expref: 12 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.449133:0:7217:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 25 pid: 1854 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746142919.449141:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.449146:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6774 00000100:00100000:0.0:1746142919.449151:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867644544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142919.449156:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142919.449162:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 25 pid: 1854 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.449169:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 25 pid: 1854 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.449179:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.449182:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867644288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.449188:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6773 00000100:00100000:0.0:1746142919.449190:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867644544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.449194:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6774 00000100:00100000:1.0:1746142919.449277:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867922944:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.449302:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [3813376->4194303] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.449310:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75800, rc 0) 00000100:00100000:1.0:1746142919.449330:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:32762:x1830962867644032:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3831us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.449336:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14920 00010000:00010000:1.0:1746142919.449360:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb000/0x2fa243e067ccea0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b721 expref: 24 pid: 1854 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.449377:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867923200:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.449390:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1204224->1998847] (req 1204224->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.449396:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74c00, rc 0) 00000100:00100000:1.0:1746142919.449412:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:32761:x1830962867644160:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 3724us (5030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.449416:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14921 00000100:00100000:0.0:1746142919.451838:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.452470:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867644416 00000100:00100000:1.0:1746142919.452478:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867644416 00010000:00010000:1.0:1746142919.452501:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.452529:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6775 00000100:00100000:1.0:1746142919.452535:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867644416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.452544:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.452556:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.452565:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.452580:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800981a1200/0x2fa243e067cce9ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b728 expref: 23 pid: 9578 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.452591:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.452592:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.452598:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.452604:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.452630:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 9 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.452639:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867923328:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142919.452705:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.459304:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.459339:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.459368:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867644800 00000100:00100000:3.0:1746142919.459376:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867644800 00002000:00100000:3.0:1746142919.459408:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800924a1180 x1830962867644800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.459418:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1180 with x1830962867644800 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.459423:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1180 00000100:00100000:3.0:1746142919.459439:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867645056 00000100:00100000:3.0:1746142919.459442:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867645056 00002000:00100000:3.0:1746142919.459451:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800924a3100 x1830962867645056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.459457:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a3100 with x1830962867645056 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.459461:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a3100 00000100:00100000:3.0:1746142919.459489:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4687 00000100:00100000:3.0:1746142919.459496:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867644800:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142919.459525:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4688 00000100:00100000:1.0:1746142919.459533:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867645056:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142919.461262:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867643264:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 21247us (23134us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142919.461270:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4684 00002000:00100000:2.0:1746142919.461277:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800924a2d80 x1830962867643264/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.461284:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a2d80 with x1830962867643264 ext(1048576->2097151) 00002000:00010000:2.0:1746142919.461288:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a2d80 00000100:00100000:0.0:1746142919.461385:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867923328:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142919.461403:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.461425:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2005:x1830962867644416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8889us (9592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.461432:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6775 00000100:00100000:0.0:1746142919.474932:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.478087:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867643648:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 37981us (38398us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142919.478097:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4685 00002000:00100000:1.0:1746142919.478106:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800924a1c00 x1830962867643648/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.478113:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1c00 with x1830962867643648 ext(1048576->2097151) 00002000:00010000:1.0:1746142919.478118:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1c00 00000100:00100000:1.0:1746142919.478138:0:20334:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867645312 00000100:00100000:1.0:1746142919.478143:0:20334:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867645312 00002000:00100000:1.0:1746142919.478166:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3813376->3817471) req@ffff8800924a1880 x1830962867645312/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.478173:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1880 with x1830962867645312 ext(3813376->3817471) 00002000:00010000:1.0:1746142919.478180:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a1880 00000100:00100000:1.0:1746142919.478214:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4689 00000100:00100000:1.0:1746142919.478220:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867645312:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:1.0:1746142919.478309:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ad4f1515-ae46-4d91-8f96-492179af7039+10:2004:x1830962867645312:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 88us (3409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746142919.478314:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4689 00002000:00100000:1.0:1746142919.478319:0:20334:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x9b:0x0] (3813376->3817471) req@ffff8800924a1880 x1830962867645312/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.478324:0:20334:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1880 with x1830962867645312 ext(3813376->3817471) 00002000:00010000:1.0:1746142919.478327:0:20334:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924a1880 00000100:00100000:2.0:1746142919.478820:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+8:2006:x1830962867643904:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 34228us (34479us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142919.478828:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4686 00002000:00100000:2.0:1746142919.478833:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800924a1500 x1830962867643904/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.478841:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1500 with x1830962867643904 ext(1048576->2097151) 00010000:00010000:2.0:1746142919.478848:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 8 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.478870:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 8 pid: 11943 timeout: 793 lvb_type: 1 00002000:00010000:2.0:1746142919.478876:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924a1500 00000100:00100000:3.0:1746142919.487138:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867644800:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 27633us (27833us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.487149:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4687 00002000:00100000:3.0:1746142919.487158:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (1048576->2097151) req@ffff8800924a1180 x1830962867644800/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.487167:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a1180 with x1830962867644800 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.487172:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a1180 00000100:00100000:0.0:1746142919.487872:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.487950:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867645440 00000100:00100000:1.0:1746142919.487958:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867645440 00000100:00100000:0.0:1746142919.487961:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.487975:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867645568 00000100:00100000:0.0:1746142919.487978:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867645568 00000100:00100000:1.0:1746142919.487988:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14922 00010000:00010000:0.0:1746142919.487992:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 9 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.487994:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:304:x1830962867645440:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.488005:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142919.488008:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6776 00000100:00100000:0.0:1746142919.488011:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867645568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.488015:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b798 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.488019:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.488030:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.488034:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1204224->1998847] (req 1204224->1998847) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.488039:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142919.488042:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 10 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.488050:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 10 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.488058:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 10 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:0.0:1746142919.488072:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cd8fe00/0x2fa243e067ccea4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b752 expref: 10 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.488078:0:9579:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 6 type: EXT [1204224->1998847] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.488092:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.488099:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.488100:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.488108:0:9579:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.488114:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.488130:0:9579:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 21 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.488140:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 21 pid: 9579 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.488149:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867923712:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142919.488195:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.490356:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746142919.490372:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867923584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1746142919.490413:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746142919.490440:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.490458:0:9266:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867923584 00000100:00100000:0.0:1746142919.490482:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2004:x1830962867645568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2467us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.490490:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6776 00000100:00100000:1.0:1746142919.490576:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867645056:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 31043us (31236us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746142919.490583:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4688 00002000:00100000:1.0:1746142919.490590:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1048576->2097151) req@ffff8800924a3100 x1830962867645056/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142919.490599:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924a3100 with x1830962867645056 ext(1048576->2097151) 00002000:00010000:1.0:1746142919.490603:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924a3100 00000100:00100000:3.0:1746142919.490623:0:9266:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867923584 00000100:00100000:3.0:1746142919.490652:0:9266:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1746142919.490658:0:9266:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867923584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746142919.490767:0:9266:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445617664 avail 1316155392 00000100:00100000:3.0:1746142919.490797:0:9266:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830962867923584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.490802:0:9266:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1746142919.491048:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3762:1830962867923584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746142919.503493:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.503528:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.503576:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.503630:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867923712:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142919.503648:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75c00, rc 0) 00000100:00100000:0.0:1746142919.503684:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+8:304:x1830962867645440:12345-192.168.204.50@tcp:101:cat.0 Request processed in 15689us (15812us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.503690:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14922 00000100:00100000:0.0:1746142919.503715:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867646208 00000100:00100000:0.0:1746142919.503720:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867646208 00000100:00100000:0.0:1746142919.503745:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14923 00000100:00100000:0.0:1746142919.503751:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:32767:x1830962867646208:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142919.503766:0:9579:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.503782:0:9579:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b79f expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.503803:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142919.503808:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.503817:0:9579:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 23 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.503825:0:9579:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c3a400, rc 0) 00000100:00100000:0.0:1746142919.503838:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:32767:x1830962867646208:12345-192.168.204.50@tcp:101:cat.0 Request processed in 87us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.503842:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14923 00000100:00100000:2.0:1746142919.504450:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867645824 00000100:00100000:2.0:1746142919.504454:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867645824 00002000:00100000:2.0:1746142919.504477:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1204224->1208319) req@ffff8800979b2a00 x1830962867645824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.504490:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b2a00 with x1830962867645824 ext(1204224->1208319) 00010000:00010000:2.0:1746142919.504496:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.504505:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746142919.504510:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979b2a00 00000100:00100000:2.0:1746142919.504519:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867646080 00000100:00100000:2.0:1746142919.504521:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867646080 00002000:00100000:2.0:1746142919.504527:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800979b1880 x1830962867646080/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 504/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.504532:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1880 with x1830962867646080 ext(1048576->2097151) 00010000:00010000:2.0:1746142919.504535:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 24 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.504542:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 24 pid: 9579 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746142919.504551:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979b1880 00000100:00100000:2.0:1746142919.504558:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1454 00000100:00100000:2.0:1746142919.504563:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962867645824:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142919.504646:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962867645824:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 82us (1162us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142919.504651:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1454 00002000:00100000:2.0:1746142919.504656:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1204224->1208319) req@ffff8800979b2a00 x1830962867645824/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.504662:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b2a00 with x1830962867645824 ext(1204224->1208319) 00010000:00010000:2.0:1746142919.504665:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 24 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.504672:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 24 pid: 9579 timeout: 793 lvb_type: 0 00002000:00010000:2.0:1746142919.504677:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979b2a00 00000100:00100000:2.0:1746142919.504686:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1455 00000100:00100000:2.0:1746142919.504690:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867646080:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:0.0:1746142919.506506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.506633:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867646336 00000100:00100000:1.0:1746142919.506639:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867646336 00000100:00100000:1.0:1746142919.506666:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14924 00000100:00100000:1.0:1746142919.506672:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+12:32762:x1830962867646336:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.506685:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.506699:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7a6 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.506719:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 27 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.506725:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.506730:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.506732:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.506734:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->3497983] (req 3145728->3497983) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.506757:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.506769:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.506779:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867923840:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.509081:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 27 pid: 9580 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.509095:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 27 pid: 9580 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.509105:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867923968:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.509385:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.514106:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.514147:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.514553:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867923840:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.514563:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867923968:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.514588:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->3497983] (req 3145728->3497983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.514603:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75600, rc 0) 00000100:00100000:1.0:1746142919.514641:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:32762:x1830962867646336:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 7968us (8140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.514648:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14924 00000100:00100000:2.0:1746142919.515348:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867646464 00000100:00100000:2.0:1746142919.515355:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867646464 00010000:00010000:2.0:1746142919.515378:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746142919.515931:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867646592 00000100:00100000:2.0:1746142919.515934:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867646592 00010000:00010000:2.0:1746142919.515947:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 28 pid: 9580 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.516019:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6777 00000100:00100000:1.0:1746142919.516027:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867646464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.516039:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.516056:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.516064:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.516081:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8ec00/0x2fa243e067ccea53 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b760 expref: 13 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.516097:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.516131:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6778 00000100:00100000:2.0:1746142919.516137:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867646592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142919.516145:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142919.516151:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 28 pid: 9580 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.516158:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 28 pid: 9580 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.516168:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fba800/0x2fa243e067ccea14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b736 expref: 28 pid: 9580 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.516179:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.516181:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.516186:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 12 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.516192:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 12 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.516224:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 12 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142919.516235:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867924096:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142919.516451:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867646464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 363us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.516460:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6777 00000100:00100000:2.0:1746142919.516666:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.516800:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800979b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867646080:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 12108us (13270us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746142919.516807:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1455 00002000:00100000:3.0:1746142919.516814:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff8800979b1880 x1830962867646080/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 504/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:H/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.516823:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800979b1880 with x1830962867646080 ext(1048576->2097151) 00010000:00010000:3.0:1746142919.516829:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.516839:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746142919.516844:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800979b1880 00000100:00100000:2.0:1746142919.521127:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867924096:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142919.521147:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.521184:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867646592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 5046us (7036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.521194:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6778 00000100:00100000:0.0:1746142919.522758:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.522937:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867646848 00000100:00100000:3.0:1746142919.522944:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867646848 00002000:00100000:3.0:1746142919.522979:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3493888->3497983) req@ffff88009809c000 x1830962867646848/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.522987:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c000 with x1830962867646848 ext(3493888->3497983) 00002000:00010000:3.0:1746142919.522991:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809c000 00000100:00100000:3.0:1746142919.523006:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4690 00000100:00100000:3.0:1746142919.523011:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867646848:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142919.525050:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867646848:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 2032us (2292us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142919.525065:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4690 00002000:00100000:3.0:1746142919.525073:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3493888->3497983) req@ffff88009809c000 x1830962867646848/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.525081:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c000 with x1830962867646848 ext(3493888->3497983) 00002000:00010000:3.0:1746142919.525086:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809c000 00000100:00100000:0.0:1746142919.530892:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.530955:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867647232 00000100:00100000:3.0:1746142919.530964:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867647232 00000100:00100000:0.0:1746142919.531007:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.531014:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5360 00000100:00100000:3.0:1746142919.531021:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+9:32762:x1830962867647232:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:3.0:1746142919.531230:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:32762:x1830962867647232:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 209us (349us total) trans 8589936790 rc 0/0 00000100:00100000:3.0:1746142919.531240:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5360 00000100:00100000:3.0:1746142919.531281:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867647360 00000100:00100000:3.0:1746142919.531283:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867647360 00002000:00100000:3.0:1746142919.531303:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1204224->1998847) req@ffff88009809d880 x1830962867647360/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.531315:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d880 with x1830962867647360 ext(1204224->1998847) 00010000:00010000:3.0:1746142919.531323:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.531335:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 23 pid: 9579 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746142919.531341:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809d880 00000100:00100000:3.0:1746142919.531361:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1456 00000100:00100000:3.0:1746142919.531366:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962867647360:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142919.531630:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.532992:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867647616 00000100:00100000:2.0:1746142919.532999:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867647616 00000100:00100000:2.0:1746142919.533030:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5361 00000100:00100000:2.0:1746142919.533036:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32761:x1830962867647616:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142919.533158:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32761:x1830962867647616:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 122us (1528us total) trans 8589936791 rc 0/0 00000100:00100000:2.0:1746142919.533164:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5361 00000100:00100000:0.0:1746142919.533565:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.533589:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.533625:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867647744 00000100:00100000:3.0:1746142919.533629:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867647744 00002000:00100000:3.0:1746142919.533649:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3813376->4194303) req@ffff88009809ea00 x1830962867647744/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.533657:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ea00 with x1830962867647744 ext(3813376->4194303) 00002000:00010000:3.0:1746142919.533661:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809ea00 00000100:00100000:3.0:1746142919.533672:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867647872 00000100:00100000:3.0:1746142919.533674:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867647872 00002000:00100000:3.0:1746142919.533684:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3497983) req@ffff88009809ed80 x1830962867647872/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.533690:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ed80 with x1830962867647872 ext(3145728->3497983) 00002000:00010000:3.0:1746142919.533693:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809ed80 00000100:00100000:3.0:1746142919.533702:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4691 00000100:00100000:3.0:1746142919.533707:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+8:2005:x1830962867647744:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:0.0:1746142919.534232:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4692 00000100:00100000:0.0:1746142919.534239:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+12:2005:x1830962867647872:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142919.549722:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867647360:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 18348us (18708us total) trans 21474841327 rc 0/0 00000100:00100000:3.0:1746142919.549733:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1456 00002000:00100000:3.0:1746142919.549743:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x99:0x0] (1204224->1998847) req@ffff88009809d880 x1830962867647360/t21474841327(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/448 e 0 to 0 dl 1746142930 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.549752:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d880 with x1830962867647360 ext(1204224->1998847) 00010000:00010000:3.0:1746142919.549761:0:9584:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.549773:0:9584:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746142919.549779:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809d880 00000100:00100000:3.0:1746142919.551389:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867647744:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 17678us (17821us total) trans 21474841328 rc 0/0 00000100:00100000:0.0:1746142919.551389:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867647872:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 17147us (17795us total) trans 17179874080 rc 0/0 00000100:00100000:0.0:1746142919.551397:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4692 00002000:00100000:0.0:1746142919.551404:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7b:0x0] (3145728->3497983) req@ffff88009809ed80 x1830962867647872/t17179874080(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/448 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142919.551412:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ed80 with x1830962867647872 ext(3145728->3497983) 00002000:00010000:0.0:1746142919.551416:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809ed80 00000100:00100000:3.0:1746142919.551496:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4691 00002000:00100000:3.0:1746142919.551502:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3813376->4194303) req@ffff88009809ea00 x1830962867647744/t21474841328(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/448 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.551515:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ea00 with x1830962867647744 ext(3813376->4194303) 00002000:00010000:3.0:1746142919.551518:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809ea00 00000100:00100000:0.0:1746142919.552065:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867924224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746142919.552077:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867924352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746142919.552100:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142919.552119:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142919.552163:0:9582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867924224 00000100:00100000:0.0:1746142919.552169:0:9582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867924224 00000100:00100000:0.0:1746142919.552209:0:9582:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867924352 00000100:00100000:0.0:1746142919.552211:0:9582:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867924352 00000100:00100000:0.0:1746142919.552261:0:9582:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1746142919.552267:0:9581:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1746142919.552267:0:9582:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3764:x1830962867924224:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746142919.552274:0:9581:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3765:x1830962867924352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746142919.552283:0:9582:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1183349568 pending 1224704 free 3906605056 avail 3675082752 00002000:00000024:1.0:1746142919.552285:0:9581:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1305628352 pending 2195456 free 3908063232 avail 3676540928 00000100:00100000:0.0:1746142919.552308:0:9582:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3764:x1830962867924224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.552313:0:9582:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1746142919.552339:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867924224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746142919.552530:0:9581:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3765:x1830962867924352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 256us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.552536:0:9581:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1746142919.552608:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867924352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746142919.552716:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.552778:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867648000 00000100:00100000:3.0:1746142919.552785:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867648000 00010000:00010000:3.0:1746142919.552802:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.552825:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6779 00000100:00100000:3.0:1746142919.552830:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867648000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.552838:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142919.552849:0:11911:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142916 -> 1746142920 00002000:00010000:3.0:1746142919.552851:0:11911:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142916 -> 1746142920 00010000:00010000:3.0:1746142919.552856:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.552865:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.552882:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74c00/0x2fa243e067ccea92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1204224->1998847) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b791 expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.552923:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.552925:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.552931:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.552938:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.552945:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.552946:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.552949:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 24 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.552955:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 24 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.552974:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 24 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.552984:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867924480:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142919.553170:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.553182:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867924608:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142919.553219:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.554425:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867924480:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142919.554434:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867924608:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142919.554554:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.554579:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2005:x1830962867648000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1747us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.554586:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6779 00000100:00100000:0.0:1746142919.560668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.560713:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.561463:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867648384 00000100:00100000:3.0:1746142919.561471:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867648384 00002000:00100000:3.0:1746142919.561611:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009809c700 x1830962867648384/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.561620:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c700 with x1830962867648384 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.561624:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809c700 00000100:00100000:3.0:1746142919.561654:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867648512 00000100:00100000:3.0:1746142919.561657:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867648512 00002000:00100000:3.0:1746142919.561671:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009809dc00 x1830962867648512/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.561677:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809dc00 with x1830962867648512 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.561681:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809dc00 00000100:00100000:3.0:1746142919.561693:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4693 00000100:00100000:3.0:1746142919.561699:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867648384:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142919.562322:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4694 00000100:00100000:3.0:1746142919.562328:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867648512:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142919.573634:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867648384:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 11927us (12965us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.573650:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4693 00002000:00100000:3.0:1746142919.573660:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009809c700 x1830962867648384/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.573669:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809c700 with x1830962867648384 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.573673:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809c700 00000100:00100000:3.0:1746142919.575482:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867648512:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 13148us (14762us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.575491:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4694 00002000:00100000:3.0:1746142919.575497:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x99:0x0] (1048576->2097151) req@ffff88009809dc00 x1830962867648512/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.575504:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809dc00 with x1830962867648512 ext(1048576->2097151) 00002000:00010000:3.0:1746142919.575508:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809dc00 00000100:00100000:0.0:1746142919.582560:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.582602:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.583080:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867648640 00000100:00100000:2.0:1746142919.583088:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867648640 00000100:00100000:2.0:1746142919.583122:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867648768 00000100:00100000:2.0:1746142919.583124:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867648768 00000100:00100000:1.0:1746142919.583136:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14925 00000100:00100000:2.0:1746142919.583146:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14926 00000100:00100000:1.0:1746142919.583149:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2005:x1830962867648640:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:2.0:1746142919.583151:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867648768:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1746142919.583163:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.583163:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.583175:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3920000/0x2fa243e067cceaae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7b4 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.583176:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d74e00/0x2fa243e067cceab5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7ad expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142919.583228:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867924736:192.168.204.50@tcp:106: 00000100:00100000:1.0:1746142919.583228:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867924864:192.168.204.50@tcp:106: 00000100:00100000:2.0:1746142919.584530:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.584583:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.584783:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.584835:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.584863:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867649024 00000100:00100000:3.0:1746142919.584868:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867649024 00000100:00100000:2.0:1746142919.584877:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867649280 00000100:00100000:2.0:1746142919.584881:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867649280 00002000:00100000:3.0:1746142919.584895:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3813375) req@ffff88009809ce00 x1830962867649024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.584911:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009809f800 x1830962867649280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 504/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.584919:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ce00 with x1830962867649024 ext(2097152->3813375) 00002000:00100000:2.0:1746142919.584919:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f800 with x1830962867649280 ext(2097152->4194303) 00002000:00010000:3.0:1746142919.584923:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809ce00 00002000:00010000:2.0:1746142919.584923:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809f800 00000100:00100000:2.0:1746142919.584978:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4695 00000100:00100000:3.0:1746142919.584984:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4696 00000100:00100000:2.0:1746142919.584986:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867649280:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142919.584991:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867649024:12345-192.168.204.50@tcp:3:cat.0 00002000:00010000:1.0:1746142919.585753:0:11943:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime: 1746142919 -> 1746142920 00002000:00010000:1.0:1746142919.585756:0:11943:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime: 1746142918 -> 1746142920 00002000:00010000:1.0:1746142919.585758:0:11943:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime: 1746142919 -> 1746142920 00000100:00100000:1.0:1746142919.585767:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867924864:192.168.204.50@tcp:106: 00002000:00010000:2.0:1746142919.585782:0:1854:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime: 1746142919 -> 1746142920 00002000:00010000:2.0:1746142919.585785:0:1854:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime: 1746142919 -> 1746142920 00002000:00010000:2.0:1746142919.585786:0:1854:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime: 1746142919 -> 1746142920 00000100:00100000:2.0:1746142919.585792:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867924736:192.168.204.50@tcp:106: 00010000:00010000:1.0:1746142919.585792:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d74e00/0x2fa243e067cceab5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ad expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.585802:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d74e00/0x2fa243e067cceab5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ad expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.585803:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3920000/0x2fa243e067cceaae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7b4 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.585810:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3920000/0x2fa243e067cceaae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7b4 expref: 28 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142919.585820:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3920000, rc 0) 00010000:00010000:1.0:1746142919.585830:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74e00, rc 0) 00000100:00100000:2.0:1746142919.585851:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867648768:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2699us (3247us total) trans 0 rc 301/301 00000100:00100000:1.0:1746142919.585851:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2005:x1830962867648640:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2704us (3297us total) trans 0 rc 301/301 00000100:00100000:2.0:1746142919.585856:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14926 00000100:00100000:1.0:1746142919.586045:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14925 00000100:00100000:0.0:1746142919.593015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.593241:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867649408 00000100:00100000:1.0:1746142919.593251:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867649408 00000100:00100000:1.0:1746142919.593307:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14927 00000100:00100000:1.0:1746142919.593316:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:32767:x1830962867649408:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.593332:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.593348:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7bb expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.593376:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.593384:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142919.593386:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142919.593390:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 4/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.593417:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 11 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.593428:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 11 pid: 1854 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.593438:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867924992:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.595121:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.598841:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2003:x1830962867649024:12345-192.168.204.50@tcp:3:cat.0 Request processed in 13841us (14050us total) trans 0 rc 1716224/1716224 00000100:00100000:3.0:1746142919.598852:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4696 00002000:00100000:3.0:1746142919.598863:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3813375) req@ffff88009809ce00 x1830962867649024/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1716224/1716224 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.598871:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809ce00 with x1830962867649024 ext(2097152->3813375) 00010000:00010000:3.0:1746142919.598881:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.598893:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 793 lvb_type: 0 00002000:00010000:3.0:1746142919.599030:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009809ce00 00000100:00100000:1.0:1746142919.600741:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867924992:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.600760:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 3/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.600771:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75e00, rc 0) 00000100:00100000:1.0:1746142919.600805:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:32767:x1830962867649408:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7492us (7798us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.600810:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14927 00000100:00100000:2.0:1746142919.606100:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867649280:12345-192.168.204.50@tcp:3:cat.0 Request processed in 21106us (21255us total) trans 0 rc 1744896/1744896 00000100:00100000:2.0:1746142919.606110:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4695 00002000:00100000:2.0:1746142919.606120:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88009809f800 x1830962867649280/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 504/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1744896/1744896 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.606129:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809f800 with x1830962867649280 ext(2097152->4194303) 00002000:00010000:2.0:1746142919.606134:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009809f800 00000100:00100000:0.0:1746142919.608611:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.608669:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867649536 00000100:00100000:3.0:1746142919.608677:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867649536 00010000:00010000:3.0:1746142919.608708:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.608741:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6780 00000100:00100000:3.0:1746142919.608749:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867649536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.608760:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.608777:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.608787:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.608806:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75800/0x2fa243e067ccea8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3813376->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b78a expref: 10 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.608841:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.608842:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.608849:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.608855:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.608881:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.608891:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867925120:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142919.608990:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.610517:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.610776:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11911:1830962867925120:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142919.610793:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.610822:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867649536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2074us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.610829:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867649664 00000100:00100000:3.0:1746142919.610830:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6780 00000100:00100000:1.0:1746142919.610834:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867649664 00000100:00100000:1.0:1746142919.610871:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14928 00000100:00100000:1.0:1746142919.610877:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:304:x1830962867649664:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.610889:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.610921:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7c2 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.610941:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.610942:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.610947:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 10 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.610959:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 10 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.610966:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75200, rc 0) 00000100:00100000:1.0:1746142919.610983:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:304:x1830962867649664:12345-192.168.204.50@tcp:101:cat.0 Request processed in 106us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.610988:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14928 00000100:00100000:0.0:1746142919.612509:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.612620:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867649920 00000100:00100000:2.0:1746142919.612626:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867649920 00002000:00100000:2.0:1746142919.612658:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009809d500 x1830962867649920/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.612672:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d500 with x1830962867649920 ext(2097152->3145727) 00002000:00010000:2.0:1746142919.612676:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809d500 00000100:00100000:2.0:1746142919.612848:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4697 00000100:00100000:2.0:1746142919.612856:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867649920:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142919.615822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.616092:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867650176 00000100:00100000:3.0:1746142919.616100:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867650176 00002000:00100000:3.0:1746142919.616134:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88011e13ca80 x1830962867650176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.616143:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ca80 with x1830962867650176 ext(3145728->4194303) 00002000:00010000:3.0:1746142919.616148:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13ca80 00000100:00100000:3.0:1746142919.616176:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4698 00000100:00100000:3.0:1746142919.616183:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867650176:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1746142919.621423:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867649920:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8560us (8909us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142919.621434:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4697 00002000:00100000:2.0:1746142919.621443:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (2097152->3145727) req@ffff88009809d500 x1830962867649920/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.621452:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009809d500 with x1830962867649920 ext(2097152->3145727) 00002000:00010000:2.0:1746142919.621457:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009809d500 00000100:00100000:3.0:1746142919.624394:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867650176:12345-192.168.204.50@tcp:3:cat.0 Request processed in 8203us (8572us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.624403:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4698 00002000:00100000:3.0:1746142919.624412:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88011e13ca80 x1830962867650176/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.624421:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ca80 with x1830962867650176 ext(3145728->4194303) 00002000:00010000:3.0:1746142919.624426:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13ca80 00000100:00100000:2.0:1746142919.630062:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.630412:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867650304 00000100:00100000:0.0:1746142919.630421:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867650304 00000100:00100000:0.0:1746142919.630593:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14929 00000100:00100000:0.0:1746142919.630602:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:32767:x1830962867650304:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1746142919.630616:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746142919.630630:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7c9 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.630655:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.630662:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142919.630663:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746142919.630666:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.630690:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142919.630700:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 13 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:0.0:1746142919.630709:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011e13e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867925248:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142919.631813:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433840 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.634109:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.634169:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867650560 00000100:00100000:3.0:1746142919.634176:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867650560 00002000:00100000:3.0:1746142919.634220:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88011e13f800 x1830962867650560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.634230:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f800 with x1830962867650560 ext(4194304->5066751) 00000100:00100000:1.0:1746142919.634244:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011e13e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:1854:1830962867925248:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.634266:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 28 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.634279:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d2200, rc 0) 00002000:00010000:3.0:1746142919.634373:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13f800 00000100:00100000:1.0:1746142919.634971:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:32767:x1830962867650304:12345-192.168.204.50@tcp:101:cat.0 Request processed in 4370us (4915us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.634978:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14929 00000100:00100000:3.0:1746142919.635504:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4699 00000100:00100000:3.0:1746142919.635513:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867650560:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142919.637766:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.638286:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867650688 00000100:00100000:3.0:1746142919.638451:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867650688 00010000:00010000:3.0:1746142919.638479:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 14 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.638628:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6781 00000100:00100000:3.0:1746142919.638636:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2003:x1830962867650688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.638650:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.638669:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 14 pid: 11943 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.638679:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 14 pid: 11943 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.638697:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75600/0x2fa243e067cceaa7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3497983) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7a6 expref: 14 pid: 11943 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.638718:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.638720:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.638726:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.638733:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.638759:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.638769:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867925376:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142919.638835:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.641769:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867925376:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142919.641793:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.641834:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+13:2003:x1830962867650688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3198us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.641843:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6781 00000100:00100000:2.0:1746142919.642035:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867650560:12345-192.168.204.50@tcp:3:cat.0 Request processed in 6522us (7930us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746142919.642043:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4699 00002000:00100000:2.0:1746142919.642052:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88011e13f800 x1830962867650560/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.642062:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f800 with x1830962867650560 ext(4194304->5066751) 00002000:00010000:2.0:1746142919.642068:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13f800 00000100:00100000:0.0:1746142919.646473:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.646503:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.646537:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.646695:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867650816 00000100:00100000:1.0:1746142919.646702:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867650816 00000100:00100000:1.0:1746142919.646738:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14930 00000100:00100000:1.0:1746142919.646746:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867650816:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1746142919.646761:0:1854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.646775:0:1854:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7d0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.646795:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.646807:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.646814:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.646828:0:1854:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 14 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.646837:0:1854:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74000, rc 0) 00000100:00100000:1.0:1746142919.646874:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867650816:12345-192.168.204.50@tcp:101:cat.0 Request processed in 128us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.647104:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14930 00000100:00100000:3.0:1746142919.647416:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867651072 00000100:00100000:3.0:1746142919.647420:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867651072 00002000:00100000:3.0:1746142919.647444:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88011e13f100 x1830962867651072/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.647452:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f100 with x1830962867651072 ext(2097152->4194303) 00002000:00010000:3.0:1746142919.647456:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13f100 00000100:00100000:3.0:1746142919.647467:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867651328 00000100:00100000:3.0:1746142919.647469:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867651328 00002000:00100000:3.0:1746142919.647479:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88011e13ce00 x1830962867651328/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.647485:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ce00 with x1830962867651328 ext(3145728->4194303) 00002000:00010000:3.0:1746142919.647487:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13ce00 00000100:00100000:3.0:1746142919.647499:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4700 00000100:00100000:3.0:1746142919.647504:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867651072:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142919.648483:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4701 00000100:00100000:3.0:1746142919.648489:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867651328:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1746142919.662513:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.662576:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867651584 00000100:00100000:2.0:1746142919.662585:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867651584 00000100:00100000:2.0:1746142919.662637:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5362 00000100:00100000:2.0:1746142919.662646:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:304:x1830962867651584:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142919.662834:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad4f1515-ae46-4d91-8f96-492179af7039+11:304:x1830962867651584:12345-192.168.204.50@tcp:35:cat.0 Request processed in 188us (327us total) trans 8589936792 rc 0/0 00000100:00100000:2.0:1746142919.662840:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5362 00000100:00100000:3.0:1746142919.663793:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867651072:12345-192.168.204.50@tcp:3:cat.0 Request processed in 16287us (17287us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746142919.663801:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4700 00002000:00100000:3.0:1746142919.663809:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x7b:0x0] (2097152->4194303) req@ffff88011e13f100 x1830962867651072/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.663817:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13f100 with x1830962867651072 ext(2097152->4194303) 00002000:00010000:3.0:1746142919.663822:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011e13f100 00000100:00100000:3.0:1746142919.668724:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867651328:12345-192.168.204.50@tcp:3:cat.0 Request processed in 20226us (22177us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142919.668735:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4701 00002000:00100000:3.0:1746142919.668744:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->4194303) req@ffff88011e13ce00 x1830962867651328/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.668753:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13ce00 with x1830962867651328 ext(3145728->4194303) 00002000:00010000:3.0:1746142919.668757:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13ce00 00000100:00100000:0.0:1746142919.669451:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.669582:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867651840 00000100:00100000:1.0:1746142919.669590:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867651840 00000100:00100000:1.0:1746142919.669638:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14593 00000100:00100000:1.0:1746142919.669645:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+11:309:x1830962867651840:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.669662:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.669677:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccead8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7d7 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.669737:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669751:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669760:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669770:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669775:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669779:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669858:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cceaed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669865:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cceaed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669871:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cceaed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00200000:1.0:1746142919.669878:0:13326:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:1.0:1746142919.669959:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669965:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669969:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669973:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d75600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142919.669976:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669981:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.669990:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:1.0:1746142919.669993:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142919.669995:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670000:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d75600/0x2fa243e067cceadf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670028:0:13326:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670032:0:13326:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670036:0:13326:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670039:0:13326:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74200 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:1.0:1746142919.670041:0:13326:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670045:0:13326:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670050:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880097ae4300) 00010000:00010000:1.0:1746142919.670052:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746142919.670055:0:13326:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670061:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74200/0x2fa243e067cceae6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00010000:00010000:1.0:1746142919.670090:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74600/0x2fa243e067ccead8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d7 expref: 14 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.670099:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cceaed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d7 expref: 13 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.670106:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:1.0:1746142919.670108:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746142919.670110:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74800, rc 0) 00000100:00100000:1.0:1746142919.670137:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:309:x1830962867651840:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 493us (687us total) trans 8589936793 rc 0/0 00000100:00100000:1.0:1746142919.670143:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14593 00000100:00100000:0.0:1746142919.671542:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.672102:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867652096 00000100:00100000:2.0:1746142919.672109:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867652096 00000100:00100000:2.0:1746142919.672149:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14594 00000100:00100000:2.0:1746142919.672156:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:310:x1830962867652096:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:2.0:1746142919.672173:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142919.672184:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52c00/0x2fa243e067cceafb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7de expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.672243:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672253:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672261:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672271:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672275:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672280:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672343:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672354:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672360:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142919.672367:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142919.672414:0:7230:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672420:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672425:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672430:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672435:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea52e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142919.672438:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672443:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672451:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:2.0:1746142919.672453:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142919.672456:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672460:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52e00/0x2fa243e067cceb02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672485:0:7230:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672490:0:7230:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672494:0:7230:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672498:0:7230:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea52800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142919.672500:0:7230:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672504:0:7230:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672509:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98eb7d (ffff880094736a00) 00010000:00010000:2.0:1746142919.672511:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746142919.672514:0:7230:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672518:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52800/0x2fa243e067cceb09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98eb7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142919.672544:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52c00/0x2fa243e067cceafb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 31 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.672553:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.672558:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142919.672560:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142919.672561:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea52000, rc 0) 00000100:00100000:2.0:1746142919.672595:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:310:x1830962867652096:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 440us (1057us total) trans 8589936794 rc 0/0 00000100:00100000:2.0:1746142919.672600:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14594 00000100:00100000:0.0:1746142919.686643:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.686938:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867652352 00000100:00100000:3.0:1746142919.686946:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867652352 00002000:00100000:3.0:1746142919.686982:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88011e13df80 x1830962867652352/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.686992:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13df80 with x1830962867652352 ext(4194304->5066751) 00002000:00010000:3.0:1746142919.686997:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13df80 00000100:00100000:3.0:1746142919.687020:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4702 00000100:00100000:3.0:1746142919.687028:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867652352:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1746142919.692611:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867652352:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5576us (5968us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746142919.692624:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4702 00002000:00100000:3.0:1746142919.692634:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (4194304->5066751) req@ffff88011e13df80 x1830962867652352/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/440 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.692643:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011e13df80 with x1830962867652352 ext(4194304->5066751) 00002000:00010000:3.0:1746142919.692648:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011e13df80 00000100:00100000:0.0:1746142919.699274:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.699603:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867652608 00000100:00100000:2.0:1746142919.699612:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867652608 00000100:00100000:2.0:1746142919.700583:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5363 00000100:00100000:2.0:1746142919.700594:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:32767:x1830962867652608:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1746142919.701553:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:32767:x1830962867652608:12345-192.168.204.50@tcp:35:cat.0 Request processed in 959us (2284us total) trans 8589936795 rc 0/0 00000100:00100000:2.0:1746142919.701561:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5363 00000100:00100000:0.0:1746142919.775362:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.775612:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867652736 00000100:00100000:1.0:1746142919.775621:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867652736 00000100:00100000:1.0:1746142919.775807:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14931 00000100:00100000:1.0:1746142919.775816:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:309:x1830962867652736:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.775835:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.775853:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7e5 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.775880:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.775888:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.775896:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.775933:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.775936:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7e5 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.775963:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 15 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.775972:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 15 pid: 1854 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.775982:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867925504:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.778694:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 27 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.778710:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 27 pid: 1854 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.778728:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867925632:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.778819:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746142919.781144:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.781209:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867652864 00000100:00100000:3.0:1746142919.781217:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867652864 00010000:00010000:3.0:1746142919.781248:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 16 pid: 1854 timeout: 793 lvb_type: 1 00000100:00100000:3.0:1746142919.781293:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6782 00000100:00100000:3.0:1746142919.781308:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867652864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.781321:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.781341:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 16 pid: 1854 timeout: 793 lvb_type: 1 00010000:00010000:3.0:1746142919.781351:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 16 pid: 1854 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.781437:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867925504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.781449:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867925632:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142919.781675:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74000/0x2fa243e067ccead1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d0 expref: 16 pid: 1854 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.781758:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3014656->3145727] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7e5 expref: 15 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.781776:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75a00, rc 0) 00000100:00100000:1.0:1746142919.781828:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011e13e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+15:309:x1830962867652736:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 6012us (6474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.781834:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14931 00010000:00010000:3.0:1746142919.782120:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.782140:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867652864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 840us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.782146:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6782 00000100:00100000:0.0:1746142919.784743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.784953:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867652992 00000100:00100000:3.0:1746142919.784961:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867652992 00010000:00010000:3.0:1746142919.784988:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 28 pid: 1854 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.785010:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6783 00000100:00100000:3.0:1746142919.785016:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867652992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.785028:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.785044:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 28 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.785056:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 28 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.785075:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067cceaca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c9 expref: 28 pid: 1854 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.785088:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.785090:0:11911:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.785096:0:11911:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7e5 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.785104:0:11911:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7e5 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.785131:0:11911:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7e5 expref: 13 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.785142:0:11911:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867925760:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142919.786771:0:11911:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.787941:0:11911:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11911:1830962867925760:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142919.787958:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.787991:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867652992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2975us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.788000:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6783 00000100:00100000:0.0:1746142919.788415:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.788522:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867653248 00000100:00100000:3.0:1746142919.788527:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867653248 00002000:00100000:3.0:1746142919.788558:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3014656->3018751) req@ffff88013644d880 x1830962867653248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.788566:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d880 with x1830962867653248 ext(3014656->3018751) 00002000:00010000:3.0:1746142919.788570:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644d880 00000100:00100000:3.0:1746142919.788623:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4703 00000100:00100000:3.0:1746142919.788630:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867653248:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142919.788996:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867653248:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 365us (581us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142919.789002:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4703 00002000:00100000:3.0:1746142919.789007:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x7b:0x0] (3014656->3018751) req@ffff88013644d880 x1830962867653248/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.789014:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644d880 with x1830962867653248 ext(3014656->3018751) 00002000:00010000:3.0:1746142919.789017:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644d880 00000100:00100000:2.0:1746142919.791456:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.791825:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867653376 00000100:00100000:1.0:1746142919.791834:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867653376 00000100:00100000:1.0:1746142919.791879:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14932 00000100:00100000:1.0:1746142919.791889:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:309:x1830962867653376:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.791941:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.791958:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7ec expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.791988:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.791996:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.792002:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.792004:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.792007:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3883007] (req 3145728->3883007) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ec expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.792039:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.792055:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.792067:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867925888:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.792149:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.792158:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 24 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.792166:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867926016:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.792183:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.794314:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867925888:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.794327:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867926016:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.794347:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->3883007] (req 3145728->3883007) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ec expref: 11 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.794358:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75400, rc 0) 00000100:00100000:1.0:1746142919.794393:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:309:x1830962867653376:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 2506us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.794401:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14932 00000100:00100000:0.0:1746142919.798150:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.798204:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.798302:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867653504 00000100:00100000:3.0:1746142919.798310:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867653504 00010000:00010000:3.0:1746142919.798337:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.798359:0:11911:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867653632 00000100:00100000:3.0:1746142919.798361:0:11911:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867653632 00010000:00010000:3.0:1746142919.798367:0:11911:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 25 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.798395:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6784 00000100:00100000:3.0:1746142919.798402:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867653504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.798414:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.798429:0:11911:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.798433:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6785 00010000:00010000:3.0:1746142919.798439:0:11911:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:2.0:1746142919.798442:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b483b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867653632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142919.798450:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.798457:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75200/0x2fa243e067cceac3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7c2 expref: 11 pid: 11943 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.798460:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 25 pid: 11943 timeout: 793 lvb_type: 0 00010000:00010000:2.0:1746142919.798470:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 25 pid: 11943 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.799207:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142919.799216:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75e00/0x2fa243e067cceabc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7bb expref: 25 pid: 11943 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.799246:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867653504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 843us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.799253:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6784 00010000:00010000:2.0:1746142919.799302:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.799304:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142919.799310:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3883007) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ec expref: 9 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.799317:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3883007) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ec expref: 9 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142919.799343:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3883007) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ec expref: 9 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142919.799353:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867926144:192.168.204.50@tcp:105: 00000100:00100000:2.0:1746142919.799418:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746142919.805148:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867926144:192.168.204.50@tcp:105: 00010000:00010000:2.0:1746142919.805172:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.805230:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b483b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2004:x1830962867653632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 6789us (7024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.805239:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6785 00000100:00100000:0.0:1746142919.807379:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.807919:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867653888 00000100:00100000:3.0:1746142919.807927:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867653888 00002000:00100000:3.0:1746142919.807963:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3878912->3883007) req@ffff88013644f100 x1830962867653888/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.807972:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f100 with x1830962867653888 ext(3878912->3883007) 00002000:00010000:3.0:1746142919.807976:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644f100 00000100:00100000:3.0:1746142919.808038:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4704 00000100:00100000:3.0:1746142919.808045:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867653888:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142919.808296:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867653888:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 249us (920us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142919.808304:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4704 00002000:00100000:3.0:1746142919.808310:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x9b:0x0] (3878912->3883007) req@ffff88013644f100 x1830962867653888/t0(0) o3->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.808316:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644f100 with x1830962867653888 ext(3878912->3883007) 00002000:00010000:3.0:1746142919.808318:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013644f100 00000100:00100000:0.0:1746142919.815585:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.815652:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867654144 00000100:00100000:2.0:1746142919.815660:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867654144 00000100:00100000:2.0:1746142919.815706:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5364 00000100:00100000:2.0:1746142919.815713:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+13:309:x1830962867654144:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142919.816075:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:ad4f1515-ae46-4d91-8f96-492179af7039+14:309:x1830962867654144:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 361us (494us total) trans 8589936796 rc 0/0 00000100:00100000:2.0:1746142919.816082:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5364 00000100:00100000:0.0:1746142919.831580:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.831687:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867654272 00000100:00100000:1.0:1746142919.831694:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867654272 00000100:00100000:1.0:1746142919.831744:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14933 00000100:00100000:1.0:1746142919.831751:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:310:x1830962867654272:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.831767:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.831781:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7f3 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.831806:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.831813:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.831819:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.831821:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.831823:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1519616->2097151] (req 1519616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.831859:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 13 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.831869:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 13 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.831879:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867926272:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.831990:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142919.832002:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.832010:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867926400:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.832027:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.836091:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867926272:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.836104:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867926400:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.836128:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [1519616->2097151] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.836142:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d74a00, rc 0) 00000100:00100000:1.0:1746142919.836176:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:310:x1830962867654272:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 4425us (4603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.836183:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14933 00000100:00100000:0.0:1746142919.843298:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.844145:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.844236:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867654400 00000100:00100000:2.0:1746142919.844244:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867654400 00010000:00010000:2.0:1746142919.844276:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 14 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746142919.844791:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867654528 00000100:00100000:2.0:1746142919.844795:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867654528 00010000:00010000:2.0:1746142919.844807:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:2.0:1746142919.844834:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6786 00000100:00100000:2.0:1746142919.844840:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+14:2005:x1830962867654400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746142919.844853:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142919.844868:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 14 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.844877:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 14 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:2.0:1746142919.844895:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e671000/0x2fa243e067ccea37 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b74b expref: 14 pid: 11943 timeout: 793 lvb_type: 1 00000100:00100000:1.0:1746142919.844964:0:7217:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6787 00000100:00100000:1.0:1746142919.844972:0:7217:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867654528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142919.844978:0:7217:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746142919.844986:0:7217:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.844995:0:7217:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.845011:0:7217:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e671400/0x2fa243e067cce9f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b71a expref: 28 pid: 11943 timeout: 793 lvb_type: 1 00010000:00010000:1.0:1746142919.845030:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.845032:0:7217:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.845037:0:7217:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.845043:0:7217:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.845071:0:7217:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142919.845081:0:7217:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867926528:192.168.204.50@tcp:105: 00000100:00100000:1.0:1746142919.845143:0:7217:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9000 going to sleep for 11 seconds 00010000:00010000:2.0:1746142919.845795:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142919.846172:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+13:2005:x1830962867654400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1330us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142919.846179:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6786 00000100:00100000:0.0:1746142919.846704:0:7217:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7217:1830962867926528:192.168.204.50@tcp:105: 00010000:00010000:0.0:1746142919.846718:0:7217:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142919.846748:0:7217:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867654528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1777us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142919.846754:0:7217:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6787 00000100:00100000:0.0:1746142919.847818:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.849692:0:9584:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867654784 00000100:00100000:3.0:1746142919.849704:0:9584:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867654784 00002000:00100000:3.0:1746142919.849741:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1519616->1523711) req@ffff88013644e300 x1830962867654784/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.849751:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e300 with x1830962867654784 ext(1519616->1523711) 00002000:00010000:3.0:1746142919.849756:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644e300 00000100:00100000:3.0:1746142919.849777:0:9584:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4705 00000100:00100000:3.0:1746142919.849784:0:9584:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867654784:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:3.0:1746142919.849970:0:9584:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867654784:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 185us (2153us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746142919.849976:0:9584:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4705 00002000:00100000:3.0:1746142919.849981:0:9584:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x79:0x0] (1519616->1523711) req@ffff88013644e300 x1830962867654784/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746142919.849988:0:9584:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013644e300 with x1830962867654784 ext(1519616->1523711) 00002000:00010000:3.0:1746142919.849991:0:9584:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013644e300 00000100:00100000:0.0:1746142919.857775:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142919.857860:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867654912 00000100:00100000:1.0:1746142919.857868:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867654912 00000100:00100000:1.0:1746142919.857947:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14934 00000100:00100000:1.0:1746142919.857955:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:310:x1830962867654912:12345-192.168.204.50@tcp:101:multiop.0 00010000:00010000:1.0:1746142919.857971:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746142919.857986:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b7fa expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.858008:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.858020:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.858026:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.858028:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142919.858030:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1388543] (req 1048576->1388543) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.858055:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.858065:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.858075:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867926656:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.858154:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.858162:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 9 pid: 9579 timeout: 793 lvb_type: 0 00000100:00100000:1.0:1746142919.858173:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867926784:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.858202:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff880096ff9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746142919.859602:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867926656:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142919.859611:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11943:1830962867926784:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142919.859629:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [1048576->1388543] (req 1048576->1388543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 25 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142919.859641:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d75600, rc 0) 00000100:00100000:1.0:1746142919.859665:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:310:x1830962867654912:12345-192.168.204.50@tcp:101:multiop.0 Request processed in 1710us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142919.859671:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14934 00000100:00100000:0.0:1746142919.862287:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142919.862335:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142919.862406:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867655040 00000100:00100000:3.0:1746142919.862414:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867655040 00010000:00010000:3.0:1746142919.862444:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.862469:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867655168 00000100:00100000:3.0:1746142919.862472:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867655168 00010000:00010000:3.0:1746142919.862481:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 10 pid: 9579 timeout: 793 lvb_type: 0 00000100:00100000:3.0:1746142919.862508:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6788 00000100:00100000:3.0:1746142919.862515:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867655040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.862528:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.862546:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.862556:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.862574:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c3a400/0x2fa243e067cceaa0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b79f expref: 25 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.862589:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.862618:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867655040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.862624:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6788 00000100:00100000:3.0:1746142919.862636:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6789 00000100:00100000:3.0:1746142919.862640:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2005:x1830962867655168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142919.862647:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142919.862654:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 10 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.862663:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 10 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.862674:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75c00/0x2fa243e067ccea99 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b798 expref: 10 pid: 9579 timeout: 793 lvb_type: 0 00010000:00010000:3.0:1746142919.862681:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.862684:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142919.862689:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 23 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.862695:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 23 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142919.862721:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 23 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142919.862732:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867926912:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142919.862779:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142919.863850:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867926912:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142919.863863:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142919.863882:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad4f1515-ae46-4d91-8f96-492179af7039+9:2005:x1830962867655168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1241us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142919.863889:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6789 00000100:00100000:0.0:1746142919.867668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.867741:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867655424 00000100:00100000:2.0:1746142919.867749:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867655424 00002000:00100000:2.0:1746142919.867786:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1384448->1388543) req@ffff880098190380 x1830962867655424/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/0 e 0 to 0 dl 1746142930 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.867800:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098190380 with x1830962867655424 ext(1384448->1388543) 00002000:00010000:2.0:1746142919.867805:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098190380 00000100:00100000:2.0:1746142919.867832:0:29475:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4706 00000100:00100000:2.0:1746142919.867839:0:29475:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867655424:12345-192.168.204.50@tcp:3:multiop.0 00000100:00100000:2.0:1746142919.867980:0:29475:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867655424:12345-192.168.204.50@tcp:3:multiop.0 Request processed in 141us (319us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746142919.867986:0:29475:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4706 00002000:00100000:2.0:1746142919.867992:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x99:0x0] (1384448->1388543) req@ffff880098190380 x1830962867655424/t0(0) o3->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:70/0 lens 488/4536 e 0 to 0 dl 1746142930 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142919.867998:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098190380 with x1830962867655424 ext(1384448->1388543) 00002000:00010000:2.0:1746142919.868001:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098190380 00000100:00100000:0.0:1746142919.869726:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142919.870189:0:16092:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867655680 00000100:00100000:2.0:1746142919.870204:0:16092:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867655680 00000100:00100000:2.0:1746142919.870236:0:16092:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5365 00000100:00100000:2.0:1746142919.870242:0:16092:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:310:x1830962867655680:12345-192.168.204.50@tcp:35:multiop.0 00000100:00100000:2.0:1746142919.870402:0:16092:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:310:x1830962867655680:12345-192.168.204.50@tcp:35:multiop.0 Request processed in 159us (679us total) trans 8589936797 rc 0/0 00000100:00100000:2.0:1746142919.870409:0:16092:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5365 00010000:00010000:3.0:1746142920.130054:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142920.474715:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142920.474753:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.474777:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867655936 00000100:00100000:0.0:1746142920.474779:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.474785:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867655936 00000100:00100000:0.0:1746142920.474795:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656192 00000100:00100000:0.0:1746142920.474799:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656192 00000100:00100000:1.0:1746142920.474818:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656448 00000100:00100000:1.0:1746142920.474821:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656448 00000100:00100000:0.0:1746142920.474842:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14935 00000100:00100000:0.0:1746142920.474849:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+13:2006:x1830962867655936:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:1.0:1746142920.474885:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14936 00000100:00100000:1.0:1746142920.474891:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867656192:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:0.0:1746142920.474945:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.474961:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656704 00000100:00100000:1.0:1746142920.474963:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656704 00000100:00100000:1.0:1746142920.474977:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14937 00000100:00100000:1.0:1746142920.474981:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867656448:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:1.0:1746142920.475075:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14938 00000100:00100000:1.0:1746142920.475080:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+14:2006:x1830962867656704:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:0.0:1746142920.475086:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142920.475101:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.475109:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867655808 00000100:00100000:1.0:1746142920.475111:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867655808 00000100:00100000:0.0:1746142920.475117:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.475119:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656064 00000100:00100000:1.0:1746142920.475121:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656064 00000100:00100000:1.0:1746142920.475127:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14939 00000100:00100000:1.0:1746142920.475130:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867655808:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:0.0:1746142920.475140:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142920.475154:0:29475:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656320 00000100:00100000:0.0:1746142920.475157:0:29475:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656320 00000100:00100000:1.0:1746142920.475176:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+12:2006:x1830962867655808:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 45us (91us total) trans 0 rc 0/0 00002000:00100000:0.0:1746142920.475176:0:29475:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3883007) req@ffff880098191c00 x1830962867656320/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:71/0 lens 488/0 e 0 to 0 dl 1746142931 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746142920.475193:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14939 00002000:00100000:0.0:1746142920.475200:0:29475:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191c00 with x1830962867656320 ext(3145728->3883007) 00000100:00100000:1.0:1746142920.475204:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14940 00002000:00010000:0.0:1746142920.475204:0:29475:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191c00 00000100:00100000:1.0:1746142920.475207:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+15:2006:x1830962867656064:12345-192.168.204.50@tcp:16:kworker.0 00000100:00100000:0.0:1746142920.475219:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656576 00000100:00100000:0.0:1746142920.475222:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656576 00002000:00100000:0.0:1746142920.475234:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x7b:0x0] (3014656->3145727) req@ffff880098193100 x1830962867656576/t0(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:71/0 lens 488/0 e 0 to 0 dl 1746142931 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142920.475240:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098193100 with x1830962867656576 ext(3014656->3145727) 00002000:00010000:0.0:1746142920.475243:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098193100 00000100:00100000:0.0:1746142920.475252:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4707 00000100:00100000:0.0:1746142920.475257:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867656320:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:1.0:1746142920.475276:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4708 00000100:00100000:1.0:1746142920.475281:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+16:2006:x1830962867656576:12345-192.168.204.50@tcp:4:multiop.0 00000001:00080000:0.0:1746142920.480154:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841328 is committed 00000001:00080000:0.0:1746142920.480167:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841327 is committed 00000001:00080000:0.0:1746142920.480172:0:30378:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841326 is committed 00000001:00080000:1.0:1746142920.480731:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874080 is committed 00000001:00080000:1.0:1746142920.480739:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874079 is committed 00000001:00080000:1.0:1746142920.480765:0:31998:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874052 is committed 00000100:00100000:1.0:1746142920.480853:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:ad4f1515-ae46-4d91-8f96-492179af7039+11:2006:x1830962867656064:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 5640us (5746us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142920.480862:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14940 00000100:00100000:1.0:1746142920.481019:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867656704:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 5938us (6073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142920.481024:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14938 00000100:00100000:2.0:1746142920.482930:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867656448:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 7943us (8145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142920.482930:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+10:2006:x1830962867656192:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 8035us (8173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142920.482939:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14937 00000100:00100000:1.0:1746142920.482943:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14936 00000100:00100000:2.0:1746142920.483017:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098190000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867655936:12345-192.168.204.50@tcp:16:kworker.0 Request processed in 8168us (8309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142920.483026:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14935 00000100:00100000:1.0:1746142920.488102:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098193100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867656576:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 12813us (12953us total) trans 17179874081 rc 0/0 00000100:00100000:1.0:1746142920.488112:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4708 00002000:00100000:1.0:1746142920.488122:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x7b:0x0] (3014656->3145727) req@ffff880098193100 x1830962867656576/t17179874081(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:71/0 lens 488/448 e 0 to 0 dl 1746142931 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142920.488130:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098193100 with x1830962867656576 ext(3014656->3145727) 00002000:00010000:1.0:1746142920.488135:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098193100 00000100:00100000:2.0:1746142920.491470:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:ad4f1515-ae46-4d91-8f96-492179af7039+9:2006:x1830962867656320:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 16205us (16344us total) trans 21474841329 rc 0/0 00000100:00100000:2.0:1746142920.491480:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4707 00002000:00100000:2.0:1746142920.491490:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x9b:0x0] (3145728->3883007) req@ffff880098191c00 x1830962867656320/t21474841329(0) o4->ad4f1515-ae46-4d91-8f96-492179af7039@192.168.204.50@tcp:71/0 lens 488/448 e 0 to 0 dl 1746142931 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142920.491497:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098191c00 with x1830962867656320 ext(3145728->3883007) 00002000:00010000:2.0:1746142920.491502:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098191c00 00000100:00100000:0.0:1746142920.495895:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142920.496085:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142920.496105:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.496333:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656832 00000100:00100000:1.0:1746142920.496341:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656832 00000100:00100000:1.0:1746142920.496550:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867656960 00000100:00100000:1.0:1746142920.496553:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867656960 00000100:00100000:0.0:1746142920.496584:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142920.496631:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867657088 00000100:00100000:3.0:1746142920.496635:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867657088 00000100:00100000:0.0:1746142920.496652:0:11911:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 788 00000100:00100000:3.0:1746142920.496661:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 789 00000100:00100000:3.0:1746142920.496667:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9590e9a3-538a-49d5-a431-e1408ed78761+17:2006:x1830962867656960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142920.496679:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142920.496682:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 790 00000100:00100000:1.0:1746142920.496687:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9590e9a3-538a-49d5-a431-e1408ed78761+17:2006:x1830962867657088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142920.496692:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142920.496694:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009ab29000/0x2fa243e067cc27d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb84721 expref: 17 pid: 8100 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142920.496697:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009ab28000/0x2fa243e067cc27db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb84728 expref: 17 pid: 8097 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142920.496708:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142920.496708:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142920.496750:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9590e9a3-538a-49d5-a431-e1408ed78761+15:2006:x1830962867656960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142920.496756:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 789 00000100:00100000:3.0:1746142920.496787:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867657472 00000100:00100000:3.0:1746142920.496789:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867657472 00000100:00100000:3.0:1746142920.496807:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14941 00000100:00100000:0.0:1746142920.496810:0:11911:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9590e9a3-538a-49d5-a431-e1408ed78761+14:2005:x1830962867656832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746142920.496811:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+9:2002:x1830962867657472:12345-192.168.204.50@tcp:9:umount.0 00010000:00010000:0.0:1746142920.496816:0:11911:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142920.496822:0:11911:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009ab28200/0x2fa243e067cc27cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb846f0 expref: 14 pid: 8097 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1746142920.496829:0:1397:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc27f7 00010000:00010000:0.0:1746142920.496831:0:11911:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00010000:3.0:1746142920.496834:0:1397:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8801356af000: total 0 00000100:00080000:3.0:1746142920.496836:0:1397:0:(import.c:66:import_set_state_nolock()) ffff8801356aa000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1746142920.496850:0:11911:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9590e9a3-538a-49d5-a431-e1408ed78761+13:2005:x1830962867656832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142920.496855:0:11911:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 788 00000001:00000004:3.0:1746142920.496866:0:1397:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874081 00000020:00010000:0.0:1746142920.496914:0:7220:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8801356af000: total 0 00010000:00010000:0.0:1746142920.496945:0:7220:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8801356af000, canceled 0 locks, left on hash table 2. 00000100:00100000:3.0:1746142920.496965:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:ad4f1515-ae46-4d91-8f96-492179af7039+7:2002:x1830962867657472:12345-192.168.204.50@tcp:9:umount.0 Request processed in 152us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142920.496969:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14941 00010000:00010000:0.0:1746142920.496974:0:7220:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d75a00/0x2fa243e067cceb1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3014656->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7e5 expref: 7 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142920.496995:0:7220:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cd8f600/0x2fa243e067ccea45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b744 expref: 5 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142920.497004:0:7220:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8801356af000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746142920.497013:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746142920.497014:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746142920.497016:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746142920.497070:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9590e9a3-538a-49d5-a431-e1408ed78761+12:2006:x1830962867657088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 58us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142920.497075:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 790 00000100:00100000:0.0:1746142920.503979:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142920.504075:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867657856 00000100:00100000:2.0:1746142920.504082:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867657856 00000100:00100000:2.0:1746142920.504126:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14942 00000100:00100000:2.0:1746142920.504132:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+9:2002:x1830962867657856:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:2.0:1746142920.504154:0:11943:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc27f0 00000020:00010000:2.0:1746142920.504158:0:11943:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a7612000: total 0 00000100:00080000:2.0:1746142920.504160:0:11943:0:(import.c:66:import_set_state_nolock()) ffff8800a7611800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746142920.504207:0:11943:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841329 00000020:00010000:0.0:1746142920.504276:0:7549:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a7612000: total 0 00010000:00010000:0.0:1746142920.504306:0:7549:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a7612000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746142920.504346:0:7549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75400/0x2fa243e067cceb25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->3883007) gid 0 flags: 0x44801000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7ec expref: 8 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142920.504371:0:7549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e670200/0x2fa243e067ccea30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b73d expref: 7 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142920.504379:0:7549:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a7612000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746142920.504389:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746142920.504390:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746142920.504392:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746142920.504475:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ad4f1515-ae46-4d91-8f96-492179af7039+4:2002:x1830962867657856:12345-192.168.204.50@tcp:9:umount.0 Request processed in 341us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142920.504482:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14942 00000100:00100000:0.0:1746142920.513820:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.513872:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658240 00000100:00100000:1.0:1746142920.513880:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658240 00000100:00100000:1.0:1746142920.514136:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14595 00000100:00100000:1.0:1746142920.514144:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+14:2002:x1830962867658240:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:1.0:1746142920.514176:0:13326:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc27e2 00000020:00010000:1.0:1746142920.514199:0:13326:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b4b4e000: total 0 00000100:00080000:1.0:1746142920.514203:0:13326:0:(import.c:66:import_set_state_nolock()) ffff8800b4b49000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746142920.514337:0:13326:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936797 00000020:00010000:3.0:1746142920.514499:0:8380:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b4b4e000: total 0 00010000:00010000:3.0:1746142920.514535:0:8380:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b4b4e000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1746142920.514559:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142920.514562:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746142920.514568:0:8380:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129fb7800/0x2fa243e067cc28b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb847e5 expref: 13 pid: 10924 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142920.514986:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+12:2002:x1830962867658240:12345-192.168.204.50@tcp:39:umount.0 Request processed in 842us (1174us total) trans 8589936798 rc 0/0 00000100:00100000:1.0:1746142920.514993:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14595 00010000:00010000:3.0:1746142920.515555:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142920.515558:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142920.515563:0:8380:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135d74800/0x2fa243e067cceaed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7d7 expref: 11 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142920.515575:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142920.515577:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142920.515580:0:8380:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d3400/0x2fa243e067ccea7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b77c expref: 10 pid: 22383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142920.515588:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142920.515590:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746142920.515593:0:8380:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2a00/0x2fa243e067ccea6f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b76e expref: 9 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142920.516198:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142920.516202:0:8380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1746142920.516206:0:8380:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d7800/0x2fa243e067cc6d4f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb86f29 expref: 8 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142920.516217:0:8380:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b4b4e000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1746142920.516238:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746142920.516240:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746142920.516242:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142920.524106:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142920.524448:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658368 00000100:00100000:1.0:1746142920.524456:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658368 00000100:00100000:1.0:1746142920.525547:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14596 00000100:00100000:1.0:1746142920.525557:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+5:2002:x1830962867658368:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:1.0:1746142920.525586:0:13326:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc27e9 00000100:00080000:1.0:1746142920.525592:0:13326:0:(import.c:66:import_set_state_nolock()) ffff8800a7615800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746142920.525608:0:13326:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294976111 00010000:00010000:3.0:1746142920.525998:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1746142920.526069:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746142920.526663:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ad4f1515-ae46-4d91-8f96-492179af7039+3:2002:x1830962867658368:12345-192.168.204.50@tcp:39:umount.0 Request processed in 1104us (2559us total) trans 4294976112 rc 0/0 00000100:00100000:1.0:1746142920.526671:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14596 00010000:00010000:2.0:1746142921.133373:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142921.147817:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.147927:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.148306:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142921.148674:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658496 00000100:00100000:1.0:1746142921.148682:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658496 00000100:00100000:1.0:1746142921.148718:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658624 00000100:00100000:1.0:1746142921.148720:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658624 00000100:00100000:2.0:1746142921.148778:0:7217:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867658752 00000100:00100000:2.0:1746142921.148782:0:7217:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867658752 00000100:00100000:0.0:1746142921.148814:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 791 00000100:00100000:0.0:1746142921.148821:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9590e9a3-538a-49d5-a431-e1408ed78761+14:2004:x1830962867658496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142921.148832:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142921.148854:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800927fde00/0x2fa243e067cc27fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb84759 expref: 14 pid: 8097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.148871:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142921.148921:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9590e9a3-538a-49d5-a431-e1408ed78761+13:2004:x1830962867658496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142921.148927:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 791 00000100:00100000:0.0:1746142921.148941:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 792 00000100:00100000:0.0:1746142921.148946:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9590e9a3-538a-49d5-a431-e1408ed78761+12:2004:x1830962867658624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142921.148952:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142921.148958:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800927fc800/0x2fa243e067cc2805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8478a expref: 12 pid: 8097 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.148966:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142921.148978:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9590e9a3-538a-49d5-a431-e1408ed78761+11:2004:x1830962867658624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 32us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142921.148983:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 792 00000100:00100000:0.0:1746142921.148991:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 793 00000100:00100000:0.0:1746142921.148995:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9590e9a3-538a-49d5-a431-e1408ed78761+10:2003:x1830962867658752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746142921.149000:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746142921.149006:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800927fca00/0x2fa243e067cc280c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb84791 expref: 10 pid: 8100 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.149012:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746142921.149022:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9590e9a3-538a-49d5-a431-e1408ed78761+9:2003:x1830962867658752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 27us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142921.149026:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 793 00000100:00100000:0.0:1746142921.150755:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.151150:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867659392 00000100:00100000:2.0:1746142921.151155:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867659392 00000100:00100000:2.0:1746142921.151198:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14943 00000100:00100000:2.0:1746142921.151205:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+9:2002:x1830962867659392:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:2.0:1746142921.151225:0:11943:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc2828 00000020:00010000:2.0:1746142921.151230:0:11943:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d35a000: total 0 00000100:00080000:2.0:1746142921.151232:0:11943:0:(import.c:66:import_set_state_nolock()) ffff88012d35e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746142921.151544:0:11943:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874081 00000100:00100000:2.0:1746142921.151626:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c8243383-433c-45fe-9bef-8828afa9ff81+7:2002:x1830962867659392:12345-192.168.204.50@tcp:9:umount.0 Request processed in 422us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.151631:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14943 00000100:00080000:0.0:1746142921.151701:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:1.0:1746142921.151726:0:7549:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d35a000: total 0 00010000:00010000:1.0:1746142921.151729:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746142921.151759:0:7549:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d35a000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1746142921.151791:0:7549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe4c00/0x2fa243e067cc6c3e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2744320->2756607) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb86eb2 expref: 6 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.151829:0:7549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e690000/0x2fa243e067cc6f71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87079 expref: 5 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.151847:0:7549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe5200/0x2fa243e067cc6c45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5890048->5902335) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb86eb9 expref: 4 pid: 1397 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.151860:0:7549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097106c00/0x2fa243e067cc5308 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3616768->3649535) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb85f5b expref: 3 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.151870:0:7549:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d35a000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1746142921.151882:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746142921.151884:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746142921.151885:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142921.156566:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.157245:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867659648 00000100:00100000:2.0:1746142921.157252:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867659648 00000100:00100000:2.0:1746142921.158074:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14944 00000100:00100000:2.0:1746142921.158094:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+6:2002:x1830962867659648:12345-192.168.204.50@tcp:9:umount.0 00000020:00000080:2.0:1746142921.158120:0:1397:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc2821 00000020:00010000:2.0:1746142921.158126:0:1397:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012d35a800: total 0 00000100:00080000:2.0:1746142921.158130:0:1397:0:(import.c:66:import_set_state_nolock()) ffff88012d35e000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1746142921.159259:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:2.0:1746142921.160153:0:1397:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841329 00000100:00100000:2.0:1746142921.160284:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c8243383-433c-45fe-9bef-8828afa9ff81+4:2002:x1830962867659648:12345-192.168.204.50@tcp:9:umount.0 Request processed in 2200us (3722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.160291:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14944 00000020:00010000:3.0:1746142921.160335:0:8380:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012d35a800: total 0 00010000:00010000:3.0:1746142921.160361:0:8380:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012d35a800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1746142921.160398:0:8380:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009337a200/0x2fa243e067cc6f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->36863) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb87095 expref: 3 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.160427:0:8380:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012d35a800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1746142921.160435:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746142921.160437:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746142921.160438:0:8380:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746142921.168986:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142921.169140:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867659904 00000100:00100000:1.0:1746142921.169148:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867659904 00000100:00100000:1.0:1746142921.169216:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14597 00000100:00100000:1.0:1746142921.169224:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+6:2002:x1830962867659904:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:1.0:1746142921.169255:0:13326:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc2813 00000020:00010000:1.0:1746142921.169261:0:13326:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8801356ad000: total 0 00000100:00080000:1.0:1746142921.169265:0:13326:0:(import.c:66:import_set_state_nolock()) ffff8801356a9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746142921.169288:0:13326:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589936798 00000020:00010000:3.0:1746142921.169296:0:7221:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8801356ad000: total 0 00010000:00010000:3.0:1746142921.169333:0:7221:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8801356ad000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1746142921.169357:0:7221:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880098e43600) 00010000:00010000:3.0:1746142921.169360:0:7221:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746142921.169366:0:7221:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927fda00/0x2fa243e067cc2836 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb847c2 expref: 5 pid: 7232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142921.169385:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+4:2002:x1830962867659904:12345-192.168.204.50@tcp:39:umount.0 Request processed in 162us (406us total) trans 8589936799 rc 0/0 00010000:00010000:3.0:1746142921.169386:0:7221:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8801356ad000, canceled 1 locks, left on hash table 0. 00000100:00100000:1.0:1746142921.169391:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14597 00010000:00010000:3.0:1746142921.169394:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746142921.169395:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746142921.169397:0:7221:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1746142921.169412:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746142921.175506:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1746142921.175587:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660032 00000100:00100000:1.0:1746142921.175594:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660032 00000100:00100000:1.0:1746142921.175655:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14598 00000100:00100000:1.0:1746142921.175663:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+5:2002:x1830962867660032:12345-192.168.204.50@tcp:39:umount.0 00000020:00000080:1.0:1746142921.175689:0:13326:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x2fa243e067cc281a 00000100:00080000:1.0:1746142921.175695:0:13326:0:(import.c:66:import_set_state_nolock()) ffff88012d35d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746142921.175710:0:13326:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294976112 00000100:00100000:1.0:1746142921.175803:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c8243383-433c-45fe-9bef-8828afa9ff81+3:2002:x1830962867660032:12345-192.168.204.50@tcp:39:umount.0 Request processed in 141us (303us total) trans 4294976113 rc 0/0 00000100:00100000:1.0:1746142921.175809:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14598 00010000:00010000:1.0:1746142921.175836:0:7220:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1746142921.175930:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746142921.237851:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.237927:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.238004:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660160 00000100:00100000:2.0:1746142921.238012:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660160 00000100:00100000:2.0:1746142921.238055:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660288 00000100:00100000:2.0:1746142921.238057:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660288 00000100:00100000:2.0:1746142921.238081:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14945 00000100:00100000:2.0:1746142921.238088:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2005:x1830962867660160:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.238102:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.238118:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b801 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142921.238137:0:1397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c8, atime: 0x681406c8, ctime: 0x681406c8, blocks: 0x16b0 00010000:00010000:2.0:1746142921.238151:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.238152:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.238159:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.238198:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 23 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.238207:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe7400, rc 0) 00000100:00100000:2.0:1746142921.238242:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2005:x1830962867660160:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 155us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.238247:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14945 00000100:00100000:2.0:1746142921.238259:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14946 00000100:00100000:2.0:1746142921.238263:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867660288:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.238269:0:1397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.238277:0:1397:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b808 expref: -99 pid: 1397 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142921.238288:0:1397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c8, atime: 0x681406c8, ctime: 0x681406c8, blocks: 0x1008 00010000:00010000:2.0:1746142921.238294:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.238296:0:1397:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.238299:0:1397:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.238312:0:1397:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 26 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.238319:0:1397:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6000, rc 0) 00000100:00100000:2.0:1746142921.238331:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867660288:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 68us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.238335:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14946 00000100:00080000:0.0:1746142921.238550:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746142921.238554:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746142921.241999:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.242082:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660544 00000100:00100000:2.0:1746142921.242089:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660544 00000100:00080000:0.0:1746142921.242138:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746142921.242717:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14599 00000100:00100000:2.0:1746142921.242725:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:356:x1830962867660544:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.242741:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.242754:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b80f expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.242828:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.242839:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 33 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.242845:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.242867:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 33 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.242881:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 33 pid: 7230 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746142921.242890:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867927040:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.243456:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.244606:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867927040:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.244620:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142921.244794:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.245072:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660672 00000100:00100000:3.0:1746142921.245076:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660672 00010000:00010000:3.0:1746142921.245097:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 34 pid: 7230 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746142921.245377:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6790 00000100:00100000:3.0:1746142921.245384:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2003:x1830962867660672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.245394:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.245399:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 34 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.245508:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 34 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.245524:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea52000/0x2fa243e067cceb10 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7de expref: 34 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.245571:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142921.245575:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.245591:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.245596:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.245681:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.245719:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867660672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 335us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.245725:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6790 00010000:00010000:2.0:1746142921.245768:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.245773:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142921.245786:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142921.245874:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.245888:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 33 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.245894:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.245896:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746142921.246412:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d2200, rc 0) 00000100:00100000:2.0:1746142921.246446:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:356:x1830962867660544:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 3723us (4452us total) trans 8589936800 rc 0/0 00000100:00100000:2.0:1746142921.246452:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14599 00000100:00100000:0.0:1746142921.248223:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.248283:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660800 00000100:00100000:2.0:1746142921.248289:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660800 00000100:00100000:2.0:1746142921.248454:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14600 00000100:00100000:2.0:1746142921.248461:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:356:x1830962867660800:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.248477:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.248488:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cceb5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b816 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.248547:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.248557:0:7230:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.248562:0:7230:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.248582:0:7230:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.248591:0:7230:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 34 pid: 7230 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746142921.248600:0:7230:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867927168:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.249024:0:7230:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.249969:0:7230:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7230:1830962867927168:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.249983:0:7230:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142921.250330:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.250469:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867660928 00000100:00100000:3.0:1746142921.250474:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867660928 00010000:00010000:3.0:1746142921.250493:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 35 pid: 7230 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746142921.250651:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6791 00000100:00100000:3.0:1746142921.250658:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2006:x1830962867660928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.250667:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.250672:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 35 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.250681:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 35 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.250695:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2200/0x2fa243e067cceb4f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x55:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b80f expref: 35 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.250705:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142921.250708:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.250715:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.250720:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.250742:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.250776:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2006:x1830962867660928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 118us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.250782:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6791 00010000:00010000:2.0:1746142921.250938:0:7230:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.250943:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142921.250974:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:2.0:1746142921.250977:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746142921.250988:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.251009:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d2a00/0x2fa243e067cceb5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b816 expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.251018:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b816 expref: 33 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.251023:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.251026:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746142921.251028:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3e00, rc 0) 00000100:00100000:2.0:1746142921.251062:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:356:x1830962867660800:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2602us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.251068:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14600 00000100:00100000:0.0:1746142921.252882:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.253048:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661184 00000100:00100000:2.0:1746142921.253054:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661184 00000100:00100000:2.0:1746142921.253092:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14601 00000100:00100000:2.0:1746142921.253099:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:356:x1830962867661184:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.253113:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.253125:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6600/0x2fa243e067cceb6b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b81d expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.253210:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3a00/0x2fa243e067cceb72 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.253219:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3a00/0x2fa243e067cceb72 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.253227:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3a00/0x2fa243e067cceb72 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:2.0:1746142921.253235:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00010000:00010000:2.0:1746142921.253999:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6600/0x2fa243e067cceb6b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b81d expref: 36 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.254012:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3a00/0x2fa243e067cceb72 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b81d expref: 35 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.254019:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.254021:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746142921.254023:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d3a00, rc 0) 00000100:00100000:2.0:1746142921.254279:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:356:x1830962867661184:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1179us (1400us total) trans 8589936801 rc 0/0 00000100:00100000:2.0:1746142921.254285:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14601 00000100:00100000:2.0:1746142921.257668:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.257704:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.257921:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.258548:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661312 00000100:00100000:3.0:1746142921.258555:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661312 00000100:00100000:2.0:1746142921.258560:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661440 00000100:00100000:2.0:1746142921.258564:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661440 00000100:00100000:2.0:1746142921.258584:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661696 00000100:00100000:2.0:1746142921.258585:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661696 00000100:00100000:3.0:1746142921.258598:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14947 00000100:00100000:3.0:1746142921.258605:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867661440:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142921.258645:0:11943:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.258660:0:11943:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 26 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.258667:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.258669:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.258671:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.258694:0:11943:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 26 pid: 11943 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746142921.258925:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14948 00000100:00100000:0.0:1746142921.258932:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14949 00000100:00100000:2.0:1746142921.258933:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867661312:12345-192.168.204.50@tcp:1:lfs.0 00000100:00100000:0.0:1746142921.258940:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867661696:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:2.0:1746142921.258953:0:9579:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.258956:0:1852:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.258964:0:9579:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142921.258965:0:1852:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.258970:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142921.258970:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142921.258971:0:9579:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142921.258971:0:1852:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746142921.258973:0:9579:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.258973:0:1852:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.258985:0:1852:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.258988:0:9579:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 24 pid: 1854 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746142921.258993:0:1852:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746142921.258997:0:9579:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 24 pid: 1854 timeout: 795 lvb_type: 1 00000100:00100000:0.0:1746142921.259003:0:1852:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867927424:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.259005:0:9579:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867927552:192.168.204.50@tcp:104: 00000100:00100000:0.0:1746142921.259067:0:1852:0:(client.c:2553:ptlrpc_set_wait()) set ffff880132433c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746142921.259334:0:11943:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 26 pid: 11943 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.259345:0:11943:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867927296:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142921.259384:0:11943:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06840 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.259418:0:9579:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.259444:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.260258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.260291:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.260304:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661952 00000100:00100000:2.0:1746142921.260308:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661952 00000100:00100000:2.0:1746142921.260323:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661568 00000100:00100000:2.0:1746142921.260325:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661568 00000100:00100000:2.0:1746142921.260711:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867661824 00000100:00100000:2.0:1746142921.260714:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867661824 00000100:00100000:1.0:1746142921.260868:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14950 00000100:00100000:3.0:1746142921.260959:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14951 00000100:00100000:1.0:1746142921.260961:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867661952:12345-192.168.204.50@tcp:1:lfs.0 00000100:00100000:3.0:1746142921.260967:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867661568:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142921.260986:0:11421:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.260986:0:9578:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.260997:0:11421:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.260997:0:9578:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.261003:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142921.261003:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.261004:0:11421:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746142921.261005:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.261006:0:11421:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.261007:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.261025:0:11421:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 28 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.261025:0:9578:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 28 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.261033:0:11421:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 28 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746142921.261033:0:9578:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 28 pid: 1397 timeout: 795 lvb_type: 1 00000100:00100000:1.0:1746142921.261041:0:9578:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867927680:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142921.261042:0:11421:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867927808:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142921.261078:0:11421:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746142921.261095:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14952 00000100:00100000:3.0:1746142921.261101:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867661824:12345-192.168.204.50@tcp:1:lfs.0 00010000:00010000:3.0:1746142921.261115:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.261124:0:1854:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.261128:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.261129:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.261131:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.261144:0:1854:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 25 pid: 1397 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.261151:0:1854:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 25 pid: 1397 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.261159:0:1854:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867927936:192.168.204.50@tcp:104: 00000100:00100000:1.0:1746142921.261661:0:9578:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fceba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746142921.261844:0:1854:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06300 going to sleep for 11 seconds 00000100:00100000:1.0:1746142921.262877:0:1852:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:1852:1830962867927424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1746142921.262894:0:1852:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.263110:0:9579:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9579:1830962867927552:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.263123:0:9579:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.263306:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.263373:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.263540:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662208 00000100:00100000:2.0:1746142921.263544:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662208 00002000:00100000:2.0:1746142921.263574:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1388543) req@ffff88012c0e1500 x1830962867662208/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:72/0 lens 488/0 e 0 to 0 dl 1746142932 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746142921.263583:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1500 with x1830962867662208 ext(1048576->1388543) 00010000:00010000:2.0:1746142921.263589:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 26 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:2.0:1746142921.263599:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 26 pid: 11943 timeout: 795 lvb_type: 0 00002000:00010000:2.0:1746142921.263605:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0e1500 00000100:00100000:2.0:1746142921.263630:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1457 00000100:00100000:2.0:1746142921.263637:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867662208:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:3.0:1746142921.263827:0:11943:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11943:1830962867927296:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142921.263840:0:11943:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.264264:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.264591:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662080 00000100:00100000:3.0:1746142921.264594:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662080 00010000:00010000:3.0:1746142921.264609:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 28 pid: 1854 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.264626:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6792 00000100:00100000:3.0:1746142921.264630:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867662080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.264638:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.264649:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 28 pid: 1854 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.264658:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 28 pid: 1854 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.264674:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fbb200/0x2fa243e067cce9f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b70c expref: 28 pid: 1854 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.264688:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.264691:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.264694:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264700:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264713:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.264735:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867662080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.264739:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6792 00010000:00010000:3.0:1746142921.264760:0:9579:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264766:0:9579:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264778:0:9579:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264784:0:9579:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264789:0:9579:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264795:0:9579:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe6200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142921.264798:0:9579:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264808:0:9579:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264817:0:9579:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.264823:0:9579:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe6200/0x2fa243e067cceb87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9579 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.264859:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867661312:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 5928us (7197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.264866:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14948 00000100:00100000:1.0:1746142921.264949:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662464 00000100:00100000:1.0:1746142921.264953:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662464 00002000:00100000:1.0:1746142921.264971:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1519616->2097151) req@ffff88009862ce00 x1830962867662464/t0(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:72/0 lens 488/0 e 0 to 0 dl 1746142932 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746142921.264983:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862ce00 with x1830962867662464 ext(1519616->2097151) 00010000:00010000:1.0:1746142921.264989:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 29 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:1.0:1746142921.264998:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 29 pid: 11943 timeout: 795 lvb_type: 0 00002000:00010000:1.0:1746142921.265003:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009862ce00 00000100:00100000:1.0:1746142921.265015:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1458 00000100:00100000:1.0:1746142921.265020:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867662464:12345-192.168.204.50@tcp:4:multiop.0 00000100:00100000:2.0:1746142921.265258:0:11421:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11421:1830962867927808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.265270:0:11421:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.269258:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.269276:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662336 00000100:00100000:3.0:1746142921.269281:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662336 00000100:00100000:1.0:1746142921.269291:0:9578:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880096af1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9578:1830962867927680:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142921.269303:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746142921.269312:0:9578:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.269320:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6793 00000100:00100000:3.0:1746142921.269324:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867662336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.269331:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.269344:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.269350:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.269365:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e670400/0x2fa243e067ccea06 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b713 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.269373:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.269375:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.269377:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.269382:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.269457:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.269482:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867662336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 157us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.269486:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6793 00000100:00100000:3.0:1746142921.269677:0:1854:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:1854:1830962867927936:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142921.269689:0:1854:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.271402:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.271431:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.271447:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662720 00000100:00100000:3.0:1746142921.271452:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662720 00010000:00010000:3.0:1746142921.271473:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 26 pid: 1397 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.271510:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662592 00000100:00100000:3.0:1746142921.271513:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662592 00010000:00010000:3.0:1746142921.271522:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 30 pid: 1397 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.271537:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6794 00000100:00100000:3.0:1746142921.271543:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867662720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746142921.271548:0:13297:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6795 00010000:00010000:3.0:1746142921.271552:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746142921.271555:0:13297:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867662592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746142921.271564:0:13297:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.271567:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 26 pid: 1397 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.271575:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 26 pid: 1397 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746142921.271576:0:13297:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 30 pid: 1397 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746142921.271584:0:13297:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 30 pid: 1397 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.271592:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7400/0x2fa243e067cceb3a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b801 expref: 26 pid: 1397 timeout: 795 lvb_type: 1 00010000:00010000:1.0:1746142921.271596:0:13297:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cbe6000/0x2fa243e067cceb41 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b808 expref: 30 pid: 1397 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.271605:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.271606:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.271609:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271609:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142921.271611:0:13297:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142921.271613:0:13297:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.271616:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271619:0:13297:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.271632:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746142921.271633:0:13297:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142921.271705:0:11943:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271713:0:11943:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142921.271720:0:13297:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867662592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 165us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142921.271727:0:13297:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6795 00010000:00010000:0.0:1746142921.271727:0:11943:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271733:0:11943:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271738:0:11943:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271743:0:11943:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6e6600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746142921.271746:0:11943:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271752:0:11943:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271762:0:11943:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.271771:0:11943:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6600/0x2fa243e067cceb80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271798:0:9578:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271804:0:9578:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.271813:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867661440:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 13208us (14107us total) trans 0 rc 0/0 00010000:00010000:1.0:1746142921.271815:0:9578:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.271819:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14947 00010000:00010000:1.0:1746142921.271820:0:9578:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271826:0:9578:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271836:0:9578:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135d74e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142921.271838:0:9578:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271843:0:9578:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271852:0:9578:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.271857:0:9578:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74e00/0x2fa243e067cceb9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142921.271885:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867661952:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 10926us (12440us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142921.271891:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14950 00010000:00010000:2.0:1746142921.272590:0:1854:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272603:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272615:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272620:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272626:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272631:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6e7a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142921.272634:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272639:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272648:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.272652:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e6e7a00/0x2fa243e067cceba3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.272698:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867661824:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 11596us (12405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.272704:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14952 00000100:00100000:3.0:1746142921.272943:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a359180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2006:x1830962867662720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1398us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.272949:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6794 00000100:00100000:0.0:1746142921.277045:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2004:x1830962867662208:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 13400us (13732us total) trans 21474841330 rc 0/0 00000100:00100000:0.0:1746142921.277055:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1457 00002000:00100000:0.0:1746142921.277064:0:29473:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x99:0x0] (1048576->1388543) req@ffff88012c0e1500 x1830962867662208/t21474841330(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:72/0 lens 488/448 e 0 to 0 dl 1746142932 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142921.277072:0:29473:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c0e1500 with x1830962867662208 ext(1048576->1388543) 00010000:00010000:0.0:1746142921.277081:0:29473:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:0.0:1746142921.277092:0:29473:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00002000:00010000:0.0:1746142921.277098:0:29473:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c0e1500 00000100:00100000:0.0:1746142921.279618:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.279700:0:8381:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662848 00000100:00100000:3.0:1746142921.279706:0:8381:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662848 00010000:00010000:3.0:1746142921.279730:0:8381:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746142921.279833:0:8381:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6796 00000100:00100000:3.0:1746142921.279840:0:8381:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2003:x1830962867662848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.279850:0:8381:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.279864:0:8381:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.279873:0:8381:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.279890:0:8381:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d75600/0x2fa243e067cceb33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7fa expref: 24 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.280963:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.280966:0:8381:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.280970:0:8381:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.280978:0:8381:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.280990:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867662464:12345-192.168.204.50@tcp:4:multiop.0 Request processed in 15969us (16725us total) trans 17179874082 rc 0/0 00000100:00100000:0.0:1746142921.280999:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1458 00002000:00100000:0.0:1746142921.281008:0:29474:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x79:0x0] (1519616->2097151) req@ffff88009862ce00 x1830962867662464/t17179874082(0) o4->96cc7c44-1c57-46a5-be83-bd77aad4cb6f@192.168.204.50@tcp:72/0 lens 488/448 e 0 to 0 dl 1746142932 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746142921.281017:0:29474:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009862ce00 with x1830962867662464 ext(1519616->2097151) 00010000:00010000:0.0:1746142921.281023:0:29474:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.281024:0:8381:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746142921.281032:0:29474:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 795 lvb_type: 0 00002000:00010000:0.0:1746142921.281038:0:29474:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009862ce00 00000100:00100000:3.0:1746142921.281039:0:8381:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+23:2003:x1830962867662848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1200us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.281044:0:8381:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6796 00010000:00010000:1.0:1746142921.281454:0:1852:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281463:0:1852:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281478:0:1852:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281484:0:1852:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281491:0:1852:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281496:0:1852:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471ec00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746142921.281499:0:1852:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281505:0:1852:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281515:0:1852:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746142921.281520:0:1852:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009471ec00/0x2fa243e067cceb8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1852 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142921.281567:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2006:x1830962867661696:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 22628us (23668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142921.281574:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14949 00000100:00100000:0.0:1746142921.285346:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.285506:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867662976 00000100:00100000:3.0:1746142921.285513:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867662976 00010000:00010000:3.0:1746142921.285540:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746142921.285566:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6797 00000100:00100000:3.0:1746142921.285572:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867662976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.285584:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746142921.285597:0:7218:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142919 -> 1746142920 00002000:00010000:3.0:1746142921.285600:0:7218:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142919 -> 1746142920 00010000:00010000:3.0:1746142921.285604:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.285614:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.285634:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d74a00/0x2fa243e067cceb2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1519616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b7f3 expref: 27 pid: 11943 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.285646:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.285647:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.285652:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.285659:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.286152:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.286211:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867662976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 638us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.286217:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6797 00010000:00010000:2.0:1746142921.286599:0:11421:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286608:0:11421:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286624:0:11421:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286631:0:11421:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286637:0:11421:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286642:0:11421:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6e7000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142921.286645:0:11421:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286651:0:11421:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286662:0:11421:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.286666:0:11421:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e7000/0x2fa243e067cceb95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11421 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.286729:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867661568:12345-192.168.204.50@tcp:1:lfs.0 Request processed in 25762us (26471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.286736:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14951 00000100:00100000:0.0:1746142921.290248:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.290411:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867663232 00000100:00100000:2.0:1746142921.290419:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867663232 00000100:00100000:2.0:1746142921.290453:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14602 00000100:00100000:2.0:1746142921.290458:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:356:x1830962867663232:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1746142921.290494:0:7230:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746142921.290514:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800974d2800/0x2fa243e067ccea76 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b775 expref: 35 pid: 7232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.290530:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067cceb64 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b816 expref: 34 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.290538:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.290541:0:7230:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142921.290560:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.290569:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.290575:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000040:00080000:2.0:1746142921.290762:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].722, 88 off71256 00000004:00080000:2.0:1746142921.290769:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695289868776ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290791:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].805, 88 off78656 00000004:00080000:2.0:1746142921.290796:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695289895888ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290828:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].806, 88 off78744 00000004:00080000:2.0:1746142921.290831:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695289930886ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290841:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].723, 88 off71344 00000004:00080000:2.0:1746142921.290843:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695289942916ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290849:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].724, 88 off71432 00000004:00080000:2.0:1746142921.290851:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695289951089ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290857:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].807, 88 off78832 00000004:00080000:2.0:1746142921.290859:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695289959588ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290868:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].808, 88 off78920 00000004:00080000:2.0:1746142921.290870:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695289970744ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290879:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].725, 88 off71520 00000004:00080000:2.0:1746142921.290881:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695289981154ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290887:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].809, 88 off79008 00000004:00080000:2.0:1746142921.290889:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695289989376ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290917:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].726, 88 off71608 00000004:00080000:2.0:1746142921.290920:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695290020211ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290927:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].810, 88 off79096 00000004:00080000:2.0:1746142921.290929:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695290029541ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290939:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].727, 88 off71696 00000004:00080000:2.0:1746142921.290941:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695290041631ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290948:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].811, 88 off79184 00000004:00080000:2.0:1746142921.290950:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695290050214ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290958:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].728, 88 off71784 00000004:00080000:2.0:1746142921.290960:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695290060776ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.290967:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].812, 88 off79272 00000004:00080000:2.0:1746142921.290969:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695290068868ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290978:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].813, 88 off79360 00000004:00080000:2.0:1746142921.290980:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695290080256ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.290988:0:7230:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].729, 88 off71872 00000004:00080000:2.0:1746142921.290991:0:7230:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695290090878ns, next at 629431245375ns, rc = 0 00000001:00080000:0.0:1746142921.294301:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936802 is committed 00000004:00080000:0.0:1746142921.294311:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 717 committed 00000004:00080000:0.0:1746142921.294316:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 801 committed 00000004:00080000:0.0:1746142921.294335:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 800 committed 00000004:00080000:0.0:1746142921.294337:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 716 committed 00000004:00080000:0.0:1746142921.294339:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 799 committed 00000004:00080000:0.0:1746142921.294340:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 715 committed 00000004:00080000:0.0:1746142921.294342:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 798 committed 00000004:00080000:0.0:1746142921.294343:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 714 committed 00000004:00080000:0.0:1746142921.294344:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 797 committed 00000004:00080000:0.0:1746142921.294346:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 713 committed 00000004:00080000:0.0:1746142921.294347:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 796 committed 00000004:00080000:0.0:1746142921.294348:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 795 committed 00000004:00080000:0.0:1746142921.294349:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 712 committed 00000004:00080000:0.0:1746142921.294351:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 711 committed 00000004:00080000:0.0:1746142921.294352:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 794 committed 00000004:00080000:0.0:1746142921.294353:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 793 committed 00000004:00080000:0.0:1746142921.294354:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 710 committed 00000001:00100000:0.0:1746142921.294362:0:8093:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c8243383-433c-45fe-9bef-8828afa9ff81 00000001:00080000:0.0:1746142921.294366:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936799 is committed 00000020:00000080:0.0:1746142921.294369:0:8093:0:(genops.c:904:class_export_put()) final put ffff8801356ad000/c8243383-433c-45fe-9bef-8828afa9ff81 00000001:00100000:0.0:1746142921.294447:0:8093:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad4f1515-ae46-4d91-8f96-492179af7039 00000001:00080000:0.0:1746142921.294451:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936798 is committed 00000020:00000080:0.0:1746142921.294461:0:8093:0:(genops.c:904:class_export_put()) final put ffff8800b4b4e000/ad4f1515-ae46-4d91-8f96-492179af7039 00000020:00000080:1.0:1746142921.294558:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff8801356ad000/c8243383-433c-45fe-9bef-8828afa9ff81 for lustre-MDT0000 00000020:00000080:1.0:1746142921.294626:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff8800b4b4e000/ad4f1515-ae46-4d91-8f96-492179af7039 for lustre-MDT0000 00000100:00100000:3.0:1746142921.294629:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928448:0@lo:2:osp-syn-1-0.0 00000020:00000080:1.0:1746142921.294645:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8801356a9000 for lustre-MDT0000 00000020:00000080:1.0:1746142921.294648:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800b4b49000 for lustre-MDT0000 00000100:00100000:1.0:1746142921.294658:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867928064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.294677:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.294697:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.294711:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867928576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.294712:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.294715:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928448 00000100:00100000:2.0:1746142921.294721:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928448 00000100:00100000:1.0:1746142921.294724:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.294730:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867928192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.294741:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867929088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.294742:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.294754:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867928704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.294754:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928064 00000100:00100000:1.0:1746142921.294755:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.294756:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928064 00000100:00100000:1.0:1746142921.294764:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867929600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.294765:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928576 00000100:00100000:3.0:1746142921.294766:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.294767:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928576 00000100:00100000:2.0:1746142921.294775:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928192 00000100:00100000:1.0:1746142921.294776:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.294777:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928192 00000100:00100000:3.0:1746142921.294778:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867929216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.294783:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929088 00000100:00100000:2.0:1746142921.294784:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929088 00000100:00100000:3.0:1746142921.294791:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.294791:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928704 00000100:00100000:2.0:1746142921.294793:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928704 00000100:00100000:1.0:1746142921.294793:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929600 00000100:00100000:1.0:1746142921.294796:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929600 00000100:00100000:3.0:1746142921.294798:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867929728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.294799:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929216 00000100:00100000:2.0:1746142921.294805:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929216 00000100:00100000:3.0:1746142921.294808:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.294810:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14953 00000100:00100000:2.0:1746142921.294821:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929728 00000100:00100000:3.0:1746142921.294823:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.294823:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929728 00000100:00100000:2.0:1746142921.294828:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928960 00000100:00100000:3.0:1746142921.294830:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.294830:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928960 00000100:00100000:2.0:1746142921.294838:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14954 00000100:00100000:3.0:1746142921.294840:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.294843:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3762:x1830962867928064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.294845:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.294857:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.294862:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746142921.294866:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.294875:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.294879:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928832:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746142921.294884:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746142921.294886:0:7228:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746142921.294889:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142921.294894:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929472 00000100:00100000:3.0:1746142921.294895:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142921.294897:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929472 00000100:00100000:3.0:1746142921.294918:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142921.294922:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929984 00000100:00100000:0.0:1746142921.294924:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929984 00000100:00100000:3.0:1746142921.294927:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142921.294930:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928320 00000100:00100000:0.0:1746142921.294931:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928320 00000100:00100000:3.0:1746142921.294936:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142921.294936:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867928832 00000100:00100000:0.0:1746142921.294937:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867928832 00000100:00100000:0.0:1746142921.294942:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929344 00000100:00100000:0.0:1746142921.294943:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929344 00000100:00100000:3.0:1746142921.294947:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867929856 00000100:00100000:0.0:1746142921.294949:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14955 00000100:00100000:3.0:1746142921.294950:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867929856 00000100:00100000:0.0:1746142921.294953:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867928576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.294962:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14956 00000100:00100000:3.0:1746142921.294966:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867928192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.294982:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867928064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (284us total) trans 17179874083 rc 0/0 00000100:00100000:2.0:1746142921.294989:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14954 00000100:00100000:2.0:1746142921.295000:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14957 00000100:00100000:2.0:1746142921.295004:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3762:x1830962867929088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295021:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867928192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (277us total) trans 17179874085 rc 0/0 00000100:00100000:3.0:1746142921.295026:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14956 00000100:00100000:3.0:1746142921.295034:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14958 00000100:00100000:3.0:1746142921.295038:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867928704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.295063:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3762:x1830962867929088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (307us total) trans 21474841331 rc 0/0 00000100:00100000:2.0:1746142921.295069:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14957 00000100:00100000:3.0:1746142921.295074:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867928704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (307us total) trans 17179874086 rc 0/0 00000100:00100000:2.0:1746142921.295078:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14959 00000100:00100000:3.0:1746142921.295081:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14958 00000100:00100000:2.0:1746142921.295082:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3762:x1830962867929600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295088:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14960 00000100:00100000:3.0:1746142921.295092:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867929216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.295123:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867929600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (346us total) trans 21474841332 rc 0/0 00000100:00100000:2.0:1746142921.295128:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14959 00000100:00100000:3.0:1746142921.295132:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867929216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (340us total) trans 21474841333 rc 0/0 00000100:00100000:3.0:1746142921.295137:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14960 00000100:00100000:2.0:1746142921.295140:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14961 00000100:00100000:2.0:1746142921.295143:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3763:x1830962867929728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295145:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14962 00000100:00100000:3.0:1746142921.295148:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867928960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.295202:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867929728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (392us total) trans 21474841334 rc 0/0 00000100:00100000:3.0:1746142921.295204:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867928960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (380us total) trans 17179874087 rc 0/0 00000100:00100000:2.0:1746142921.295207:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14961 00000100:00100000:3.0:1746142921.295210:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14962 00000100:00100000:2.0:1746142921.295216:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14963 00000100:00100000:3.0:1746142921.295219:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14964 00000100:00100000:2.0:1746142921.295220:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867929472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295222:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3765:x1830962867929984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295260:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874079 gen 2 00000004:00080000:3.0:1746142921.295263:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c06a00, transno 17179874053 00000100:00100000:2.0:1746142921.295266:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867929472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (424us total) trans 21474841335 rc 0/0 00000004:00080000:3.0:1746142921.295268:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07800, transno 17179874054 00000004:00080000:3.0:1746142921.295270:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c04700, transno 17179874055 00000100:00100000:2.0:1746142921.295270:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14963 00000004:00080000:3.0:1746142921.295272:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07b80, transno 17179874056 00000004:00080000:3.0:1746142921.295273:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c05f80, transno 17179874057 00000004:00080000:3.0:1746142921.295275:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c07100, transno 17179874058 00000004:00080000:3.0:1746142921.295277:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc63b80, transno 17179874059 00000004:00080000:3.0:1746142921.295279:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c05880, transno 17179874060 00000100:00100000:2.0:1746142921.295279:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14965 00000004:00080000:3.0:1746142921.295280:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091c05500, transno 17179874061 00000004:00080000:3.0:1746142921.295282:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092407b80, transno 17179874062 00000100:00100000:2.0:1746142921.295283:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867928320:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142921.295284:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092405f80, transno 17179874063 00000004:00080000:3.0:1746142921.295285:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f7b80, transno 17179874064 00000004:00080000:3.0:1746142921.295287:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092405880, transno 17179874065 00000004:00080000:3.0:1746142921.295289:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092407800, transno 17179874066 00000004:00080000:3.0:1746142921.295290:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f4e00, transno 17179874067 00000004:00080000:3.0:1746142921.295292:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f5500, transno 17179874068 00000004:00080000:3.0:1746142921.295293:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f6680, transno 17179874069 00000004:00080000:3.0:1746142921.295296:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800924f4380, transno 17179874070 00000004:00080000:3.0:1746142921.295297:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e88a80, transno 17179874071 00000004:00080000:3.0:1746142921.295299:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e8a680, transno 17179874072 00000004:00080000:3.0:1746142921.295301:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e88700, transno 17179874073 00000004:00080000:3.0:1746142921.295302:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e8a300, transno 17179874074 00000004:00080000:3.0:1746142921.295304:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e89880, transno 17179874075 00000004:00080000:3.0:1746142921.295306:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800938df100, transno 17179874076 00000004:00080000:3.0:1746142921.295308:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e88000, transno 17179874077 00000004:00080000:3.0:1746142921.295310:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e8b100, transno 17179874078 00000004:00080000:3.0:1746142921.295312:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e8aa00, transno 17179874079 00000100:00100000:3.0:1746142921.295316:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009a35aa00 x1830962867928960/t17179874087(17179874087) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142937 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746142921.295323:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35aa00/2, rc 0, transno 17179874087 00000100:00100000:3.0:1746142921.295327:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.295329:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867928320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (453us total) trans 17179874088 rc 0/0 00000100:00100000:2.0:1746142921.295333:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14965 00000004:00080000:3.0:1746142921.295336:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a359880/2, rc 0, transno 17179874088 00000100:00100000:3.0:1746142921.295338:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.295341:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14966 00000100:00100000:3.0:1746142921.295344:0:3765:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841326 gen 2 00000100:00100000:2.0:1746142921.295344:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867928832:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142921.295346:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096af1f80, transno 21474841309 00000004:00080000:3.0:1746142921.295355:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092d08000, transno 21474841310 00000004:00080000:3.0:1746142921.295358:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092135500, transno 21474841311 00000004:00080000:3.0:1746142921.295360:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092136d80, transno 21474841312 00000004:00080000:3.0:1746142921.295362:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092136a00, transno 21474841313 00000004:00080000:3.0:1746142921.295363:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092137100, transno 21474841314 00000004:00080000:3.0:1746142921.295365:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092136300, transno 21474841315 00000004:00080000:3.0:1746142921.295367:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092137800, transno 21474841316 00000004:00080000:3.0:1746142921.295369:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092134a80, transno 21474841317 00000004:00080000:3.0:1746142921.295371:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092134380, transno 21474841318 00000004:00080000:3.0:1746142921.295373:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096143100, transno 21474841319 00000004:00080000:3.0:1746142921.295375:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096140a80, transno 21474841320 00000004:00080000:3.0:1746142921.295377:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880096143b80, transno 21474841321 00000004:00080000:3.0:1746142921.295379:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092d0bb80, transno 21474841322 00000004:00080000:3.0:1746142921.295381:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093bcd500, transno 21474841323 00000004:00080000:3.0:1746142921.295383:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092433b80, transno 21474841324 00000004:00080000:3.0:1746142921.295385:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130377100, transno 21474841325 00000100:00100000:2.0:1746142921.295385:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867928832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (495us total) trans 17179874089 rc 0/0 00000004:00080000:3.0:1746142921.295387:0:3765:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009cd5f800, transno 21474841326 00000100:00100000:2.0:1746142921.295390:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14966 00000100:00100000:3.0:1746142921.295391:0:3765:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800981cd180 x1830962867929472/t21474841335(21474841335) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746142937 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746142921.295397:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cd180/2, rc 0, transno 21474841335 00000100:00100000:2.0:1746142921.295397:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14967 00000100:00100000:3.0:1746142921.295399:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.295401:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867929344:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142921.295408:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35b800/2, rc 0, transno 17179874089 00000100:00100000:3.0:1746142921.295411:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.295443:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867929344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (523us total) trans 21474841337 rc 0/0 00000100:00100000:2.0:1746142921.295448:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14967 00000100:00100000:2.0:1746142921.295455:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14968 00000100:00100000:2.0:1746142921.295459:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867929856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.295503:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867929856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (565us total) trans 21474841338 rc 0/0 00000100:00100000:2.0:1746142921.295507:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14968 00000004:00080000:3.0:1746142921.295521:0:8111:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 27 done 00000004:00080000:3.0:1746142921.295546:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cdc00/2, rc 0, transno 21474841337 00000100:00100000:3.0:1746142921.295549:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929344:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142921.295555:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cdf80/2, rc 0, transno 21474841338 00000100:00100000:3.0:1746142921.295558:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295591:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3765:x1830962867929984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 368us (733us total) trans 21474841336 rc 0/0 00000004:00080000:2.0:1746142921.295594:0:8109:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 18 done 00000100:00100000:3.0:1746142921.295596:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14964 00000004:00080000:3.0:1746142921.295612:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809e300/2, rc 0, transno 21474841336 00000100:00100000:3.0:1746142921.295615:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867929984:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1746142921.295621:0:7230:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009862c380 reply state ffff880092fd1800 transno 8589936802 ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.295635:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00000004:00080000:3.0:1746142921.295638:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a358000/2, rc 0, transno 17179874085 00000100:00100000:3.0:1746142921.295641:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867928192:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746142921.295643:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.295645:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:3.0:1746142921.295648:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a359c00/2, rc 0, transno 17179874086 00000100:00100000:2.0:1746142921.295648:0:7230:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746142921.295650:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867928704:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142921.295656:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cc700/2, rc 0, transno 21474841333 00000100:00100000:3.0:1746142921.295658:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867929216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142921.295663:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cca80/2, rc 0, transno 21474841334 00000100:00100000:3.0:1746142921.295665:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867929728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.295670:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746142921.295674:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867930112:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.295693:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1746142921.295699:0:7230:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746142921.295709:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867930112 00000100:00100000:2.0:1746142921.295710:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867663232:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 5249us (5466us total) trans 8589936802 rc 0/0 00000100:00100000:3.0:1746142921.295711:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867930112 00000100:00100000:2.0:1746142921.295716:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14602 00000100:00100000:3.0:1746142921.295726:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14969 00000100:00100000:3.0:1746142921.295730:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867930112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.295776:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3763:x1830962867930112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (82us total) trans 17179874090 rc 0/0 00000100:00100000:3.0:1746142921.295780:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14969 00000004:00080000:3.0:1746142921.295795:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c06a00/2, rc 0, transno 17179874090 00000100:00100000:3.0:1746142921.295807:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867930112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.295943:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3765:x1830962867928448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.296018:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3765:x1830962867928448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1201us (1340us total) trans 17179874091 rc 0/0 00000100:00100000:1.0:1746142921.296025:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14953 00000004:00080000:1.0:1746142921.296050:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cea00/2, rc 0, transno 21474841331 00000100:00100000:1.0:1746142921.296054:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867929088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142921.296060:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cc380/2, rc 0, transno 21474841332 00000100:00100000:1.0:1746142921.296062:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867929600:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746142921.296068:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a359500/2, rc 0, transno 17179874083 00000100:00100000:1.0:1746142921.296070:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867928064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142921.296076:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a35b480/2, rc 0, transno 17179874084 00000100:00100000:1.0:1746142921.296078:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867928576:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746142921.296141:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.296148:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.296152:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.296157:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097795600 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142921.296160:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.296175:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.296183:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.296186:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142921.296188:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00010000:00010000:2.0:1746142921.296192:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097795600/0x2fa243e067ccebaa lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7230 initiator: MDT0 00000100:00100000:0.0:1746142921.296372:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830962867928576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (285us total) trans 17179874084 rc 0/0 00000100:00100000:0.0:1746142921.296378:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14955 00000004:00080000:3.0:1746142921.298077:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a358700/2, rc 0, transno 17179874091 00000100:00100000:3.0:1746142921.298083:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867928448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746142921.302230:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.302272:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867663360 00000100:00100000:3.0:1746142921.302279:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867663360 00000100:00100000:3.0:1746142921.302670:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14603 00000100:00100000:3.0:1746142921.302678:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867663360:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142921.302697:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142921.302712:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b824 expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.302754:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.302765:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 28 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.302870:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142921.302873:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746142921.302876:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cbe6200, rc 0) 00000100:00100000:3.0:1746142921.303344:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867663360:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 662us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.303350:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14603 00000100:00100000:0.0:1746142921.307076:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.307151:0:7230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867663488 00000100:00100000:3.0:1746142921.307159:0:7230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867663488 00000100:00100000:3.0:1746142921.307202:0:7230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14604 00000100:00100000:3.0:1746142921.307209:0:7230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867663488:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142921.307223:0:7230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142921.307238:0:7230:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccebb8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b82b expref: -99 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.307306:0:7230:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccebbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.307317:0:7230:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccebbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.307326:0:7230:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccebbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00000004:00200000:3.0:1746142921.307346:0:7230:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x55:0x0]: returning size 9260896 00000004:00200000:3.0:1746142921.307350:0:7230:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746142921.307361:0:7230:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccebbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7230 initiator: MDT0 00010000:00010000:3.0:1746142921.307379:0:7230:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dee00/0x2fa243e067ccebb8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b82b expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.307409:0:7230:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccebbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b82b expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.307416:0:7230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142921.307419:0:7230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746142921.307422:0:7230:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801313dfa00, rc 0) 00000100:00100000:3.0:1746142921.307468:0:7230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:356:x1830962867663488:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 260us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.307474:0:7230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14604 00000100:00100000:0.0:1746142921.309501:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.309536:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.309569:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.309629:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867663616 00000100:00100000:2.0:1746142921.309636:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867663616 00000100:00100000:0.0:1746142921.309644:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.309658:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.309682:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14970 00000100:00100000:2.0:1746142921.309692:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+22:2006:x1830962867663616:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.309704:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746142921.309710:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1746142921.309717:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b832 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142921.309730:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867663744 00000100:00100000:1.0:1746142921.309734:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867663744 00000100:00100000:3.0:1746142921.309755:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867663872 00000100:00100000:3.0:1746142921.309759:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867663872 00000100:00100000:3.0:1746142921.309776:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664000 00000100:00100000:3.0:1746142921.309778:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664000 00000100:00100000:3.0:1746142921.309787:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664128 00000100:00100000:3.0:1746142921.309789:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664128 00000100:00100000:3.0:1746142921.309801:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14971 00000100:00100000:3.0:1746142921.309805:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867663872:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142921.309812:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142921.309821:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b840 expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746142921.309838:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x79:0x0] initial LVB size: 2097152, mtime: 0x681406c8, atime: 0x681406c6, ctime: 0x681406c8, blocks: 0x800 00000100:00100000:1.0:1746142921.309845:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14972 00000100:00100000:1.0:1746142921.309851:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+24:2005:x1830962867664000:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142921.309853:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.309855:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142921.309859:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142921.309862:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 27 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142921.309868:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b847 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.309873:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 27 pid: 12211 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746142921.309881:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x99:0x0] initial LVB size: 2097152, mtime: 0x681406c8, atime: 0x681406c4, ctime: 0x681406c8, blocks: 0x808 00010000:00010000:3.0:1746142921.309882:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3920c00, rc 0) 00010000:00010000:1.0:1746142921.309889:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142921.309890:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142921.309895:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 25 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142921.309928:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 25 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142921.309935:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37c00, rc 0) 00000100:00100000:3.0:1746142921.309936:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867663872:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 129us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.309941:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14971 00000100:00100000:1.0:1746142921.309954:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2005:x1830962867664000:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.309955:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14973 00000100:00100000:1.0:1746142921.309959:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14972 00000100:00100000:3.0:1746142921.309960:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867664128:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142921.309966:0:12211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746142921.309970:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14974 00010000:00010000:3.0:1746142921.309973:0:12211:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b84e expref: -99 pid: 12211 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746142921.309975:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2005:x1830962867663744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1746142921.309980:0:1853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746142921.309982:0:12211:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x9b:0x0] initial LVB size: 5066592, mtime: 0x681406c8, atime: 0x681406c8, ctime: 0x681406c8, blocks: 0x16b0 00010000:00010000:1.0:1746142921.309987:0:1853:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b839 expref: -99 pid: 1853 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.309990:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.309991:0:12211:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.309995:0:12211:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 25 pid: 12211 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746142921.309996:0:1853:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 2097152, mtime: 0x681406c7, atime: 0x681406c6, ctime: 0x681406c7, blocks: 0x808 00010000:00010000:1.0:1746142921.310004:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746142921.310005:0:1853:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.310008:0:12211:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 25 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142921.310009:0:1853:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.310014:0:12211:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3921c00, rc 0) 00010000:00010000:1.0:1746142921.310018:0:1853:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 27 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746142921.310025:0:1853:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a37400, rc 0) 00000100:00100000:3.0:1746142921.310030:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867664128:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 70us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.310035:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14973 00000100:00100000:1.0:1746142921.310040:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867663744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 65us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142921.310045:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14974 00002000:00010000:2.0:1746142921.310122:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x97:0x0] initial LVB size: 1048576, mtime: 0x681406c4, atime: 0x681406c4, ctime: 0x681406c4, blocks: 0x7f0 00010000:00010000:2.0:1746142921.310131:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.310132:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.310137:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.310146:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 25 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.310152:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0e00, rc 0) 00000100:00100000:2.0:1746142921.310182:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009862ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2006:x1830962867663616:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 491us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.310187:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14970 00000100:00100000:2.0:1746142921.310196:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664256 00000100:00100000:2.0:1746142921.310198:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664256 00000100:00100000:2.0:1746142921.310211:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14975 00000100:00100000:2.0:1746142921.310215:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867664256:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.310221:0:11943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.310228:0:11943:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b855 expref: -99 pid: 11943 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142921.310237:0:11943:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x7b:0x0] initial LVB size: 4194304, mtime: 0x681406c8, atime: 0x681406c8, ctime: 0x681406c8, blocks: 0x1008 00010000:00010000:2.0:1746142921.310243:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.310245:0:11943:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.310249:0:11943:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.310262:0:11943:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.310268:0:11943:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0400, rc 0) 00000100:00100000:2.0:1746142921.310288:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867664256:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 72us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.310292:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14975 00000100:00100000:0.0:1746142921.314645:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.314680:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.314703:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664512 00000100:00100000:0.0:1746142921.314705:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.314712:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664512 00000100:00100000:0.0:1746142921.314727:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.314742:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664768 00000100:00100000:3.0:1746142921.314743:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664768 00000100:00100000:0.0:1746142921.314743:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665024 00000100:00100000:0.0:1746142921.314746:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665024 00000100:00100000:3.0:1746142921.314754:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664384 00000100:00100000:3.0:1746142921.314755:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664384 00000100:00100000:3.0:1746142921.314766:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14976 00000100:00100000:3.0:1746142921.314772:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867664512:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142921.314846:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14977 00000100:00100000:1.0:1746142921.314853:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867664768:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142921.314855:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867664512:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.314861:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14976 00000100:00100000:3.0:1746142921.314873:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14978 00000100:00100000:3.0:1746142921.314877:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867664384:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:1.0:1746142921.314892:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2004:x1830962867664768:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142921.314914:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14977 00000100:00100000:3.0:1746142921.314924:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867664384:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 45us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.314928:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14978 00000100:00100000:0.0:1746142921.315633:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14979 00000100:00100000:0.0:1746142921.315640:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867665024:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142921.315769:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867665024:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 129us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142921.315774:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14979 00000100:00100000:0.0:1746142921.315813:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.315854:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.316982:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664640 00000100:00100000:0.0:1746142921.316989:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664640 00000100:00100000:2.0:1746142921.316996:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867664896 00000100:00100000:2.0:1746142921.317000:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867664896 00000100:00100000:0.0:1746142921.317017:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14980 00000100:00100000:2.0:1746142921.317023:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14981 00000100:00100000:0.0:1746142921.317023:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867664640:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142921.317028:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867664896:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142921.317072:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2004:x1830962867664640:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142921.317078:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14980 00000100:00100000:2.0:1746142921.319008:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2004:x1830962867664896:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 1974us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.319016:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14981 00000100:00100000:0.0:1746142921.320631:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.320654:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.320677:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665152 00000100:00100000:0.0:1746142921.320677:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.320684:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665152 00000100:00100000:0.0:1746142921.321003:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.321016:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665408 00000100:00100000:0.0:1746142921.321019:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665408 00000100:00100000:2.0:1746142921.321050:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665664 00000100:00100000:2.0:1746142921.321053:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665664 00000100:00100000:0.0:1746142921.321478:0:1397:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665280 00000100:00100000:0.0:1746142921.321482:0:1397:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665280 00000100:00100000:1.0:1746142921.321619:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14982 00000100:00100000:1.0:1746142921.321628:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2003:x1830962867665152:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142921.321669:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14983 00000100:00100000:3.0:1746142921.321677:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867665408:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:0.0:1746142921.321683:0:1397:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14984 00000100:00100000:0.0:1746142921.321688:0:1397:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2003:x1830962867665664:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142921.321702:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14985 00000100:00100000:2.0:1746142921.321710:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867665280:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:3.0:1746142921.321747:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2003:x1830962867665408:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 71us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.321752:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14983 00000100:00100000:0.0:1746142921.321846:0:1397:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2003:x1830962867665664:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 158us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746142921.321852:0:1397:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14984 00000100:00100000:1.0:1746142921.321918:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867665152:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 291us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.321921:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867665280:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 212us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1746142921.321923:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14982 00000100:00100000:2.0:1746142921.321927:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14985 00000100:00100000:0.0:1746142921.322098:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.322420:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.322484:0:11943:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665536 00000100:00100000:2.0:1746142921.322488:0:11943:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665536 00000100:00100000:2.0:1746142921.322506:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665792 00000100:00100000:2.0:1746142921.322507:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665792 00000100:00100000:2.0:1746142921.322518:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14986 00000100:00100000:2.0:1746142921.322523:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867665536:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142921.322559:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:2003:x1830962867665536:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 35us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.322564:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14986 00000100:00100000:2.0:1746142921.322573:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14987 00000100:00100000:2.0:1746142921.322577:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867665792:12345-192.168.204.50@tcp:23:lfs.0 00000100:00100000:2.0:1746142921.322604:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2003:x1830962867665792:12345-192.168.204.50@tcp:23:lfs.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.322609:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14987 00000100:00100000:1.0:1746142921.328601:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.328696:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867665920 00000100:00100000:2.0:1746142921.328704:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867665920 00000100:00100000:2.0:1746142921.328746:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14988 00000100:00100000:2.0:1746142921.328752:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867665920:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.328766:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.328783:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccebf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b85c expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142921.328799:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x681406a2, atime: 0x6814068a, ctime: 0x681406a2, blocks: 0xfc0 00010000:00010000:2.0:1746142921.328816:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.328817:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.328823:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccebf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b85c expref: 29 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.328839:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f1c00/0x2fa243e067ccebf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b85c expref: 29 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.328847:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1c00, rc 0) 00000100:00100000:2.0:1746142921.328877:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:356:x1830962867665920:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 125us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.328882:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14988 00000100:00100000:0.0:1746142921.331390:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.331447:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867666048 00000100:00100000:3.0:1746142921.331453:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867666048 00000100:00100000:3.0:1746142921.331492:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14989 00000100:00100000:3.0:1746142921.331498:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2005:x1830962867666048:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:3.0:1746142921.331632:0:9580:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142921.331635:0:9580:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142921.331637:0:9580:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142921.331638:0:9580:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142921.331640:0:9580:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142921.331682:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2005:x1830962867666048:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 183us (297us total) trans 17179874092 rc 0/0 00000100:00100000:3.0:1746142921.331688:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14989 00000100:00100000:0.0:1746142921.340729:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.340858:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867666176 00000100:00100000:2.0:1746142921.340865:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867666176 00000100:00100000:2.0:1746142921.340933:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14990 00000100:00100000:2.0:1746142921.340942:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+25:356:x1830962867666176:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.340958:0:9578:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.340980:0:9578:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f1a00/0x2fa243e067ccebf7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b863 expref: -99 pid: 9578 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746142921.340998:0:9578:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x98:0x0] initial LVB size: 4194304, mtime: 0x681406a2, atime: 0x0, ctime: 0x681406a2, blocks: 0x1fc0 00010000:00010000:2.0:1746142921.341016:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.341018:0:9578:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.341024:0:9578:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f1a00/0x2fa243e067ccebf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b863 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.341036:0:9578:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f1a00/0x2fa243e067ccebf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b863 expref: 26 pid: 9578 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.341043:0:9578:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1a00, rc 0) 00000100:00100000:2.0:1746142921.355668:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:356:x1830962867666176:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 14718us (14937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.355678:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14990 00000100:00100000:0.0:1746142921.358712:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.358795:0:9578:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867666304 00000100:00100000:2.0:1746142921.358802:0:9578:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867666304 00000100:00100000:2.0:1746142921.358847:0:9578:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14991 00000100:00100000:2.0:1746142921.358854:0:9578:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:2006:x1830962867666304:12345-192.168.204.50@tcp:22:lfs.0 00002000:00010000:2.0:1746142921.359039:0:9578:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142921.359042:0:9578:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142921.359044:0:9578:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746142921.359046:0:9578:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:2.0:1746142921.359047:0:9578:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:2.0:1746142921.359095:0:9578:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867666304:12345-192.168.204.50@tcp:22:lfs.0 Request processed in 240us (389us total) trans 21474841339 rc 0/0 00000100:00100000:2.0:1746142921.359101:0:9578:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14991 00000100:00100000:0.0:1746142921.363713:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.363797:0:29474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867666560 00000100:00100000:2.0:1746142921.363804:0:29474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867666560 00000100:00100000:2.0:1746142921.363851:0:29474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4709 00000100:00100000:2.0:1746142921.363858:0:29474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2003:x1830962867666560:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142921.363888:0:29474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 3/1,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.363919:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.363920:0:29474:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.363925:0:29474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.363936:0:29474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.367420:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.367491:0:29473:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867666816 00000100:00100000:2.0:1746142921.367499:0:29473:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867666816 00000100:00100000:2.0:1746142921.367541:0:29473:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4710 00000100:00100000:2.0:1746142921.367547:0:29473:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867666816:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:2.0:1746142921.367570:0:29473:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.367581:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.367582:0:29473:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.367586:0:29473:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.367596:0:29473:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.374707:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.374743:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.374769:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.374794:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.374806:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.374816:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867667072 00000100:00100000:3.0:1746142921.374823:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867667072 00000100:00100000:0.0:1746142921.374825:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.374839:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867667328 00000100:00100000:0.0:1746142921.374842:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867667328 00000100:00100000:0.0:1746142921.374865:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867667584 00000100:00100000:0.0:1746142921.374867:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867667584 00000100:00100000:3.0:1746142921.374873:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867667840 00000100:00100000:3.0:1746142921.374876:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867667840 00000100:00100000:0.0:1746142921.374876:0:20333:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867668096 00000100:00100000:0.0:1746142921.374878:0:20333:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867668096 00000100:00100000:3.0:1746142921.374885:0:9585:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867668352 00000100:00100000:3.0:1746142921.374887:0:9585:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867668352 00000100:00100000:0.0:1746142921.374889:0:20333:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4711 00000100:00100000:0.0:1746142921.374895:0:20333:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867667328:12345-192.168.204.50@tcp:3:lfs.0 00000100:00100000:3.0:1746142921.374897:0:9585:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4712 00000100:00100000:3.0:1746142921.374932:0:9585:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867667072:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142921.374943:0:20333:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.374952:0:9585:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.374955:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142921.374956:0:20333:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.374960:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142921.374960:0:20333:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.374962:0:9585:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.374968:0:9585:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.374969:0:20333:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.374977:0:9585:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746142921.375496:0:29472:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4713 00000100:00100000:0.0:1746142921.375501:0:29472:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867667584:12345-192.168.204.50@tcp:3:lfs.0 00000100:00100000:3.0:1746142921.375507:0:9583:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4714 00000100:00100000:3.0:1746142921.375512:0:9583:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+35:2004:x1830962867667840:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:0.0:1746142921.375513:0:29472:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.375519:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142921.375521:0:29472:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746142921.375523:0:29472:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.375526:0:9583:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746142921.375530:0:29472:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.375533:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.375534:0:9583:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.375537:0:9583:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.375544:0:9583:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.376011:0:20331:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4715 00000100:00100000:3.0:1746142921.376016:0:20331:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2004:x1830962867668096:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142921.376030:0:20331:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.376036:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.376038:0:20331:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.376041:0:20331:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.376052:0:20331:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.376521:0:20334:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4716 00000100:00100000:3.0:1746142921.376527:0:20334:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2004:x1830962867668352:12345-192.168.204.50@tcp:3:lfs.0 00010000:00010000:3.0:1746142921.376541:0:20334:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.376547:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.376548:0:20334:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.376551:0:20334:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.376557:0:20334:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384845:0:29474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384858:0:29474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384866:0:29474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384871:0:29474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097795e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142921.384874:0:29474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384886:0:29474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384909:0:29474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.384914:0:29474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097795e00/0x2fa243e067ccebfe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [12288->1048575] (req 12288->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.384993:0:29474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2003:x1830962867666560:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 21133us (21285us total) trans 0 rc 1036288/1036288 00000100:00100000:2.0:1746142921.385002:0:29474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4709 00010000:00010000:2.0:1746142921.393864:0:29473:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.393878:0:29473:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.393885:0:29473:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.393890:0:29473:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e6e6200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142921.393893:0:29473:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.393919:0:29473:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.393939:0:29473:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.393945:0:29473:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e6e6200/0x2fa243e067ccec05 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.394017:0:29473:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+36:2003:x1830962867666816:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 26466us (26601us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142921.394025:0:29473:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4710 00010000:00010000:2.0:1746142921.403268:0:20333:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.403282:0:20333:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.403289:0:20333:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.403294:0:20333:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d3200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142921.403298:0:20333:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.403303:0:20333:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.403318:0:20333:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.403327:0:20333:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d3200/0x2fa243e067ccec0c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20333 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.404137:0:20333:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2004:x1830962867667328:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 29236us (29387us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142921.404147:0:20333:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4711 00010000:00010000:3.0:1746142921.406210:0:9585:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.406224:0:9585:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.406231:0:9585:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.406237:0:9585:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3920400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142921.406240:0:9585:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.406248:0:9585:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.406263:0:9585:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.406269:0:9585:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3920400/0x2fa243e067ccec13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9585 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.406330:0:9585:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+34:2004:x1830962867667072:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 31397us (31626us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142921.406338:0:9585:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4712 00010000:00010000:3.0:1746142921.410431:0:9583:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.410445:0:9583:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.410453:0:9583:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.410459:0:9583:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3921e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142921.410462:0:9583:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.410469:0:9583:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.410489:0:9583:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.410494:0:9583:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3921e00/0x2fa243e067ccec21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9583 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.410548:0:9583:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2004:x1830962867667840:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 35031us (35749us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142921.410556:0:9583:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4714 00010000:00010000:3.0:1746142921.418026:0:20331:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.418041:0:20331:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.418048:0:20331:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.418053:0:20331:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cbe7600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142921.418056:0:20331:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.418062:0:20331:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.418076:0:20331:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.418085:0:20331:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cbe7600/0x2fa243e067ccec28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20331 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.418143:0:20331:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2004:x1830962867668096:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 42122us (43330us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142921.418151:0:20331:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4715 00010000:00010000:2.0:1746142921.418772:0:29472:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.418780:0:29472:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.418787:0:29472:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.418792:0:29472:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fb6000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746142921.418794:0:29472:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.418800:0:29472:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.418810:0:29472:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.418815:0:29472:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fb6000/0x2fa243e067ccec1a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29472 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746142921.418885:0:29472:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2004:x1830962867667584:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 43382us (44113us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746142921.418891:0:29472:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4713 00010000:00010000:3.0:1746142921.421722:0:20334:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.421734:0:20334:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.421741:0:20334:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.421746:0:20334:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098445000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746142921.421749:0:20334:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.421756:0:20334:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.421770:0:20334:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.421776:0:20334:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098445000/0x2fa243e067ccec2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20334 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.421842:0:20334:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2004:x1830962867668352:12345-192.168.204.50@tcp:3:lfs.0 Request processed in 45311us (47012us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746142921.421851:0:20334:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4716 00000100:00100000:0.0:1746142921.426304:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.426398:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867668608 00000100:00100000:2.0:1746142921.426406:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867668608 00000100:00100000:2.0:1746142921.426457:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14605 00000100:00100000:2.0:1746142921.426464:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:356:x1830962867668608:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1746142921.426502:0:13326:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746142921.426523:0:13326:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313dfa00/0x2fa243e067ccebbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b82b expref: 29 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.426548:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.426551:0:13326:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142921.426585:0:13326:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142921.426594:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142921.426606:0:13326:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00000004:00010000:2.0:1746142921.426676:0:13326:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800938d0380 reply state ffff88012de27000 transno 8589936803 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142921.426681:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:2.0:1746142921.426684:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.426686:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746142921.426687:0:13326:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746142921.426738:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:356:x1830962867668608:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 274us (443us total) trans 8589936803 rc 0/0 00000100:00100000:2.0:1746142921.426744:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14605 00000100:00100000:0.0:1746142921.428276:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.428364:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867668736 00000100:00100000:3.0:1746142921.428369:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867668736 00000100:00100000:3.0:1746142921.428407:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14992 00000100:00100000:3.0:1746142921.428414:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867668736:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1746142921.428425:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746142921.428436:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067ccec3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b86a expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.428457:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.428464:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.428466:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.428468:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067ccec3d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b86a expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.428492:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746142921.428502:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.428511:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867930240:192.168.204.50@tcp:104: 00000100:00100000:3.0:1746142921.428590:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:3.0:1746142921.433080:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867930240:192.168.204.50@tcp:104: 00010000:00010000:3.0:1746142921.433106:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067ccec3d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b86a expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.433122:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097106400, rc 0) 00000100:00100000:3.0:1746142921.433169:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867668736:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 4746us (4887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.433177:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14992 00000100:00100000:0.0:1746142921.433306:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.433425:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867668864 00000100:00100000:3.0:1746142921.433430:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867668864 00010000:00010000:3.0:1746142921.433451:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.433499:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6798 00000100:00100000:3.0:1746142921.433507:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2005:x1830962867668864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.433516:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.433530:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.433539:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.433555:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800968f0e00/0x2fa243e067ccebc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x97:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b832 expref: 28 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.433577:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.433579:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.433588:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067ccec3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b86a expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.433594:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067ccec3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b86a expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.433616:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097106400/0x2fa243e067ccec3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x97:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b86a expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.433626:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867930368:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142921.433686:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142921.437327:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.437433:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867930368:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142921.437449:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746142921.437477:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867668992 00000100:00100000:2.0:1746142921.437483:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867668992 00000100:00100000:3.0:1746142921.437498:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2005:x1830962867668864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3992us (4191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.437507:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6798 00000100:00100000:2.0:1746142921.437515:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14993 00000100:00100000:2.0:1746142921.437520:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:356:x1830962867668992:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.437534:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.437547:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067ccec44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b871 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.437573:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.437579:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.437581:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.437584:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067ccec44 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b871 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.437606:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.437616:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746142921.437626:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867930496:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.437799:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142921.440277:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.440362:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867930496:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.440384:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067ccec44 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b871 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.440396:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d2200, rc 0) 00000100:00100000:2.0:1746142921.440440:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:356:x1830962867668992:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2920us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.440447:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14993 00000100:00100000:3.0:1746142921.440660:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669120 00000100:00100000:3.0:1746142921.440666:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669120 00010000:00010000:3.0:1746142921.440686:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.440706:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6799 00000100:00100000:3.0:1746142921.440711:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2003:x1830962867669120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.440723:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.440739:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.440748:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.440764:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a37400/0x2fa243e067ccebe2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b839 expref: 31 pid: 1853 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.440776:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.440777:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.440784:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067ccec44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b871 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.440791:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067ccec44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b871 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.440814:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0d2200/0x2fa243e067ccec44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b871 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.440823:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867930624:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142921.440875:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142921.445043:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.445627:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867930624:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142921.445642:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.445687:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2003:x1830962867669120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4974us (5416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.445696:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6799 00000100:00100000:2.0:1746142921.446189:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669248 00000100:00100000:2.0:1746142921.446195:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669248 00000100:00100000:2.0:1746142921.446219:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14994 00000100:00100000:2.0:1746142921.446224:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:356:x1830962867669248:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.446236:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.446249:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800968f0e00/0x2fa243e067ccec4b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b878 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.446270:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.446276:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.446278:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.446281:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0e00/0x2fa243e067ccec4b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b878 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.446302:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.446316:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746142921.446325:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867930752:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.446360:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.449082:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867930752:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.449104:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0e00/0x2fa243e067ccec4b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b878 expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.449116:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f0e00, rc 0) 00000100:00100000:2.0:1746142921.449144:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:356:x1830962867669248:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2919us (4107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.449150:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14994 00000100:00100000:0.0:1746142921.449630:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.450145:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669376 00000100:00100000:3.0:1746142921.450150:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669376 00010000:00010000:3.0:1746142921.450181:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.450200:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6800 00000100:00100000:3.0:1746142921.450206:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867669376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.450214:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.450228:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.450236:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.450251:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3920c00/0x2fa243e067ccebcd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x79:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b840 expref: 31 pid: 12211 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.450262:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.450264:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.450269:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0e00/0x2fa243e067ccec4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b878 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.450275:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0e00/0x2fa243e067ccec4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b878 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.450294:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f0e00/0x2fa243e067ccec4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x79:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b878 expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.450303:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867930880:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142921.450350:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d06540 going to sleep for 11 seconds 00000100:00100000:0.0:1746142921.452253:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.452322:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867930880:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142921.452335:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.452362:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b524ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867669376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2156us (2732us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.452371:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6800 00000100:00100000:2.0:1746142921.452462:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669504 00000100:00100000:2.0:1746142921.452467:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669504 00000100:00100000:2.0:1746142921.452492:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14995 00000100:00100000:2.0:1746142921.452497:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867669504:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.452509:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.452523:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800968f1400/0x2fa243e067ccec52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b87f expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.452542:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.452552:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.452553:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.452556:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f1400/0x2fa243e067ccec52 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b87f expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.452575:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.452584:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746142921.452593:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867931008:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.453500:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.454410:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867931008:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.454428:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800968f1400/0x2fa243e067ccec52 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b87f expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.454439:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800968f1400, rc 0) 00000100:00100000:0.0:1746142921.454822:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.454856:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867669504:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2358us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.454863:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14995 00000100:00100000:3.0:1746142921.454925:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669632 00000100:00100000:3.0:1746142921.454929:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669632 00010000:00010000:3.0:1746142921.454945:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.454968:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6801 00000100:00100000:3.0:1746142921.454973:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867669632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.454982:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.454995:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.455004:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.455020:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a37c00/0x2fa243e067ccebd4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x99:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b847 expref: 28 pid: 1853 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.455033:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.455034:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.455039:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800968f1400/0x2fa243e067ccec52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b87f expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.455046:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800968f1400/0x2fa243e067ccec52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b87f expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.455064:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800968f1400/0x2fa243e067ccec52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x99:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b87f expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.455072:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867931136:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142921.455893:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142921.457778:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867931136:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142921.457793:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.457829:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867669632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2856us (3007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.457837:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6801 00000100:00100000:0.0:1746142921.458092:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.458250:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669760 00000100:00100000:2.0:1746142921.458255:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669760 00000100:00100000:2.0:1746142921.458279:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14996 00000100:00100000:2.0:1746142921.458285:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867669760:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.458298:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.458310:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097795600/0x2fa243e067ccec59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b886 expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.458329:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.458336:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.458337:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.458340:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097795600/0x2fa243e067ccec59 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b886 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.458361:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.458372:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746142921.458380:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867931264:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.458428:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142921.460524:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.460663:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9580:1830962867931264:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.460682:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097795600/0x2fa243e067ccec59 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b886 expref: 28 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.460696:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795600, rc 0) 00000100:00100000:2.0:1746142921.460735:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867669760:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2449us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.460742:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14996 00000100:00100000:3.0:1746142921.460995:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867669888 00000100:00100000:3.0:1746142921.461000:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867669888 00010000:00010000:3.0:1746142921.461017:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.461035:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6802 00000100:00100000:3.0:1746142921.461041:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:2006:x1830962867669888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.461050:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.461064:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.461073:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.461088:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3921c00/0x2fa243e067ccebdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x9b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b84e expref: 28 pid: 12211 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.461107:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.461109:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.461114:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097795600/0x2fa243e067ccec59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b886 expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.461120:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097795600/0x2fa243e067ccec59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b886 expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.461140:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097795600/0x2fa243e067ccec59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b886 expref: 27 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.461148:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867931392:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142921.461193:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142921.463030:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7218:1830962867931392:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142921.463042:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.463202:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:2006:x1830962867669888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 2160us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.463210:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6802 00000100:00100000:0.0:1746142921.463358:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.464235:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670016 00000100:00100000:2.0:1746142921.464241:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670016 00000100:00100000:2.0:1746142921.464274:0:9580:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14997 00000100:00100000:2.0:1746142921.464280:0:9580:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:356:x1830962867670016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.464294:0:9580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.464309:0:9580:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccec60 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b88d expref: -99 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.464328:0:9580:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.464335:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.464336:0:9580:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746142921.464339:0:9580:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccec60 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b88d expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.464361:0:9580:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746142921.464370:0:9580:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00000100:00100000:2.0:1746142921.464379:0:9580:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867931520:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.464425:0:9580:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746142921.466143:0:3755:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.466246:0:9580:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9580:1830962867931520:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.466263:0:9580:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccec60 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b88d expref: 31 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.466273:0:9580:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097795e00, rc 0) 00000100:00100000:2.0:1746142921.466303:0:9580:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:356:x1830962867670016:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 2023us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.466309:0:9580:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14997 00000100:00100000:3.0:1746142921.466509:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670144 00000100:00100000:3.0:1746142921.466513:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670144 00010000:00010000:3.0:1746142921.466528:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00000100:00100000:3.0:1746142921.466542:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6803 00000100:00100000:3.0:1746142921.466547:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867670144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.466554:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.466567:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.466575:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.466588:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800968f0400/0x2fa243e067ccebe9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x7b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b855 expref: 31 pid: 11943 timeout: 795 lvb_type: 1 00010000:00010000:3.0:1746142921.466595:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.466597:0:7218:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746142921.466601:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccec60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b88d expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.466607:0:7218:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccec60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b88d expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746142921.466622:0:7218:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097795e00/0x2fa243e067ccec60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b88d expref: 30 pid: 9580 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746142921.466630:0:7218:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867931648:192.168.204.50@tcp:105: 00000100:00100000:3.0:1746142921.467304:0:7218:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a7d060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746142921.469571:0:7218:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7218:1830962867931648:192.168.204.50@tcp:105: 00010000:00010000:3.0:1746142921.469588:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746142921.469734:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867670144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3184us (3591us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.469742:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6803 00000100:00100000:0.0:1746142921.469958:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.469997:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.470015:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.470026:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.470036:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.470052:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1746142921.470064:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670272 00000100:00100000:0.0:1746142921.470068:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670272 00000100:00100000:0.0:1746142921.471103:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670400 00000100:00100000:0.0:1746142921.471107:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670400 00000100:00100000:2.0:1746142921.471216:0:9580:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670528 00000100:00100000:2.0:1746142921.471219:0:9580:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670528 00000100:00100000:2.0:1746142921.471240:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670656 00000100:00100000:2.0:1746142921.471242:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670656 00000100:00100000:2.0:1746142921.471251:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670784 00000100:00100000:2.0:1746142921.471253:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670784 00000100:00100000:2.0:1746142921.471261:0:11421:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867670912 00000100:00100000:2.0:1746142921.471262:0:11421:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867670912 00000100:00100000:2.0:1746142921.471271:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14998 00000100:00100000:2.0:1746142921.471276:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867670272:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142921.471386:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746142921.471389:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142916 -> 1746142920 00002000:00010000:2.0:1746142921.471391:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142916 -> 1746142920 00002000:00010000:2.0:1746142921.471393:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142916 -> 1746142922 00002000:00010000:2.0:1746142921.471394:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:2.0:1746142921.471422:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867670272:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 146us (1465us total) trans 21474841340 rc 0/0 00000100:00100000:2.0:1746142921.471428:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14998 00000100:00100000:2.0:1746142921.471439:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14999 00000100:00100000:2.0:1746142921.471443:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867670400:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142921.471492:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142921.471494:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142919 -> 1746142920 00002000:00010000:2.0:1746142921.471496:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142918 -> 1746142920 00002000:00010000:2.0:1746142921.471497:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142919 -> 1746142922 00002000:00010000:2.0:1746142921.471499:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142921.471513:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867670400:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 70us (1516us total) trans 17179874093 rc 0/0 00000100:00100000:2.0:1746142921.471518:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14999 00000100:00100000:2.0:1746142921.471526:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15000 00000100:00100000:2.0:1746142921.471530:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801355d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867670528:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142921.471561:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142921.471563:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.471565:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142918 -> 1746142920 00002000:00010000:2.0:1746142921.471567:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142920 -> 1746142922 00002000:00010000:2.0:1746142921.471569:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746142921.471582:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801355d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867670528:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 51us (1566us total) trans 17179874094 rc 0/0 00000100:00100000:2.0:1746142921.471586:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15000 00000100:00100000:2.0:1746142921.471595:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15001 00000100:00100000:2.0:1746142921.471600:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867670656:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142921.471631:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746142921.471633:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.471634:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142916 -> 1746142920 00002000:00010000:2.0:1746142921.471635:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142920 -> 1746142922 00002000:00010000:2.0:1746142921.471637:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746142921.471651:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867670656:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 51us (1623us total) trans 21474841341 rc 0/0 00000100:00100000:2.0:1746142921.471657:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15001 00000100:00100000:2.0:1746142921.471665:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15002 00000100:00100000:2.0:1746142921.471669:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+29:2006:x1830962867670784:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142921.471703:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:2.0:1746142921.471705:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.471707:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.471708:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142920 -> 1746142922 00002000:00010000:2.0:1746142921.471710:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:2.0:1746142921.471724:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:2006:x1830962867670784:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 54us (1687us total) trans 21474841342 rc 0/0 00000100:00100000:2.0:1746142921.471729:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15002 00000100:00100000:2.0:1746142921.471737:0:11421:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 15003 00000100:00100000:2.0:1746142921.471742:0:11421:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+32:2006:x1830962867670912:12345-192.168.204.50@tcp:2:lfs.0 00002000:00010000:2.0:1746142921.471777:0:11421:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746142921.471779:0:11421:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.471781:0:11421:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.471782:0:11421:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142920 -> 1746142922 00002000:00010000:2.0:1746142921.471784:0:11421:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746142921.471798:0:11421:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+33:2006:x1830962867670912:12345-192.168.204.50@tcp:2:lfs.0 Request processed in 56us (1745us total) trans 17179874095 rc 0/0 00000100:00100000:2.0:1746142921.471802:0:11421:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 15003 00000100:00100000:0.0:1746142921.473984:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.474453:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867671168 00000100:00100000:2.0:1746142921.474460:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867671168 00000100:00100000:2.0:1746142921.474685:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5366 00000100:00100000:2.0:1746142921.474693:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7f38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+30:356:x1830962867671168:12345-192.168.204.50@tcp:35:lfs.0 00000004:00010000:2.0:1746142921.474736:0:7233:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x55:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3a00/0x2fa243e067cceb72 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b81d expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.474765:0:7233:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.474774:0:7233:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.474780:0:7233:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.474802:0:7233:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 30 pid: 7230 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.474810:0:7233:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 30 pid: 7230 timeout: 795 lvb_type: 0 00000100:00100000:2.0:1746142921.474820:0:7233:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7233:1830962867931776:192.168.204.50@tcp:104: 00000100:00100000:2.0:1746142921.475300:0:7233:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800983b93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746142921.477857:0:7233:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7233:1830962867931776:192.168.204.50@tcp:104: 00010000:00010000:2.0:1746142921.477875:0:7233:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00000100:00100000:0.0:1746142921.478655:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1746142921.478728:0:7218:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867671296 00000100:00100000:3.0:1746142921.478733:0:7218:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867671296 00010000:00010000:3.0:1746142921.478757:0:7218:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 31 pid: 7230 timeout: 795 lvb_type: 0 00000100:00100000:3.0:1746142921.478779:0:7218:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6804 00000100:00100000:3.0:1746142921.478784:0:7218:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867671296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746142921.478795:0:7218:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746142921.478800:0:7218:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 31 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.478808:0:7218:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 31 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.478826:0:7218:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cbe6200/0x2fa243e067ccebb1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b824 expref: 31 pid: 7230 timeout: 795 lvb_type: 0 00010000:00010000:3.0:1746142921.478851:0:7218:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142921.478856:0:7218:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142921.478863:0:7218:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142921.478868:0:7218:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7233 initiator: MDT0 00010000:00010000:3.0:1746142921.479630:0:7218:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746142921.479730:0:7233:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.479740:0:7233:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00000040:00080000:2.0:1746142921.479957:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].730, 88 off71960 00000004:00080000:2.0:1746142921.479962:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479061646ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.479984:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].814, 88 off79448 00000004:00080000:2.0:1746142921.479987:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479087388ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480006:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].815, 88 off79536 00000004:00080000:2.0:1746142921.480008:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479108689ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480017:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].731, 88 off72048 00000004:00080000:2.0:1746142921.480019:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479119129ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.480026:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].732, 88 off72136 00000004:00080000:2.0:1746142921.480029:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479129009ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.480036:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].816, 88 off79624 00000004:00080000:2.0:1746142921.480039:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479138789ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480046:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].817, 88 off79712 00000004:00080000:2.0:1746142921.480048:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479148499ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480056:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].733, 88 off72224 00000004:00080000:2.0:1746142921.480058:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479158144ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.480065:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].818, 88 off79800 00000004:00080000:2.0:1746142921.480068:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479167859ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480075:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].734, 88 off72312 00000004:00080000:2.0:1746142921.480077:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479177156ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.480094:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].819, 88 off79888 00000004:00080000:2.0:1746142921.480096:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479196498ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480105:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].735, 88 off72400 00000004:00080000:2.0:1746142921.480108:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479207943ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.480116:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].820, 88 off79976 00000004:00080000:2.0:1746142921.480118:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479218508ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480125:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].736, 88 off72488 00000004:00080000:2.0:1746142921.480129:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479228939ns, next at 629431245375ns, rc = 0 00000040:00080000:2.0:1746142921.480136:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].821, 88 off80064 00000004:00080000:2.0:1746142921.480139:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479238769ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480145:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].822, 88 off80152 00000004:00080000:2.0:1746142921.480147:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 695479247656ns, next at 629431169684ns, rc = 0 00000040:00080000:2.0:1746142921.480154:0:7233:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].737, 88 off72576 00000004:00080000:2.0:1746142921.480156:0:7233:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 695479256289ns, next at 629431245375ns, rc = 0 00000100:00100000:3.0:1746142921.480227:0:7218:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+31:2006:x1830962867671296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1441us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746142921.480234:0:7218:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6804 00000001:00080000:0.0:1746142921.483463:0:8093:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936804 is committed 00000004:00080000:0.0:1746142921.483472:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 725 committed 00000004:00080000:0.0:1746142921.483486:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 810 committed 00010000:00010000:3.0:1746142921.483523:0:3749:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142921.483533:0:3749:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142921.483538:0:3749:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142921.483543:0:3749:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d3e00 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:3.0:1746142921.483547:0:3749:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142921.483553:0:3749:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13326 initiator: MDT0 00010000:00010000:3.0:1746142921.483566:0:3749:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:3.0:1746142921.483568:0:3749:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746142921.483571:0:3749:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142921.483571:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1746142921.483579:0:3749:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3e00/0x2fa243e067ccec36 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13326 initiator: MDT0 00000100:00100000:2.0:1746142921.483584:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867932032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.483600:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867931904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.483657:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.483675:0:1852:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867931904 00000100:00100000:1.0:1746142921.483682:0:1852:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867931904 00000100:00100000:1.0:1746142921.483711:0:1852:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15004 00000100:00100000:1.0:1746142921.483717:0:1852:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3763:x1830962867931904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142921.483812:0:1852:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746142921.483815:0:1852:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:1.0:1746142921.483817:0:1852:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:1.0:1746142921.483819:0:1852:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746142922 -> 1746142922 00002000:00010000:1.0:1746142921.483821:0:1852:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 2032 -> 2032 00000100:00100000:1.0:1746142921.483862:0:1852:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3763:x1830962867931904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (204us total) trans 21474841343 rc 0/0 00000100:00100000:1.0:1746142921.483867:0:1852:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15004 00000100:00100000:2.0:1746142921.483926:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.483965:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009809d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867932160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.483983:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.484011:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867932288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.484026:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746142921.484051:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1746142921.484053:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 809 committed 00000100:00100000:2.0:1746142921.484056:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800981cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867932416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142921.484056:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 724 committed 00000004:00080000:0.0:1746142921.484058:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 808 committed 00000004:00080000:0.0:1746142921.484060:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 723 committed 00000004:00080000:0.0:1746142921.484061:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 807 committed 00000004:00080000:0.0:1746142921.484063:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 722 committed 00000004:00080000:0.0:1746142921.484064:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 806 committed 00000004:00080000:0.0:1746142921.484066:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 721 committed 00000004:00080000:0.0:1746142921.484068:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 805 committed 00000004:00080000:0.0:1746142921.484069:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 804 committed 00000100:00100000:2.0:1746142921.484070:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746142921.484070:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 720 committed 00000004:00080000:0.0:1746142921.484072:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 719 committed 00000004:00080000:0.0:1746142921.484073:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 803 committed 00000004:00080000:0.0:1746142921.484075:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 802 committed 00000004:00080000:0.0:1746142921.484076:0:8093:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 718 committed 00000100:00100000:0.0:1746142921.484096:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932032 00000100:00100000:2.0:1746142921.484098:0:3765:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746142921.484099:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932032 00000100:00100000:2.0:1746142921.484102:0:3765:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867932544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142921.484113:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932160 00000100:00100000:2.0:1746142921.484114:0:3765:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142921.484114:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932160 00000100:00100000:0.0:1746142921.484123:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932288 00000100:00100000:0.0:1746142921.484125:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932288 00000100:00100000:2.0:1746142921.484131:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932416 00000100:00100000:2.0:1746142921.484133:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932416 00000100:00100000:0.0:1746142921.484134:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932544 00000100:00100000:0.0:1746142921.484135:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932544 00000100:00100000:0.0:1746142921.484146:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15005 00000100:00100000:2.0:1746142921.484151:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15006 00000100:00100000:0.0:1746142921.484151:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3765:x1830962867932032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.484155:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3765:x1830962867932160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746142921.484210:0:1853:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746142921.484213:0:1853:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:0.0:1746142921.484215:0:1853:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.484216:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb size from disk: 5066592 -> 5066592 00002000:00010000:0.0:1746142921.484217:0:1853:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb ctime from disk: 1746142922 -> 1746142922 00002000:00010000:2.0:1746142921.484219:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:0.0:1746142921.484219:0:1853:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x99:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:2.0:1746142921.484220:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:2.0:1746142921.484222:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb ctime from disk: 1746142922 -> 1746142922 00002000:00010000:2.0:1746142921.484223:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x9b:0x0] updating lvb blocks from disk: 5808 -> 5808 00000100:00100000:0.0:1746142921.484247:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3765:x1830962867932032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 95us (320us total) trans 21474841344 rc 0/0 00000100:00100000:0.0:1746142921.484258:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15005 00000100:00100000:0.0:1746142921.484267:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15007 00000100:00100000:0.0:1746142921.484272:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3762:x1830962867932288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.484279:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15008 00000100:00100000:3.0:1746142921.484285:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3765:x1830962867932544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142921.484321:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867932288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (294us total) trans 21474841346 rc 0/0 00000100:00100000:0.0:1746142921.484329:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15007 00000100:00100000:0.0:1746142921.484337:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15009 00000100:00100000:0.0:1746142921.484341:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3762:x1830962867932416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746142921.484386:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3762:x1830962867932416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (315us total) trans 21474841348 rc 0/0 00000100:00100000:0.0:1746142921.484391:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15009 00000004:00080000:0.0:1746142921.484421:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cf480/2, rc 0, transno 21474841348 00000100:00100000:0.0:1746142921.484426:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867932416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746142921.484433:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800981cf100/2, rc 0, transno 21474841346 00000100:00100000:0.0:1746142921.484435:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800981cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3762:1830962867932288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746142921.484539:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800981cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3765:x1830962867932160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 382us (554us total) trans 21474841345 rc 0/0 00000100:00100000:2.0:1746142921.484544:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15006 00000004:00010000:2.0:1746142921.484580:0:7233:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a7f38450 reply state ffff88009a392400 transno 8589936804 ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484590:0:7233:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484596:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.484598:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746142921.484600:0:7233:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746142921.484603:0:7233:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.484605:0:7233:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:3.0:1746142921.484659:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ceb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+19:3765:x1830962867932544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 375us (544us total) trans 21474841347 rc 0/0 00000100:00100000:3.0:1746142921.484664:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15008 00000004:00080000:3.0:1746142921.484685:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809f480/2, rc 0, transno 21474841343 00000100:00100000:3.0:1746142921.484688:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867931904:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746142921.484740:0:7233:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d3a00/0x2fa243e067cceb72 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x55:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b81d expref: 27 pid: 7230 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746142921.484792:0:7233:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746142921.484799:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7f38450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867671168:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 10108us (10819us total) trans 8589936804 rc 0/0 00000100:00100000:2.0:1746142921.484805:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5366 00010000:00010000:2.0:1746142921.484838:0:3748:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484843:0:3748:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484849:0:3748:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484853:0:3748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009471e800 already unused, calling callback (ffffffffa0f2d690) 00010000:00010000:2.0:1746142921.484855:0:3748:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484859:0:3748:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484865:0:3748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.484866:0:3748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142921.484868:0:3748:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7233 initiator: MDT0 00010000:00010000:2.0:1746142921.484872:0:3748:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009471e800/0x2fa243e067ccec67 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7233 initiator: MDT0 00000100:00100000:1.0:1746142921.485097:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746142921.485104:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485126:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867932928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142921.485126:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.485138:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867932672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485140:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.485149:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.485150:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.485170:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485172:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.485183:0:3763:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1746142921.485183:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.485187:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867932800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142921.485191:0:3764:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746142921.485195:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485198:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.485206:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.485207:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.485213:0:3764:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485217:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.485223:0:3764:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746142921.485224:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485236:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746142921.485239:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933056 00000100:00100000:1.0:1746142921.485242:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933056 00000100:00100000:3.0:1746142921.485247:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932928 00000100:00100000:3.0:1746142921.485249:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932928 00000100:00100000:1.0:1746142921.485253:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932672 00000100:00100000:1.0:1746142921.485255:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932672 00000100:00100000:3.0:1746142921.485258:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933440 00000100:00100000:3.0:1746142921.485259:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933440 00000100:00100000:1.0:1746142921.485260:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933568 00000100:00100000:1.0:1746142921.485261:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933568 00000100:00100000:3.0:1746142921.485264:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867932800 00000100:00100000:3.0:1746142921.485265:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867932800 00000100:00100000:1.0:1746142921.485267:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933184 00000100:00100000:1.0:1746142921.485268:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933184 00000100:00100000:3.0:1746142921.485271:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933312 00000100:00100000:3.0:1746142921.485272:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933312 00000100:00100000:1.0:1746142921.485273:0:12211:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933696 00000100:00100000:1.0:1746142921.485275:0:12211:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933696 00000100:00100000:3.0:1746142921.485277:0:9579:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933824 00000100:00100000:3.0:1746142921.485279:0:9579:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933824 00000100:00100000:1.0:1746142921.485281:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15010 00000100:00100000:1.0:1746142921.485285:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867933056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485286:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15011 00000100:00100000:3.0:1746142921.485289:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3763:x1830962867932928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142921.485331:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746142921.485333:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:1.0:1746142921.485335:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:1.0:1746142921.485337:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb ctime from disk: 1746142922 -> 1746142922 00002000:00010000:1.0:1746142921.485338:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x79:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746142921.485341:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c0e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867932928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (201us total) trans 21474841349 rc 0/0 00000100:00100000:3.0:1746142921.485347:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15011 00000100:00100000:1.0:1746142921.485353:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867933056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (227us total) trans 17179874096 rc 0/0 00000100:00100000:3.0:1746142921.485357:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15012 00000100:00100000:1.0:1746142921.485359:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15010 00000100:00100000:3.0:1746142921.485360:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867932672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.485367:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15013 00000100:00100000:1.0:1746142921.485370:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867933440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142921.485393:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142921.485395:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:3.0:1746142921.485396:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00002000:00010000:3.0:1746142921.485398:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746142922 -> 1746142922 00002000:00010000:3.0:1746142921.485399:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746142921.485404:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3763:x1830962867933440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (243us total) trans 17179874098 rc 0/0 00000100:00100000:1.0:1746142921.485408:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15013 00000100:00100000:3.0:1746142921.485411:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3764:x1830962867932672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (261us total) trans 17179874097 rc 0/0 00000100:00100000:3.0:1746142921.485416:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15012 00000100:00100000:1.0:1746142921.485694:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15014 00000100:00100000:3.0:1746142921.485697:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15015 00000100:00100000:1.0:1746142921.485699:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867933568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485701:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3763:x1830962867932800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746142921.485732:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746142921.485734:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142921.485736:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746142921.485737:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142921.485739:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 8128 -> 8128 00000100:00100000:1.0:1746142921.485743:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867933568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (560us total) trans 17179874099 rc 0/0 00000100:00100000:1.0:1746142921.485748:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15014 00000100:00100000:3.0:1746142921.485751:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867932800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (552us total) trans 21474841350 rc 0/0 00000100:00100000:3.0:1746142921.485755:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15015 00000100:00100000:1.0:1746142921.485758:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15016 00000100:00100000:1.0:1746142921.485761:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3764:x1830962867933184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485762:0:9579:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15017 00000100:00100000:3.0:1746142921.485766:0:9579:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3763:x1830962867933312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746142921.485796:0:12211:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:3.0:1746142921.485798:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0380/2, rc 0, transno 21474841350 00002000:00010000:1.0:1746142921.485799:0:12211:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb mtime from disk: 1746142920 -> 1746142920 00002000:00010000:1.0:1746142921.485800:0:12211:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb atime from disk: 1746142920 -> 1746142920 00000100:00100000:3.0:1746142921.485801:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867932800:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746142921.485802:0:12211:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb ctime from disk: 1746142922 -> 1746142922 00002000:00010000:1.0:1746142921.485803:0:12211:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7b:0x0] updating lvb blocks from disk: 4104 -> 4104 00000004:00080000:3.0:1746142921.485807:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb2680/2, rc 0, transno 21474841349 00000100:00100000:3.0:1746142921.485810:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867932928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746142921.485816:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05500/2, rc 0, transno 17179874098 00000100:00100000:3.0:1746142921.485821:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.485821:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3764:x1830962867933184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (614us total) trans 17179874101 rc 0/0 00000100:00100000:1.0:1746142921.485825:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15016 00000004:00080000:0.0:1746142921.485825:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ceb0e00/2, rc 0, transno 21474841347 00000100:00100000:0.0:1746142921.485829:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ceb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867932544:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746142921.485834:0:12211:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15018 00000100:00100000:1.0:1746142921.485837:0:12211:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3764:x1830962867933696:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142921.485837:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809d180/2, rc 0, transno 21474841345 00000100:00100000:0.0:1746142921.485839:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867932160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.485842:0:3763:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746142921.485845:0:3765:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009809ca80/2, rc 0, transno 21474841344 00000100:00100000:0.0:1746142921.485847:0:3765:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009809ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3765:1830962867932032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746142921.485858:0:3763:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746142921.485862:0:1853:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867933952 00000100:00100000:0.0:1746142921.485865:0:1853:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867933952 00000100:00100000:3.0:1746142921.485874:0:11943:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15019 00000100:00100000:3.0:1746142921.485878:0:11943:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867933824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.485880:0:12211:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096af1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3764:x1830962867933696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (656us total) trans 17179874102 rc 0/0 00000100:00100000:0.0:1746142921.485885:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15020 00000100:00100000:1.0:1746142921.485888:0:12211:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15018 00000100:00100000:0.0:1746142921.485889:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3763:x1830962867933952:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142921.485922:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07100/2, rc 0, transno 17179874101 00000100:00100000:1.0:1746142921.485925:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142921.485931:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0e0a80/2, rc 0, transno 17179874102 00000100:00100000:1.0:1746142921.485933:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142921.485938:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07800/2, rc 0, transno 17179874099 00000100:00100000:1.0:1746142921.485941:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746142921.485943:0:11943:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867933824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (706us total) trans 17179874103 rc 0/0 00000004:00080000:1.0:1746142921.485946:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05f80/2, rc 0, transno 17179874096 00000100:00100000:3.0:1746142921.485947:0:11943:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15019 00000100:00100000:1.0:1746142921.485948:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867933056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746142921.485953:0:3764:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c07b80/2, rc 0, transno 17179874097 00000100:00100000:1.0:1746142921.485955:0:3764:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3764:1830962867932672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746142921.485963:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3763:x1830962867933952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (104us total) trans 17179874104 rc 0/0 00000100:00100000:0.0:1746142921.485968:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15020 00000004:00080000:3.0:1746142921.486100:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800938dea00/2, rc 0, transno 17179874104 00000100:00100000:3.0:1746142921.486104:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933952:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746142921.486109:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c0e2a00/2, rc 0, transno 17179874103 00000100:00100000:3.0:1746142921.486112:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c0e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933824:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746142921.486130:0:9579:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746142921.486133:0:9579:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142921.486134:0:9579:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746142858 -> 1746142858 00002000:00010000:3.0:1746142921.486136:0:9579:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746142882 -> 1746142882 00002000:00010000:3.0:1746142921.486138:0:9579:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 4032 -> 4032 00000100:00100000:3.0:1746142921.486394:0:9579:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3763:x1830962867933312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 626us (1175us total) trans 17179874100 rc 0/0 00000100:00100000:3.0:1746142921.486398:0:9579:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15017 00000004:00080000:2.0:1746142921.486446:0:3763:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091c05880/2, rc 0, transno 17179874100 00000100:00100000:2.0:1746142921.486449:0:3763:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3763:1830962867933312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746142921.496179:0:3756:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.496237:0:13326:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867671424 00000100:00100000:2.0:1746142921.496245:0:13326:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867671424 00000100:00100000:2.0:1746142921.496292:0:13326:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 14606 00000100:00100000:2.0:1746142921.496299:0:13326:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+26:356:x1830962867671424:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1746142921.496316:0:13326:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746142921.496332:0:13326:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccec6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x95bc94077eb8b894 expref: -99 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.496376:0:13326:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccec6e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b894 expref: 27 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.496388:0:13326:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131322a00/0x2fa243e067ccec6e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x95bc94077eb8b894 expref: 27 pid: 13326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746142921.496402:0:13326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x55:0x0].0x0 (ffff880098b3eb00) 00010000:00010000:2.0:1746142921.496405:0:13326:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746142921.496407:0:13326:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131322a00, rc 0) 00000100:00100000:2.0:1746142921.496449:0:13326:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013644ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867671424:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 150us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746142921.496455:0:13326:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 14606 00000100:00100000:0.0:1746142921.499706:0:3757:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1746142921.499763:0:7233:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830962867671680 00000100:00100000:2.0:1746142921.499771:0:7233:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830962867671680 00000100:00100000:2.0:1746142921.499811:0:7233:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5367 00000100:00100000:2.0:1746142921.499818:0:7233:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880096094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+27:356:x1830962867671680:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1746142921.500004:0:7233:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880096094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96cc7c44-1c57-46a5-be83-bd77aad4cb6f+28:356:x1830962867671680:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 182us (301us total) trans 8589936805 rc 0/0 00000100:00100000:2.0:1746142921.500010:0:7233:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5367 00010000:00010000:1.0:1746142922.136991:0:7549:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746142922.232714:0:13383:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200a: @@@@@@ FAIL: final resync failed Debug log: 70174 lines, 70174 kept, 0 dropped, 0 bad.